VisualProbe
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Search | VisualProbe (test) | Success Rate (Easy)71.3 | 22 | |
| Visual Reasoning | VisualProbe Hard | Accuracy0.434 | 18 | |
| Visual Reasoning | VisualProbe Medium | Accuracy40.6 | 18 | |
| Visual Reasoning | VisualProbe Easy | Accuracy65.4 | 18 | |
| Visual Reasoning | VisualProbe | Score42.7 | 17 | |
| Visual Reasoning | VisualProbe (VP) cross-domain (test) | Accuracy0.4357 | 15 | |
| Visual Reasoning | VisualProbe (test) | Accuracy (Hard)47.2 | 15 | |
| Visual Perception | VisualProbe | Score53.9 | 10 | |
| Visual Question Answering | VisualProbe (Overall) | Accuracy49.7 | 9 | |
| Visual Question Answering | VisualProbe Hard | Accuracy47.2 | 9 | |
| Visual Question Answering | VisualProbe (Medium) | Accuracy41.4 | 9 | |
| Visual Question Answering | VisualProbe Easy | Accuracy67.4 | 9 | |
| Spatial Reasoning | VisualProbe | Accuracy55.1 | 5 | |
| Agentic Reasoning | VisualProbe Hard | Accuracy75.9 | 3 | |
| Agentic Reasoning | VisualProbe Medium | Accuracy84.7 | 3 |
Showing 15 of 15 rows