VSR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | VSR | Top-1 Accuracy73.77 | 26 | |
| Spatial Relationship Understanding | VSR | Overall Accuracy73.9 | 17 | |
| Spatial Reasoning | VSR | LLM-Judge Accuracy84.3 | 12 | |
| 2D Spatial Reasoning | VSR | Accuracy75.6 | 10 | |
| Spatial Reasoning | VSR (ood) | Accuracy84.8 | 10 | |
| Directional attribution | VSR (n=240) | DAE96.8 | 8 | |
| Confidence estimation | VSR (test) | AUROC67.4 | 6 | |
| Spatial Reasoning | VSR zero-shot (test) | Accuracy (zero-shot)63.67 | 6 | |
| General | VSR | Score80.6 | 3 |
Showing 9 of 9 rows