VSR
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | VSR | Top-1 Accuracy73.77 | 26 | |
| Spatial Relationship Understanding | VSR | Overall Accuracy73.9 | 17 | |
| 2D Spatial Reasoning | VSR | Accuracy75.6 | 10 | |
| Spatial Reasoning | VSR (ood) | Accuracy84.8 | 10 | |
| Confidence estimation | VSR (test) | AUROC67.4 | 6 | |
| Spatial Reasoning | VSR zero-shot (test) | Accuracy (zero-shot)63.67 | 6 | |
| General | VSR | Score80.6 | 3 |
Showing 7 of 7 rows