SPAR-Bench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Spatial Reasoning | SPAR-Bench | Overall Score54.72 | 23 | |
| Spatial Reasoning | SPAR-Bench full | Average Score68.35 | 23 | |
| Single-image spatial reasoning | SPAR-Bench SI | Low Score54.3 | 15 | |
| Multi-image Spatial Reasoning | SPAR-Bench-MV (test) | Score (Low Difficulty)43.7 | 15 | |
| Spatial Reasoning (Multi-Image) | SPAR-Bench | Accuracy52.6 | 13 | |
| Spatial Reasoning | SPAR-Bench tiny | Medium Difficulty Score72.32 | 12 | |
| Spatial Reasoning | SPAR-Bench SI, MV 91 | Accuracy63.3 | 11 |
Showing 7 of 7 rows