VSI-Bench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Spatial Reasoning | VSI-Bench | R.Dr.95.8 | 370 | |
| Video Reasoning | VSI-Bench | Accuracy61.9 | 101 | |
| Spatial Reasoning | VSI-Bench 1.0 (test) | Average Score79.2 | 101 | |
| 3D Question Answering | VSI-Bench | Average Score64.7 | 88 | |
| Visual Spatial Intelligence | VSI-Bench | Average Score79.2 | 85 | |
| Video spatial reasoning | VSI-Bench | Average Score79.2 | 75 | |
| Spatial Reasoning | VSI-Bench tiny | Avg Score51.61 | 39 | |
| Visual Spatial Instruction | VSI-Bench | Relative Direction (Hard)40.5 | 34 | |
| Spatial Reasoning | VSI-Bench (test) | Avg Score79.2 | 31 | |
| Spatial Reasoning (Video) | VSI-Bench | Accuracy79.2 | 30 | |
| Video Reasoning | VSI-Bench (test) | Accuracy38.6 | 29 | |
| Video Visual Question Answering | VSI-Bench | ACC (MCA)68.5 | 28 | |
| Video Spatial Understanding | VSI-Bench 500 QA 1.0 | Accuracy49.7 | 25 | |
| Video Understanding | VSI-Bench | Accuracy49.5 | 23 | |
| Video Understanding | VSI-Bench | VSI-Bench Score37 | 21 | |
| Visual Spatial Understanding | VSI-Bench static 1.0 | Average Score89.5 | 20 | |
| Spatial Reasoning | VSI-Bench tiny | Pass@1 Accuracy (Rel Dist)64 | 19 | |
| Spatial Reasoning | VSI-Bench Vanilla regime | Avg Score50.5 | 19 | |
| Multi-view global spatial scene understanding | VSI-Bench Standard | Relative Distance Accuracy70.5 | 17 | |
| Multi-view global spatial scene understanding | VSI-Bench | Relative Distance Score94.7 | 16 | |
| Spatial perception and reasoning | VSI-Bench (offline) | Average Score65.9 | 15 | |
| Spatial Reasoning | VSI-Bench 59 (test) | Object Count Score72.5 | 14 | |
| Fine-grained video-based spatial reasoning | VSI-Bench | Avg Score60.6 | 13 | |
| Video Spatial Intelligence | VSI-Bench 123 (test) | Object Count70 | 13 | |
| Visual Spatial Inference | VSI-Bench Tiny video-input | Object Count Score69 | 12 |
Showing 25 of 38 rows