MMSI-Bench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Spatial Reasoning | MMSI-Bench (test) | PR Score52.8 | 29 | |
| Spatial Reasoning | MMSI-Bench | Accuracy97.2 | 24 | |
| Spatial Reasoning | MMSI-Bench MindJourney Subset (162 questions) (test) | Accuracy0.358 | 19 | |
| 3D/4D Video Question Answering | MMSI-Bench | Accuracy40.7 | 12 | |
| Spatial Reasoning (Multi-Image) | MMSI-Bench | Accuracy31.3 | 8 | |
| Multi-image Understanding | MMSI-Bench | Accuracy36.9 | 6 | |
| 3D/4D Visual Question Answering | MMSI Bench 1.0 (test) | Avg Multiple Choice Accuracy33.3 | 4 | |
| Visual Spatial Reasoning | MMSI-Bench | Cam-Cam Accuracy36.6 | 4 |
Showing 8 of 8 rows