SPBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Spatial Reasoning | SPBench SI | Accuracy58.6 | 42 | |
| Multi-image spatial reasoning | SPBench-MV | Accuracy80.4 | 19 | |
| Spatial Reasoning | SPBench MV | NQ Score68.2 | 14 | |
| Spatial Reasoning | SPBench | SPBench Score55.9 | 14 | |
| Spatial Reasoning | SPBench (test) | SI Score70.2 | 14 | |
| Spatial Reasoning | SPBench SI, MV 35 | Accuracy70.6 | 11 | |
| Virtual Standardized Patient simulation | SPBench | QC Score97.17 | 9 | |
| Personality Steering | SPBench | Agreeableness (A) Mean Score9.67 | 6 |
Showing 8 of 8 rows