SAT
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Mathematical Reasoning | SAT-Math | SAT Math Accuracy97.66 | 44 | |
| Spatial Mental Modeling | SAT-Real | AVG93.9 | 41 | |
| Image Classification | SAT-6 (test) | Accuracy99.84 | 21 | |
| Mathematical Reasoning | SAT | Accuracy98.2 | 18 | |
| Spatial Mental Modeling | SAT (synthesized) | EgoM95.4 | 15 | |
| Analogy recognition | SAT | Accuracy60.78 | 15 | |
| Spatial Reasoning | SAT | Overall Acc80 | 11 | |
| Spatial Reasoning | SAT ood (test) | Accuracy79.7 | 11 | |
| Analogy Generation | SAT (test) | Accuracy91 | 11 | |
| Analogy Generation | SAT | Accuracy0.91 | 11 | |
| 3D/4D Video Question Answering | SAT | Accuracy64.8 | 8 | |
| Spatial Reasoning | SAT iid (val) | Accuracy92.7 | 8 | |
| Image Classification | SAT | Accuracy0.2835 | 7 | |
| Spatial Awareness | SAT | Accuracy (All)74.67 | 6 | |
| Human Proficiency Exam | SAT | SAT Reading Score85.1 | 6 | |
| Mathematical Reasoning | SAT (test) | Accuracy71.9 | 5 | |
| Active Visual Search | SAT (real) | Accuracy77.33 | 4 | |
| Active Visual Search | SAT (synthetic) | Accuracy69.33 | 4 | |
| Visual Question Answering | SAT 1.0 (test) | Accuracy (MCQ)65.3 | 4 | |
| Mathematical Problem Solving | SAT | Accuracy84.4 | 4 | |
| Question Answering | SAT | Accuracy78.64 | 3 | |
| Mathematical Problem Solving | SAT (test) | maj@k81.3 | 2 | |
| Reading and Writing Proficiency | SAT Evidence-Based Reading & Writing | SAT EBRW Percentile87 | 1 |
Showing 23 of 23 rows