LogicVista
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Reasoning | LogicVista | Accuracy61.7 | 99 | |
| Logical Reasoning | LogicVista | Accuracy58.2 | 84 | |
| Visual Logical Reasoning | LogicVista | Accuracy70.02 | 70 | |
| Logical Reasoning | LogicVista | Avg Pass@864.9 | 48 | |
| Multimodal Logical Reasoning | LogicVista | Accuracy77 | 47 | |
| Multimodal Mathematical Reasoning | LogicVista | Accuracy75.2 | 34 | |
| Visual Reasoning | LogicVista | Accuracy52.13 | 26 | |
| STEM Reasoning | LogicVista | Accuracy70.02 | 23 | |
| Multimodal Logical Reasoning | LogicVista (test) | Score64.4 | 16 | |
| Visual Logical Reasoning | LogicVista | BoN@8 Accuracy60.4 | 12 | |
| Logical Reasoning | LogicVista (test) | Accuracy60.3 | 12 | |
| Visual Mathematical Reasoning | LogicVista | Accuracy73.8 | 12 | |
| STEM & Puzzle | LogicVista (test) | Accuracy71.4 | 11 | |
| Mathematical Reasoning | LogicVista | Accuracy73.8 | 9 | |
| Math & Reasoning | LogicVista | Score61.3 | 6 | |
| Universal multi-modal reasoning | LogicVista | Pass@146.53 | 2 |
Showing 16 of 16 rows