LogicVista
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Reasoning | LogicVista | Accuracy84.78 | 147 | |
| Logical Reasoning | LogicVista | Accuracy81.4 | 113 | |
| Visual Logical Reasoning | LogicVista | Accuracy70.02 | 70 | |
| Multimodal Logical Reasoning | LogicVista | Accuracy77 | 63 | |
| Logical Reasoning | LogicVista | Avg Pass@864.9 | 48 | |
| Multimodal Mathematical Reasoning | LogicVista | Accuracy75.2 | 46 | |
| Mathematical Reasoning | LogicVista | Accuracy73.8 | 27 | |
| Visual Reasoning | LogicVista | Accuracy52.13 | 26 | |
| STEM Reasoning | LogicVista | Accuracy70.02 | 23 | |
| General Multimodal Reasoning | LogicVista | Score50.56 | 21 | |
| Logic Reasoning | LogicVista | LogicVista Accuracy61.97 | 16 | |
| Multimodal Logical Reasoning | LogicVista (test) | Score64.4 | 16 | |
| Visual Logical Reasoning | LogicVista | BoN@8 Accuracy60.4 | 12 | |
| Logical Reasoning | LogicVista (test) | Accuracy60.3 | 12 | |
| Visual Mathematical Reasoning | LogicVista | Accuracy73.8 | 12 | |
| STEM & Puzzle | LogicVista (test) | Accuracy71.4 | 11 | |
| Visual logic | LogicVista | Top-1 Accuracy60.01 | 7 | |
| Math & Reasoning | LogicVista | Score61.3 | 6 | |
| Universal multi-modal reasoning | LogicVista | Pass@146.53 | 2 |
Showing 19 of 19 rows