LogicVista
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multimodal Reasoning | LogicVista | Accuracy84.78 | 172 | |
| Logical Reasoning | LogicVista | Accuracy81.4 | 163 | |
| Multimodal Logical Reasoning | LogicVista | Accuracy77 | 76 | |
| Visual Logical Reasoning | LogicVista | Accuracy70.02 | 70 | |
| Logical Reasoning | LogicVista | Avg Pass@864.9 | 48 | |
| Multimodal Mathematical Reasoning | LogicVista | Accuracy75.2 | 46 | |
| Mathematical Reasoning | LogicVista | Accuracy73.8 | 27 | |
| Visual Reasoning | LogicVista | Accuracy52.13 | 26 | |
| STEM Reasoning | LogicVista | Accuracy70.02 | 23 | |
| General Multimodal Reasoning | LogicVista | Score50.56 | 21 | |
| Logic Reasoning | LogicVista | LogicVista Accuracy61.97 | 16 | |
| Multimodal Logical Reasoning | LogicVista (test) | Score64.4 | 16 | |
| Visual Logical Reasoning | LogicVista | BoN@8 Accuracy60.4 | 12 | |
| Logical Reasoning | LogicVista (test) | Accuracy60.3 | 12 | |
| Visual Mathematical Reasoning | LogicVista | Accuracy73.8 | 12 | |
| STEM & Puzzle | LogicVista (test) | Accuracy71.4 | 11 | |
| Visual Puzzles | LogicVista | Pass@1 Accuracy81.9 | 7 | |
| Visual logic | LogicVista | Top-1 Accuracy60.01 | 7 | |
| Math & Reasoning | LogicVista | Score61.3 | 6 | |
| Multimodal Logical Reasoning | LogicVista v1.0 (test) | Accuracy45 | 5 | |
| Universal multi-modal reasoning | LogicVista | Pass@146.53 | 2 |
Showing 21 of 21 rows