RealworldQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | RealworldQA | Accuracy80.2 | 327 | |
| Real-world Visual Question Answering | RealWorldQA | Accuracy79.35 | 183 | |
| Real-world Visual Understanding | RealWorldQA | Accuracy81.4 | 110 | |
| Real-world QA | RealworldQA | Accuracy81.8 | 75 | |
| Vision-centric Reasoning | RealWorldQA | Accuracy75.4 | 68 | |
| General Visual Understanding | RealWorldQA | Accuracy71.3 | 64 | |
| Real-world Multimodal Reasoning | RealWorldQA | Accuracy75.4 | 62 | |
| Real-world Question Answering | RealWorldQA | Overall Score78.7 | 58 | |
| Spatial Reasoning | RealWorldQA | Accuracy69.67 | 52 | |
| Visual Question Answering | RealWorldQA (test) | Accuracy79 | 47 | |
| Multimodal Reasoning | RealWorldQA | Accuracy81.39 | 40 | |
| Multimodal Reasoning | RealWorldQA | Mean@8 Accuracy70.46 | 40 | |
| Real-world Visual Understanding | RealWorldQA | Score72.29 | 39 | |
| Perception and Reasoning | RealWorldQA | Score74.2 | 37 | |
| Multimodal Understanding | RealWorldQA | RWQA Score78 | 33 | |
| Visual Question Answering | RealWorldQA xAI 2024 (test) | Accuracy72.81 | 32 | |
| General Visual Question Answering | RealWorldQA | Score73.1 | 32 | |
| Real-world Visual Understanding | RealWorldQA (test) | Final Performance77.1 | 30 | |
| Spatial Understanding | RealWorldQA | RWQA Score66.01 | 30 | |
| Visual Question Answering | RealWorldQA (RWQA) | Score68.5 | 26 | |
| General Visual Question Answering | RealWorldQA | Accuracy71.9 | 25 | |
| General Utility | RealWorldQA | RealWorldQA Score72.2 | 21 | |
| Real-world Multimodal Understanding | RealWorldQA | Accuracy73.99 | 21 | |
| General Reasoning & Understanding | RealWorldQA | Accuracy (RealWorldQA)72.6 | 21 | |
| Real-world Multimodal Interaction | RealWorldQA (test) | Accuracy77.8 | 18 |
Showing 25 of 56 rows