ChartQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | ChartQA | Accuracy90.5 | 620 | |
| Chart Question Answering | ChartQA | Accuracy95.9 | 404 | |
| Chart Question Answering | ChartQA (test) | Accuracy95.3 | 196 | |
| Chart Question Answering | ChartQA | Accuracy90.49 | 165 | |
| Chart Understanding | ChartQA | Accuracy91.2 | 159 | |
| Chart Understanding and Reasoning | ChartQA | Accuracy89.6 | 143 | |
| Chart Understanding | ChartQA (test) | Accuracy90.8 | 119 | |
| Visual Question Answering | ChartQA (test) | Accuracy90.8 | 95 | |
| Chart-based Question Answering | ChartQA Pro | Accuracy76.9 | 52 | |
| Chart Question Answering | ChartQA | Score94.4 | 48 | |
| Chart Understanding | ChartQA | Score88.4 | 47 | |
| Chart Question Answering | ChartQA | Accuracy83 | 37 | |
| Chart Understanding | ChartQA 1.0 (test) | Avg Relaxed Accuracy90.8 | 33 | |
| Visual Question Answering | ChartQA | Score90.9 | 32 | |
| Chart Question Answering | ChartQA | Overall Accuracy (OA)94.7 | 28 | |
| Chart Question Answering | ChartQA | ChartQA Score88.12 | 28 | |
| Chart Question Answering | ChartQA augmented | Accuracy95.91 | 26 | |
| Chart Question Answering | ChartQAPRO | Overall Accuracy66.8 | 25 | |
| Visual Math | ChartQA | Accuracy89 | 25 | |
| Chart Question Answering | ChartQA (val) | Relaxed Acc (avg.)77.8 | 25 | |
| Visual Question Answering | ChartQA (val) | Accuracy81.9 | 25 | |
| Visual Question Answering | ChartQA EvoCharts (test) | Accuracy91.07 | 24 | |
| Visual Question Answering | ChartQA 102 (test) | Accuracy94.1 | 23 | |
| Document and chart understanding | ChartQA (test) | Accuracy89.5 | 22 | |
| OCR VQA | ChartQA (test) | Accuracy87.92 | 22 |
Showing 25 of 91 rows