ChartQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | ChartQA | Accuracy90.5 | 519 | |
| Chart Question Answering | ChartQA | Accuracy95.9 | 371 | |
| Chart Question Answering | ChartQA (test) | Accuracy95.3 | 190 | |
| Chart Understanding | ChartQA | Accuracy91.2 | 159 | |
| Chart Understanding | ChartQA (test) | Accuracy90.8 | 113 | |
| Visual Question Answering | ChartQA (test) | Accuracy90.8 | 93 | |
| Chart Understanding and Reasoning | ChartQA | Accuracy89.6 | 87 | |
| Chart Question Answering | ChartQA | Accuracy90.49 | 59 | |
| Chart-based Question Answering | ChartQA Pro | Accuracy76.9 | 52 | |
| Chart Understanding | ChartQA | Score88.4 | 47 | |
| Chart Question Answering | ChartQA | Score94.4 | 38 | |
| Chart Understanding | ChartQA 1.0 (test) | Avg Relaxed Accuracy90.8 | 33 | |
| Chart Question Answering | ChartQA augmented | Accuracy95.91 | 26 | |
| Chart Question Answering | ChartQAPRO | Overall Accuracy66.8 | 25 | |
| Visual Math | ChartQA | Accuracy89 | 25 | |
| Chart Question Answering | ChartQA (val) | Relaxed Acc (avg.)77.8 | 25 | |
| Visual Question Answering | ChartQA (val) | Accuracy81.9 | 25 | |
| Visual Question Answering | ChartQA EvoCharts (test) | Accuracy91.07 | 24 | |
| Visual Question Answering | ChartQA | Score81.5 | 24 | |
| Visual Question Answering | ChartQA 102 (test) | Accuracy94.1 | 23 | |
| Document and chart understanding | ChartQA (test) | Accuracy89.5 | 22 | |
| OCR VQA | ChartQA (test) | Accuracy87.92 | 22 | |
| Chart Question Answering | ChartQA | Accuracy83 | 21 | |
| Chart Question Answering | ChartQA | Score86.6 | 21 | |
| Chart Question Answering | ChartQA | AUC87.95 | 21 |
Showing 25 of 79 rows