ChartQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | ChartQA | Accuracy89.8 | 239 | |
| Chart Question Answering | ChartQA | Accuracy95.9 | 229 | |
| Chart Question Answering | ChartQA (test) | Accuracy93.2 | 129 | |
| Chart Understanding | ChartQA | Accuracy91.2 | 83 | |
| Visual Question Answering | ChartQA (test) | Accuracy90.8 | 58 | |
| Chart Understanding | ChartQA (test) | Accuracy90.8 | 52 | |
| Chart Understanding | ChartQA 1.0 (test) | Avg Relaxed Accuracy90.8 | 33 | |
| Chart Question Answering | ChartQA (val) | Relaxed Acc (avg.)77.8 | 25 | |
| Visual Question Answering | ChartQA (val) | Accuracy81.9 | 25 | |
| Chart Understanding and Reasoning | ChartQA | Accuracy86.6 | 24 | |
| Visual Question Answering | ChartQA 102 (test) | Accuracy94.1 | 23 | |
| Chart-based Question Answering | ChartQA Pro | Accuracy52.62 | 22 | |
| Chart Understanding | ChartQA | ChartQA Score91.7 | 19 | |
| OCR VQA | ChartQA (test) | Accuracy87.92 | 18 | |
| Chart Question Answering | ChartQA Average | Accuracy89.61 | 16 | |
| Chart Question Answering | ChartQA Human-authored | Accuracy83.3 | 16 | |
| Chart Question Answering | ChartQA augmented | Accuracy95.91 | 16 | |
| Chart Information Extraction | ChartQA (val) | mPrecision (IoU Range)85.91 | 15 | |
| OCR-based Visual Question Answering | ChartQA 2022 (test) | Accuracy84.6 | 13 | |
| Chart-to-Table | ChartQA (test) | RMSF191.53 | 12 | |
| Chart Understanding and Reasoning | ChartQAPro | Score51.9 | 12 | |
| Chart VQA | ChartQAPro | Accuracy55.8 | 9 | |
| Chart Question Answering | ChartQA augmented questions (test) | Relaxed Accuracy91.36 | 9 | |
| Chart Question Answering | ChartQA human questions subset (test) | Relaxed Accuracy67.6 | 9 | |
| General Task | ChartQA | Accuracy0.895 | 8 |
Showing 25 of 37 rows