ChartQA
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Visual Question Answering | ChartQA | Accuracy90.5 | 371 | |
| Chart Question Answering | ChartQA | Accuracy95.9 | 356 | |
| Chart Question Answering | ChartQA (test) | Accuracy95.3 | 176 | |
| Chart Understanding | ChartQA | Accuracy91.2 | 127 | |
| Chart Understanding | ChartQA (test) | Accuracy90.8 | 92 | |
| Visual Question Answering | ChartQA (test) | Accuracy90.8 | 86 | |
| Chart Understanding and Reasoning | ChartQA | Accuracy89.6 | 61 | |
| Chart-based Question Answering | ChartQA Pro | Accuracy76.9 | 52 | |
| Chart Understanding | ChartQA 1.0 (test) | Avg Relaxed Accuracy90.8 | 33 | |
| Chart Question Answering | ChartQAPRO | Overall Accuracy66.8 | 25 | |
| Chart Question Answering | ChartQA (val) | Relaxed Acc (avg.)77.8 | 25 | |
| Visual Question Answering | ChartQA (val) | Accuracy81.9 | 25 | |
| Chart Understanding | ChartQA | Score88.4 | 23 | |
| Visual Question Answering | ChartQA 102 (test) | Accuracy94.1 | 23 | |
| OCR VQA | ChartQA (test) | Accuracy87.92 | 22 | |
| Chart Question Answering | ChartQA | Score86.6 | 21 | |
| Chart Question Answering | ChartQA | AUC87.95 | 21 | |
| Chart Question Answering | ChartQA | Score94.4 | 20 | |
| Chart Understanding | ChartQA | ChartQA Score91.7 | 19 | |
| Chart Question Answering | ChartQA Average | Accuracy89.61 | 16 | |
| Chart Question Answering | ChartQA Human-authored | Accuracy83.3 | 16 | |
| Chart Question Answering | ChartQA augmented | Accuracy95.91 | 16 | |
| Chart Information Extraction | ChartQA (val) | mPrecision (IoU Range)85.91 | 15 | |
| Visual Document Retrieval | ChartQA | NDCG@593.6 | 13 | |
| OCR-based Visual Question Answering | ChartQA 2022 (test) | Accuracy84.6 | 13 |
Showing 25 of 54 rows