AI2D
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Diagram Question Answering | AI2D | AI2D Accuracy96.02 | 387 | |
| Diagram Understanding | AI2D | Accuracy94.2 | 317 | |
| Visual Question Answering | AI2D | Accuracy91.81 | 317 | |
| Diagram Understanding | AI2D (test) | Accuracy94.7 | 154 | |
| Diagram Question Answering | AI2D (test) | Accuracy94.7 | 142 | |
| Visual Question Answering | AI2D (test) | Accuracy96.4 | 82 | |
| Diagram Understanding | AI2D 1.0 (test) | Accuracy96.3 | 58 | |
| Visual Perception | AI2D | Accuracy84 | 47 | |
| Visual Question Answering | AI2D | EM82.48 | 42 | |
| Diagram Understanding | AI2D | AI2D Score87.14 | 39 | |
| Multimodal Understanding | AI2D | Score85.56 | 32 | |
| Document Understanding | AI2D | Accuracy0.977 | 28 | |
| Visual Question Answering | AI2D 65 (test) | Score98.7 | 23 | |
| Diagram Understanding | AI2D F | Accuracy59.7 | 23 | |
| OCR-based Visual Question Answering | AI2D 2016 (test) | Accuracy84.6 | 21 | |
| Diagram Understanding | AI2D lite | Accuracy82.8 | 20 | |
| Diagram Understanding | AI2D | AI2D Accuracy55.38 | 19 | |
| Diagram Understanding | AI2D | Exact Match79.11 | 19 | |
| Chart Understanding | AI2D | AI2D Score0.947 | 18 | |
| Document Understanding | AI2D (test) | Accuracy88.9 | 17 | |
| Diagram Understanding | AI2D | Pass@1 Accuracy86.5 | 16 | |
| Diagram Understanding | AI2D | Accuracy84.5 | 16 | |
| Diagram Reasoning | AI2D | Score83.44 | 16 | |
| Multimodal Understanding | AI2D | Accuracy80.8 | 16 | |
| Diagram Understanding | AI2D | Score87.7 | 15 |
Showing 25 of 56 rows