CharXiv
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Scientific Chart Understanding | CharXiv 1.0 | RQ Score60.2 | 23 | |
| Scientific Figure Reasoning | CharXiv | Accuracy48.9 | 17 | |
| Chart-based Reasoning | CharXivRQ | Accuracy64.2 | 16 | |
| Visual Reasoning | CharXiv (val) | Text in Chart Accuracy37.95 | 16 | |
| Chart Understanding and Reasoning | CharXiv | Score64.2 | 15 | |
| Chart Reasoning | CharXiv | Accuracy74.2 | 12 | |
| Document Understanding | CharXiv reas. | Accuracy0.686 | 11 | |
| Chart Understanding | CharXiv | Reasoning Score46.7 | 10 | |
| Document and chart understanding | CharXiv DQ | Pass@194.4 | 7 | |
| Document and chart understanding | CharXiv RQ | Pass@169.9 | 7 | |
| OCR-related Understanding Tasks | CharXiv (DQ) | Accuracy87.4 | 7 | |
| OCR-related Understanding Tasks | CharXiv RQ | Accuracy60.2 | 7 | |
| Chart Reasoning | CharXiv Reasoning Queries | Score48.9 | 6 | |
| Chart Understanding | CharXiv Data Queries | Score86.3 | 6 | |
| Visual Question Answering | CharXiv | RQ32.3 | 5 | |
| Deception Detection | CharXiv modified images removed | Deception Rate9 | 2 | |
| Scientific Chart Understanding | CharXiv | RQ- | 0 |
Showing 17 of 17 rows