CharXiv

Benchmarks

Task Name	Dataset Name	SOTA Result
Chart Understanding	CharXiv	Reasoning Score60.2	44
Chart Understanding and Reasoning	CharXiv	Score67.8	37
Chart Question Answering	CharXiv	Reasoning Score76.4	33
Chart-based Reasoning	CharXivRQ	Accuracy67.9	29
Scientific Chart Understanding	CharXiv 1.0	RQ Score60.2	23
Scientific Figure Reasoning	CharXiv	Accuracy48.9	17
Document and chart understanding	CharXiv DQ	Pass@198.4	17
Visual Reasoning	CharXiv (val)	Text in Chart Accuracy37.95	16
Scientific Chart Interpretation	CharXiv Reasoning	Overall Score46.8	12
Chart Reasoning	CharXiv	Accuracy74.2	12
Document Question Answering	CharXiv RQ	Accuracy68.6	11
Document Question Answering	CharXiv DQ	Accuracy91.3	11
Document Understanding	CharXiv reas.	Accuracy0.686	11
OCR-related Understanding Tasks	CharXiv RQ	Accuracy60.2	11
Chart Understanding	CharXiv RQ	Pass@177.9	10
Multimodal Reasoning	CharXiv RQ	Generated Token Length6,448	9
Chart Reasoning	CharXiv Reasoning Questions	Accuracy60.52	8
Scientific QA	CharXiv	CharXiv-D Score95.2	8
Chart Reasoning	CHARXIV reasoning	Accuracy (All)64.2	7
Chart Understanding	CharXiv DQ	Score73.9	7
Image Captioning	CharXiv	Prism37.3	7
Document and chart understanding	CharXiv RQ	Pass@169.9	7
OCR-related Understanding Tasks	CharXiv (DQ)	Accuracy87.4	7
Visual instruction tuning	CharXiv	RQ50.8	6
OCR	CharXivRQ	Accuracy60.9	6

Showing 25 of 43 rows