CharXiv

Benchmarks

Task Name	Dataset Name	SOTA Result
Chart Understanding	CharXiv	Reasoning Score60.2	44
Chart Understanding and Reasoning	CharXiv	Score67.8	31
Chart-based Reasoning	CharXivRQ	Accuracy67.9	29
Scientific Chart Understanding	CharXiv 1.0	RQ Score60.2	23
Scientific Figure Reasoning	CharXiv	Accuracy48.9	17
Visual Reasoning	CharXiv (val)	Text in Chart Accuracy37.95	16
Scientific Chart Interpretation	CharXiv Reasoning	Overall Score46.8	12
Chart Reasoning	CharXiv	Accuracy74.2	12
Document Understanding	CharXiv reas.	Accuracy0.686	11
Scientific QA	CharXiv	CharXiv-D Score95.2	8
Image Captioning	CharXiv	Prism37.3	7
Document and chart understanding	CharXiv DQ	Pass@194.4	7
Document and chart understanding	CharXiv RQ	Pass@169.9	7
OCR-related Understanding Tasks	CharXiv (DQ)	Accuracy87.4	7
OCR-related Understanding Tasks	CharXiv RQ	Accuracy60.2	7
Document Understanding	CharXiv (Reasoning Questions)	Score54.1	6
Document Understanding	CharXiv Descriptive Questions	Score83.4	6
Chart Understanding	CharXiv descriptive	Score92.6	6
Chart Reasoning	CharXiv Reasoning Queries	Score48.9	6
Chart Understanding	CharXiv Data Queries	Score86.3	6
Scientific Chart Understanding	CharXiv RQ	Accuracy79.5	5
Table & Chart & OCR	CharXiv RQ	Score57.3	5
Table & Chart & OCR	CharXiv DQ	Score84.8	5
Visual Question Answering	CharXiv	RQ32.3	5
Scientific Document Reasoning	CharXiv	DQ83	4

Showing 25 of 31 rows