CharXiv

Benchmarks

Task Name	Dataset Name	SOTA Result
Chart Understanding	CharXiv	Reasoning Score60.2	44
Chart Understanding and Reasoning	CharXiv	Score67.8	37
Chart Question Answering	CharXiv	Reasoning Score76.4	33
Chart-based Reasoning	CharXivRQ	Accuracy67.9	29
Document and chart understanding	CharXiv DQ	Pass@198.4	24
Scientific Chart Understanding	CharXiv 1.0	RQ Score60.2	23
Scientific Chart Interpretation	CharXiv Reasoning	Overall Score86.6	17
Scientific Figure Reasoning	CharXiv	Accuracy48.9	17
Vision-Language Modeling	CharXiv	Accuracy73.9	16
Visual Reasoning	CharXiv (val)	Text in Chart Accuracy37.95	16
Document and chart understanding	CharXiv RQ	Pass@182.1	14
Chart Understanding	CharXiv DQ	Score75.15	13
Chart Reasoning	CharXiv	Accuracy74.2	12
Document Question Answering	CharXiv RQ	Accuracy68.6	11
Document Question Answering	CharXiv DQ	Accuracy91.3	11
Document Understanding	CharXiv reas.	Accuracy0.686	11
OCR-related Understanding Tasks	CharXiv RQ	Accuracy60.2	11
Chart Understanding	CharXiv RQ	Pass@177.9	10
Multimodal Reasoning	CharXiv RQ	Generated Token Length6,448	9
Chart Question Answering	CharXiv (test)	Accuracy47.9	8
Chart Reasoning	CharXiv Reasoning Questions	Accuracy60.52	8
Scientific QA	CharXiv	CharXiv-D Score95.2	8
Chart Reasoning	CHARXIV reasoning	Accuracy (All)64.2	7
Image Captioning	CharXiv	Prism37.3	7
OCR-related Understanding Tasks	CharXiv (DQ)	Accuracy87.4	7

Showing 25 of 49 rows