Math Word Problem Solving

Benchmarks

Dataset Name	SOTA Method	Metric
GSM8K		Accuracy95.3	158	15d ago
GSM8K		Accuracy96.8	111	2mo ago
Math23K (test)	Multi-view	Accuracy87.1	73	3mo ago
Math23K (5-fold cross-val)	Multi-view	Accuracy85.2	56	3mo ago
GSM8K official 1.3k set (test)	CAPO	Accuracy93.7	53	3mo ago
SOMADHAN (test)	GPT-OSS-20B	Accuracy0.88	45	3mo ago
SVAMP	NPG-Muse-8B	Value Accuracy94.5	38	3mo ago
MathQA (test)	Expression Tree Decoding Strategy (Ours)	Accuracy81.5	34	3mo ago
GSM8K official train (dev)	CoT	Accuracy88.3	28	3mo ago
MAWPS (5-fold cross-val)	Multi-view	Accuracy92.3	21	3mo ago
SVAMP English (test)	ATHENA	Accuracy67.8	20	3mo ago
Math23K		Accuracy0.7481	19	3mo ago
GSM8K (test)	MO-CAPO	Accuracy89.3	18	14d ago
GSM8K 200 examples (test)	ChatGPT (gpt-3.5-turbo)	Accuracy81.2	18	3mo ago
Math Word Problems 6 tasks	MIDAS	Accuracy43.1	14	3mo ago
PARAMAWPS	DeBERTa (VM)	Value Accuracy79.1	14	3mo ago
MAWPS original (whole dataset)	DeBERTa (PM + VM)	Value Accuracy91	14	3mo ago
MAWPS English (test)	ATHENA	Accuracy93	10	3mo ago
Illinois (IL) 562 single-step word problems (5-fold cross-validation)	Giving BERT a Calculator	Accuracy83.2	10	3mo ago
UnbiasedMWP 1:N Chinese (test)	ATHENA	Accuracy48.4	8	3mo ago
UnbiasedMWP Chinese (test)	ATHENA	Accuracy42	8	3mo ago
Math23k Chinese (test)	ATHENA	Accuracy86.5	8	3mo ago
SVAMP 10 low-resourced languages FLORES-200 (test)	DIP	Kazakh (Cyrillic) Accuracy44	7	13d ago
ASDiv-A (5-fold cross-val)	MSAT-DEDUCTREASONER	Accuracy87.5	7	3mo ago
GSM+ v1 (test)		Accuracy65.7	6	3mo ago

Showing 25 of 35 rows