Multilingual Mathematical Reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
MGSM (test)	QuaSAR	Accuracy93.4	109	2mo ago
MT Math100	ROSA2	Accuracy93.6	64	4mo ago
MGSM	DeepSeek V3.2	Accuracy94.9	64	25d ago
MGSM 1.0 (test)	MindMerger-Hard	Accuracy (ru)69.6	35	4mo ago
MSVAMP	Task Arithmetic	Accuracy (English)75	33	4mo ago
PolyMath (test)	Qwen2.5-32B-Instruct	Accuracy (Ar)20.3	30	2mo ago
MGSM Thai (test)	One Step + KMM	Accuracy41.6	25	2mo ago
MMATH All Languages (test)	Qwen2.5-7B-Instruct + LANG	Average Score (All)28.6	22	2mo ago
MMATH Out-of-Domain Languages (test)	Qwen2.5-7B-Instruct + LANG	Vietnamese Accuracy30.1	22	2mo ago
MMATH In-Domain Languages (test)	Qwen2.5-7B-Instruct + LANG	Accuracy (Ar)26.3	22	2mo ago
MGSM	FLy	Speedup (de)6.08	20	4mo ago
MSVAMP (all)	AdaMame-GRPO	Accuracy89	12	1mo ago
MSVAMP out-of-domain	AdaMame-GRPO	Accuracy89.4	12	1mo ago
MSVAMP in-domain	AdaMame-GRPO	Accuracy88.4	12	1mo ago
MGSM Rev2 (all)	AdaMame-GRPO	Accuracy85.9	12	1mo ago
MGSM out-of-domain Rev2		Accuracy83.6	12	1mo ago
MGSM in-domain Rev2	AdaMame-GRPO	Accuracy90.4	12	1mo ago
MGSM	SOLAR	Accuracy88.27	11	29d ago
MMLU Pro Xmath	PCS	FR SLC&Acc79.9	8	23d ago
MMATH	PCS	FR Accuracy and SLC41.2	8	23d ago
MGSM8KInstruct (test)		Accuracy (En)47.6	7	4mo ago
MCLM 1.0 (test)		MT-MATH100 Score84.89	7	4mo ago
MGSM 18 languages	SP3F-7B	Accuracy72.5	6	4mo ago
MGSM	Nemotron-3-Ultra 550B-A55B-Base	Native CoT Avg Score87.73	5	1mo ago

Showing 24 of 24 rows