Share your thoughts, 1 month free Claude Pro on usSee more

Mathematics on Mathematics Suite (GSM8K, MathQA)

73GSM8K Accuracy

Olmo 3 7B-PC

Updated 1mo ago

Evaluation Results

Method	Links
Olmo 3 7B-PC 2025.05		73	75	37
Qwen2.5 7B-PC 2025.05		72	74	42
Granite 3.1 8B-PC 2025.05		66	67	34
Llama 3.1 8B-PC 2025.05		61	63	29
Granite 8B Code-PC 2025.05		59	61	25
Olmo 3 7B-NL 2025.05		59	61	34
Qwen2.5 7B-NL 2025.05		52	54	36
Mistral 7B v0.3-PC 2025.05		44	45	25
Llama 3.1 8B-NL 2025.05		33	33	21
Qwen2.5 7B-CP 2025.05		30	32	33
Olmo 3 7B-CP 2025.05		25	25	23
Granite 3.1 8B-CP 2025.05		16	17	18
Llama 3.1 8B-CP 2025.05		14	14	18
Mistral 7B v0.3-NL 2025.05		12	13	21
Mistral 7B v0.3-CP 2025.05		10	11	14
Granite 8B Code-CP 2025.05		10	11	17
Granite 8B Code-NL 2025.05		9	9	28
Granite 3.1 8B-NL 2025.05		2	2	19