Share your thoughts, 1 month free Claude Pro on usSee more

Math Problem Solving on MMATH (test)

27.1Accuracy (Ar)

Qwen2.5-7B-Instruct + Vanilla GRPO

Updated 12d ago

Evaluation Results

Method
Qwen2.5-7B-Instruct + Vanilla GRPO 2026.05	27.1	27.4	31.6	25.5	28.3	31.1	28.5	28.7	31.3	27.9	30.2	29.5	28.9
Qwen2.5-7B-Instruct + LANG 2026.05	26.5	28.6	31.2	28.2	28.4	32.1	29.2	30.1	25.2	32.4	31.3	29.8	29.4
Qwen2.5-7B-Instruct + mGRPO 2026.05	24.7	20.5	27.8	26.5	26	31	26.1	25.9	25	29.9	28.6	27.3	26.6
Qwen2.5-7B-Instruct + LC-GRPO 2026.05	24.3	23.6	28.2	25	28.2	30.2	26.6	25.2	25	29.2	27.9	26.9	26.7
Qwen2.5-7B-Instruct + M-SFT 2026.05	22.7	21	22.2	22.1	23.9	32.6	24.1	21.7	21.2	22.9	25.3	22.8	23.6
Qwen2.5-7B-Instruct + M-Thinker 2026.05	21.4	20.7	22.7	24.5	25.7	28.6	23.9	24.6	22.8	26.7	26.7	25.2	24.4
Qwen2.5-7B-Instruct + DIT 2026.05	21.2	19.9	26.4	23.6	23	30	24	21.6	23.1	24.3	25.5	23.6	23.9
Qwen2.5-7B-Instruct 2026.05	20.3	21.5	24.1	25.4	23.8	28.2	23.9	20.8	24.6	24.1	25.1	23.6	23.8
Qwen2.5-7B-Instruct + QRT 2026.05	19.1	18.7	24.7	20.4	26.1	27.8	22.8	23	19.6	23.7	24	22.6	22.7
Qwen2.5-7B-Instruct + LCP 2026.05	18.8	19.1	23.2	18.8	22.4	29.6	22	19.9	21	23.6	23	21.9	21.9
Qwen2.5-3B-Instruct + Vanilla GRPO 2026.05	18.6	15.7	19.5	18.5	19.4	22.4	19	16	20.4	20.1	19.1	18.9	19
Qwen2.5-3B-Instruct + LC-GRPO 2026.05	16.2	15.5	17.8	16.3	17.5	22.9	17.7	16.4	15.5	20.1	19.5	17.9	17.8
Qwen2.5-3B-Instruct + LANG 2026.05	15.1	14.8	20.7	15.5	20.2	23.1	18.2	19.6	15.1	20.9	19.6	18.8	18.5
Qwen2.5-3B-Instruct + mGRPO 2026.05	15	15.3	18.2	12.2	17.1	19.9	16.3	16.3	14.5	18.6	16.7	16.5	16.4
Qwen2.5-3B-Instruct + LCP 2026.05	13.7	13.3	16.5	12.5	15.9	21.3	15.5	13.1	11	16	16.7	14.2	15
Qwen2.5-3B-Instruct 2026.05	13.1	11	16.7	13.7	15.1	23	15.4	15.9	13	18.5	16.6	16	15.7
Qwen2.5-3B-Instruct + M-SFT 2026.05	12.9	12.1	18.5	13.3	17	22.4	16	13.4	12.1	16.5	19.1	15.3	15.7
Qwen2.5-3B-Instruct + M-Thinker 2026.05	12.8	11.6	19.7	11.9	15.5	22.4	15.7	15	12.2	17.2	17.7	15.5	15.6
Qwen2.5-3B-Instruct + DIT 2026.05	12.6	12.6	17	12.7	17.4	23.2	15.9	14.9	12.5	17.8	17.9	15.8	15.8
Qwen2.5-3B-Instruct + QRT 2026.05	12.4	11.4	17.2	13.2	17.9	22.3	15.7	14.1	12.3	16.8	18.6	15.5	15.6