Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on AMC 2023 (Accuracy and Average Tokens)

100Accuracy

BCR-Qwen3-4B (Ours)

Updated 1mo ago

Evaluation Results

Method	Links
BCR-Qwen3-4B (Ours) 2026.04		100	7,128
Qwen3-4B-Thinking-2507 2026.04		97.5	10,457
Vanilla 2026.04		97.5	8,648
GRPO 2026.04		97.5	8,204
GRPO+SOP 2026.04		97.5	5,431
Vanilla 2026.04		97.5	8,801
GRPO 2026.04		97.5	7,712
GRPO-λ 2026.04		97.5	4,671
Step-GRPO 2026.04		95	5,295
GRPO-8k 2026.04		95	5,506
GRPO+LP 2026.04		95	4,712
GRPO+SOP 2026.04		95	5,793
Step-GRPO 2026.04		95	5,456
GRPO+LP 2026.04		92.5	3,786
DEER+SFT 2026.04		90	6,149
GRPO-λ 2026.04		90	5,432
BCR-JustRL-1.5B (Ours) 2026.04		87.5	2,637
GRPO-8k 2026.04		87.5	5,933
Qwen3-1.7B 2026.04		85	8,157
e3-1.7B 2026.04		85	7,154
JustRL-deepseek-1.5B 2026.04		85	5,713
DEER+SFT 2026.04		85	5,002
GRPO 2026.04		85	9,425
GRPO+SOP 2026.04		82.5	7,704
Step-GRPO 2026.04		82.5	6,856
BroRL-1.5B 2026.04		81	4,120
Vanilla 2026.04		80	10,713
GRPO-8k 2026.04		80	7,021
GRPO-λ 2026.04		75	7,050
STILL-3-1.5B 2026.04		72.5	5,706
GRPO+LP 2026.04		72.5	6,605
DeepSeek-R1-Distill-Qwen-1.5B 2026.04		67.5	9,702
DEER+SFT 2026.04		67.5	5,712
ARM-3B 2026.04		42.5	703
Thinker-Q1.5B 2026.04		32.5	828