Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on AMC23 (test)

92.2Pass@1

SimPOShortest

Updated 19d ago

Evaluation Results

Method
SimPOShortest 2026.01	92.2	5,798	77.3	-	-	-
RELIEF 2026.01	89.3	5,093	67.9	-	-	-
Original 2026.01	89.1	7,496	100	-	-	-
SFTShortest 2026.01	88.8	7,304	97.4	-	-	-
BeliefPrompt 2026.01	87.8	6,815	90.9	-	-	-
SFTbelief 2026.01	85.9	7,274	97	-	-	-
RAgent-QwQ-32B 2025.01	85	-	-	-	-	-
Search-o1 2025.01	85	-	-	-	-	-
QwQ-32B 2025.01	82.5	-	-	-	-	-
RAG-QwQ-32B 2025.01	82.5	-	-	-	-	-
RELIEF 2026.01	81.6	5,449	88.3	-	-	-
SimPOShortest 2026.01	80.9	5,549	90	-	-	-
Original 2026.01	79.1	6,169	100	-	-	-
BeliefPrompt 2026.01	78.8	5,936	96.2	-	-	-
SFTShortest 2026.01	75	5,939	96.3	-	-	-
SFTbelief 2026.01	73.8	5,855	94.9	-	-	-
RAG-Qwen2.5-32B 2025.01	72.5	-	-	-	-	-
Qwen2.5-Coder-32B 2025.01	67.5	-	-	-	-	-
Qwen2.5-72B 2025.01	67.5	-	-	-	-	-
RAgent-Qwen2.5-32B 2025.01	65	-	-	-	-	-
DAPO 2026.05	65	-	-	-	-	-
GSPO 2026.05	62.5	-	-	-	-	-
HölderPO 2026.05	60.2	-	-	-	-	-
GRPO 2026.05	60	-	-	-	-	-
Qwen2.5-32B 2025.01	57.5	-	-	-	-	-
FGO 2026.02	55	-	-	540	10.2	-
FGO 2026.02	55	-	-	494	11.1	-
FGO 2026.02	52.5	-	-	686	7.7	-
GRPO 2026.02	52.5	-	-	746	7	-
GRPO 2026.02	50	-	-	825	6.1	-
Vanilla 2026.02	50	-	-	1,450	3.4	-
GRPO 2026.02	50	-	-	1,453	3.4	-
Llama3.3-70B 2025.01	47.5	-	-	-	-	-
Vanilla 2026.02	47.5	-	-	802	5.9	-
Qwen3-4B-Base 2026.05	45	-	-	-	-	-
FGO 2026.02	40	-	-	651	6.1	-
TLDR 2026.02	37.3	-	-	861	4.3	-
Vanilla 2026.02	30	-	-	978	3.1	-
GRPO 2026.02	30	-	-	1,646	1.8	-
Vanilla 2026.02	27.5	-	-	1,820	1.5	-
TLDR 2026.02	19.3	-	-	444	4.3	-
EndoRM 2026.04	10	-	-	-	-	-
DPO-RM 2026.04	10	-	-	-	-	-
Implicit PRM 2026.04	10	-	-	-	-	-
IPVRM 2026.04	10	-	-	-	-	-
Implicit PRM 2026.04	6.7	-	-	-	-	-
IPVRM 2026.04	6.7	-	-	-	-	-
DPO-RM 2026.04	5.8	-	-	-	-	-
Q-RM 2026.04	5	-	-	-	-	-
DPO-RM 2026.04	5	-	-	-	-	-
Implicit PRM 2026.04	5	-	-	-	-	-
IPVRM 2026.04	5	-	-	-	-	-
Implicit PRM 2026.04	5	-	-	-	-	-
IPVRM 2026.04	5	-	-	-	-	-
Q-RM 2026.04	5	-	-	-	-	-
EndoRM 2026.04	5	-	-	-	-	-
Q-RM 2026.04	4.2	-	-	-	-	-
EndoRM 2026.04	2.5	-	-	-	-	-
Q-RM 2026.04	2.5	-	-	-	-	-
EndoRM 2026.04	2.5	-	-	-	-	-
DPO-RM 2026.04	2.5	-	-	-	-	-
SRFT 2026.05	-	-	-	-	-	51.25
RL 2026.05	-	-	-	-	-	54.37
RL-G 2026.05	-	-	-	-	-	57.5
LUFFY 2026.05	-	-	-	-	-	55
CHORD-ϕ 2026.05	-	-	-	-	-	53.13
HPT 2026.05	-	-	-	-	-	55
HPT-G 2026.05	-	-	-	-	-	46.88
ReLIFT 2026.05	-	-	-	-	-	57.81
ReLIFT-G 2026.05	-	-	-	-	-	54.06
FEST-DPO 2026.05	-	-	-	-	-	59.38
FEST-GRPO 2026.05	-	-	-	-	-	57.81