Share your thoughts, 1 month free Claude Pro on usSee more

Mathematical Reasoning on AMC23 (test)

92.2Pass@1

SimPOShortest

Updated 3d ago

Evaluation Results

Method	Links
SimPOShortest 2026.01		92.2	5,798	77.3	-	-
RELIEF 2026.01		89.3	5,093	67.9	-	-
Original 2026.01		89.1	7,496	100	-	-
SFTShortest 2026.01		88.8	7,304	97.4	-	-
BeliefPrompt 2026.01		87.8	6,815	90.9	-	-
SFTbelief 2026.01		85.9	7,274	97	-	-
RAgent-QwQ-32B 2025.01		85	-	-	-	-
Search-o1 2025.01		85	-	-	-	-
QwQ-32B 2025.01		82.5	-	-	-	-
RAG-QwQ-32B 2025.01		82.5	-	-	-	-
RELIEF 2026.01		81.6	5,449	88.3	-	-
SimPOShortest 2026.01		80.9	5,549	90	-	-
Original 2026.01		79.1	6,169	100	-	-
BeliefPrompt 2026.01		78.8	5,936	96.2	-	-
SFTShortest 2026.01		75	5,939	96.3	-	-
SFTbelief 2026.01		73.8	5,855	94.9	-	-
RAG-Qwen2.5-32B 2025.01		72.5	-	-	-	-
Qwen2.5-Coder-32B 2025.01		67.5	-	-	-	-
Qwen2.5-72B 2025.01		67.5	-	-	-	-
RAgent-Qwen2.5-32B 2025.01		65	-	-	-	-
Qwen2.5-32B 2025.01		57.5	-	-	-	-
FGO 2026.02		55	-	-	540	10.2
FGO 2026.02		55	-	-	494	11.1
FGO 2026.02		52.5	-	-	686	7.7
GRPO 2026.02		52.5	-	-	746	7
GRPO 2026.02		50	-	-	825	6.1
Vanilla 2026.02		50	-	-	1,450	3.4
GRPO 2026.02		50	-	-	1,453	3.4
Llama3.3-70B 2025.01		47.5	-	-	-	-
Vanilla 2026.02		47.5	-	-	802	5.9
FGO 2026.02		40	-	-	651	6.1
TLDR 2026.02		37.3	-	-	861	4.3
Vanilla 2026.02		30	-	-	978	3.1
GRPO 2026.02		30	-	-	1,646	1.8
Vanilla 2026.02		27.5	-	-	1,820	1.5
TLDR 2026.02		19.3	-	-	444	4.3
EndoRM 2026.04		10	-	-	-	-
DPO-RM 2026.04		10	-	-	-	-
Implicit PRM 2026.04		10	-	-	-	-
IPVRM 2026.04		10	-	-	-	-
Implicit PRM 2026.04		6.7	-	-	-	-
IPVRM 2026.04		6.7	-	-	-	-
DPO-RM 2026.04		5.8	-	-	-	-
Q-RM 2026.04		5	-	-	-	-
DPO-RM 2026.04		5	-	-	-	-
Implicit PRM 2026.04		5	-	-	-	-
IPVRM 2026.04		5	-	-	-	-
Implicit PRM 2026.04		5	-	-	-	-
IPVRM 2026.04		5	-	-	-	-
Q-RM 2026.04		5	-	-	-	-
EndoRM 2026.04		5	-	-	-	-
Q-RM 2026.04		4.2	-	-	-	-
EndoRM 2026.04		2.5	-	-	-	-
Q-RM 2026.04		2.5	-	-	-	-
EndoRM 2026.04		2.5	-	-	-	-
DPO-RM 2026.04		2.5	-	-	-	-