Share your thoughts, 1 month free Claude Pro on usSee more

Step-level correctness assessment on GSM8k (test)

70.2PR-AUC

Qwen2.5-Math-PRM-7B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen2.5-Math-PRM-7B 2025.11		70.2
ReProbe 2025.11		67.3
ReProbe 2025.11		65
Universal-PRM-Qwen2.5-Math-7B 2025.11		62.4
ReProbe 2025.11		61.6
Qwen2.5-Math-7B-PRM800k 2025.11		61.3
ReProbe 2025.11		59.4
RLHFlow-PRM-Deepseek-8B 2025.11		54
RLHFlow-PRM-Mistral-8B 2025.11		53.7
Skywork-PRM-1.5B 2025.11		41.2
Math-Shepherd-PRM-7B 2025.11		40.5
H4-Qwen2.5-PRM-1.5B-0.2 2025.11		17.1
MaxEntropy 2025.11		12.2
Lexical Similarity 2025.11		11.9
Semantic Entropy 2025.11		11.6
MaxProb 2025.11		10.6
Self-Certainty 2025.11		10.1
Perplexity 2025.11		9.9
CCP 2025.11		9
Degree Matrix 2025.11		8.9
Random 2025.11		6.1
P(True) 2025.11		5.9