Share your thoughts, 1 month free Claude Pro on usSee more

Step-level correctness assessment on StrQA (test)

39.5PR-AUC

ReProbe

Updated 1mo ago

Evaluation Results

Method	Links
ReProbe 2025.11		39.5
ReProbe 2025.11		39.4
RLHFlow-PRM-Deepseek-8B 2025.11		39
ReProbe 2025.11		38.1
Qwen2.5-Math-7B-PRM800k 2025.11		36.2
RLHFlow-PRM-Mistral-8B 2025.11		34.9
ReProbe 2025.11		34.4
Qwen2.5-Math-PRM-7B 2025.11		33.4
Universal-PRM-Qwen2.5-Math-7B 2025.11		32.8
Math-Shepherd-PRM-7B 2025.11		28.4
Skywork-PRM-1.5B 2025.11		25.4
H4-Qwen2.5-PRM-1.5B-0.2 2025.11		21.3
P(True) 2025.11		12.6
Self-Certainty 2025.11		12
Lexical Similarity 2025.11		12
MaxEntropy 2025.11		11.9
CCP 2025.11		11.9
Random 2025.11		11.6
MaxProb 2025.11		11.4
Semantic Entropy 2025.11		11.1
Perplexity 2025.11		11
Degree Matrix 2025.11		10.7