Share your thoughts, 1 month free Claude Pro on usSee more

Step-level correctness assessment on SciQA (test)

55.3PR-AUC

ReProbe

Updated 1mo ago

Evaluation Results

Method	Links
ReProbe 2025.11		55.3
RLHFlow-PRM-Deepseek-8B 2025.11		51.8
ReProbe 2025.11		45
Qwen2.5-Math-PRM-7B 2025.11		42.9
Math-Shepherd-PRM-7B 2025.11		41.5
RLHFlow-PRM-Mistral-8B 2025.11		41.5
Skywork-PRM-1.5B 2025.11		40.8
Qwen2.5-Math-7B-PRM800k 2025.11		40.4
ReProbe 2025.11		40.4
ReProbe 2025.11		36.1
Universal-PRM-Qwen2.5-Math-7B 2025.11		33
Semantic Entropy 2025.11		26.5
P(True) 2025.11		26.3
MaxProb 2025.11		25.9
Degree Matrix 2025.11		25.8
Lexical Similarity 2025.11		25.4
Self-Certainty 2025.11		24.3
CCP 2025.11		23.5
Perplexity 2025.11		22.8
H4-Qwen2.5-PRM-1.5B-0.2 2025.11		22.8
MaxEntropy 2025.11		22.7
Random 2025.11		12.5