Share your thoughts, 1 month free Claude Pro on usSee more

Step-level correctness assessment on Calendar (test)

0.789PR-AUC

ReProbe

Updated 1mo ago

Evaluation Results

Method	Links
ReProbe 2025.11		0.789
ReProbe 2025.11		0.786
ReProbe 2025.11		0.785
ReProbe 2025.11		0.779
Qwen2.5-Math-PRM-7B 2025.11		0.745
Qwen2.5-Math-7B-PRM800k 2025.11		0.727
Universal-PRM-Qwen2.5-Math-7B 2025.11		0.691
Math-Shepherd-PRM-7B 2025.11		0.657
RLHFlow-PRM-Deepseek-8B 2025.11		0.504
Skywork-PRM-1.5B 2025.11		0.502
RLHFlow-PRM-Mistral-8B 2025.11		0.499
H4-Qwen2.5-PRM-1.5B-0.2 2025.11		0.495
Semantic Entropy 2025.11		0.492
P(True) 2025.11		0.49
Lexical Similarity 2025.11		0.49
Random 2025.11		0.486
Degree Matrix 2025.11		0.484
MaxProb 2025.11		0.483
Self-Certainty 2025.11		0.482
CCP 2025.11		0.452
MaxEntropy 2025.11		0.443
Perplexity 2025.11		0.418