Share your thoughts, 1 month free Claude Pro on usSee more

Step-level reasoning verification on Calendar

69.8PR-AUC

ReProbe, Hidden States, GPT-OSS-anno

Updated 1mo ago

Evaluation Results

Method	Links
ReProbe, Hidden States, GPT-OSS-anno 2025.11		69.8
Qwen2.5-Math-PRM-7B 2025.11		67.6
Universal-PRM-Qwen2.5-Math-7B 2025.11		63.7
Qwen2.5-Math-7B-PRM800K 2025.11		59.4
ReProbe, Attn+Logit, Qwen3-8B-anno 2025.11		59.2
Qwen2.5-Math-7B-PRM800k 2025.11		56.8
Qwen2.5-Math-7B 2025.11		55.5
Skywork-PRM-1.5B 2025.11		50.8
Universal-PRM-Qwen2.5-Math-7B 2025.11		49.7
Math-Shepherd-PRM-7B 2025.11		48.9
H4-Qwen2.5-PRM-1.5B-0.2 2025.11		43.4
H4-Qwen2.5-PRM-1.5B-0.2 2025.11		38.6
MaxProb 2025.11		38
MaxEntropy 2025.11		36.2
RLHFlow-PRM-Deepseek-8B 2025.11		34.3
Skywork-PRM-1.5B 2025.11		32.7
Random 2025.11		32.4
Perplexity 2025.11		32.3
RLHFlow-PRM-Mistral-8B 2025.11		30.9