Share your thoughts, 1 month free Claude Pro on usSee more

Deductive Reasoning on ProntoQA

99.2Pass@1

Beam Search (BL)

Updated 1mo ago

Evaluation Results

Method	Links
Beam Search (BL) 2026.04		99.2	-
TTPO 2026.04		99.2	-
Greedy (BL) 2026.04		99	-
Steering 2026.04		99	-
Branching 2026.04		98.8	-
Greedy (BL) 2026.04		97.8	-
Steering 2026.04		97.8	-
TTPO 2026.04		97.6	-
TTPO 2026.04		96.6	-
Branching 2026.04		96	-
Branching 2026.04		94.8	-
Steering 2026.04		94.2	-
Beam Search (BL) 2026.04		94.2	-
Greedy (BL) 2026.04		93.6	-
Beam Search (BL) 2026.04		93.2	-
Beam Search (BL) 2026.04		90.6	-
TTPO 2026.04		90.4	-
Steering 2026.04		90.2	-
Branching 2026.04		90.2	-
Greedy (BL) 2026.04		90	-
RULEREASONER-8B 2025.06		0.964	0.4
Easy-to-hard RL 2025.06		0.962	-
SFT w/o CoT 2025.06		0.96	-
Dr. GRPO 2025.06		0.96	-
DAPO 2025.06		0.96	-
ADARFT 2025.06		0.96	-
Data-balance RL 2025.06		0.958	-
SFT w/ Long CoT 2025.06		0.956	-
GRPO 2025.06		0.954	-
RULEREASONER-4B 2025.06		0.95	0.6
RGFB 2025.06		0.94	-
OpenAI o3-mini 2025.06		0.94	-
Claude-3.7-Sonnet 2025.06		0.928	-
SFT w/ Short CoT 2025.06		0.926	-
HtT 2025.06		0.92	-
Chain-of-Logic 2025.06		0.91	-
OpenAI o1 2025.06		0.91	-
DeepSeek-R1 2025.06		0.4	-