Share your thoughts, 1 month free Claude Pro on usSee more

Logic Reasoning on Sudoku 8B Instruct (test)

71.7Accuracy

Prob Margin

Updated 4d ago

Evaluation Results

Method	Links
Prob Margin 2026.04		71.7
Top1 Prob 2026.04		71.2
Temperature Sampling 2026.04		69.9
Prob Margin + Both 2026.04		69.5
Top1 Prob + Both 2026.04		67
Top1 Prob + Planner 2026.04		65.2
Top1 Prob + EOS Temp. 2026.04		63.6
Init. Position 2026.04		48.3
Ancestral Sampling 2026.04		17.8