Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on Tau2

93.6Accuracy

Qwen-3.5 27B

Updated 1mo ago

Evaluation Results

Method	Links
Qwen-3.5 27B 2026.04		93.6
Apriel-1.6 2026.04		62.6
all-attention 2026.04		56.7
Idealized\|All–18 2026.04		52.6
Reg\|Lklhd–18 2026.04		46.2
Idealized\|Lklhd–6 2026.04		40.4
Idealized\|All–6 2026.04		34.2
Nemotron-3-Nano 30B 2026.04		31.3
Reg\|Lklhd–26 2026.04		30.7
Reg\|Lklhd–13 2026.04		28.6
Reg\|Lklhd–10 2026.04		23.4
S1: Distil. Idealized\|All–6 2026.04		12.3
Falcon-H1R 7B 2026.04		11.1
OLMo-Hybrid-Think 7B 2026.04		9.7
Nemotron-Nano 12B v2 2026.04		9.1
Apriel-H1 15B 2026.04		4.7