Share your thoughts, 1 month free Claude Pro on usSee more

Terminal Task Execution on Terminal-Bench 1.0

51Accuracy

Claude Sonnet 4.5

Updated 1mo ago

Evaluation Results

Method	Links
Claude Sonnet 4.5 2026.04		51
Claude Opus 4.1 2026.04		43.8
Claude Haiku 4.5 2026.04		41.8
GPT-5 2026.04		41.3
Claude Opus 4 2026.04		39
Grok 4 2026.04		39
Claude Sonnet 4 2026.04		36.4
Qwen3-32B + SS 2026.04		33.8
Grok 4 Fast 2026.04		31.3
GPT-5-Mini 2026.04		30.8
Qwen3-14B + SS 2026.04		22.9
Qwen3-8B + SS 2026.04		17.1