Share your thoughts, 1 month free Claude Pro on usSee more

Terminal-related CLI agent task on TerminalBench 1.0

54.38Accuracy

GPT-5.2

Updated 1mo ago

Evaluation Results

Method	Links
GPT-5.2 2026.04		54.38	-
Gemini-3-Flash-Preview 2026.04		53.72	-
Claude-Sonnet-4.5 2026.04		51	-
GLM-4.7 2026.04		48.75	-
Claude-Opus-4.5 2026.04		47.5	-
Gemini-3-Pro-Preview 2026.04		46.35	-
DeepSeek-V3.2 2026.04		46.25	-
TACO 2026.04		45.25	23.43
Minimax-M2.5 2026.04		45.25	-
Kimi-K2-Instruct 2026.04		44.59	-
DeepSeek-V3.2 2026.04		43.93	-
Minimax-M2.1 2026.04		42.5	-
Baseline 2026.04		42.3	29.74
Minimax-M2.5 2026.04		42.3	-
Qwen3-Coder-480B-Instruct 2026.04		38.5	-
Qwen3-Coder-480B 2026.04		37.5	-
GPT-5.1 2026.04		35.5	-
DeepSeek-V3.1-Nex-N1 2026.04		31.56	-
Qwen3-32B-Nex-N1 2026.04		28.75	-
Qwen3-30B-A3B-Nex-N1 2026.04		25	-
Qwen3-Coder-30B-A3B-Instruct 2026.04		23.8	-
Qwen3-235B-A22B-Instruct 2026.04		15	-
Qwen3-32B-Instruct 2026.04		14.13	-
Qwen3-32B-Instruct 2026.04		11.25	-
Qwen3-32B-Instruct 2026.04		11.25	-
Qwen3-14B-Instruct 2026.04		11.25	-
Qwen3-8B-Instruct 2026.04		9.22	-
Qwen3-8B-Instruct 2026.04		8.86	-
Qwen3-14B-Instruct 2026.04		5.23	-