Share your thoughts, 1 month free Claude Pro on usSee more

Terminal-related CLI agent task on TerminalBench 1.0

54.4Accuracy

GPT-5.2

Updated 1mo ago

Evaluation Results

Method	Links
GPT-5.2 2026.06		54.4	-
GPT-5.2 2026.04		54.38	-
Gemini-3-Flash-Preview 2026.04		53.72	-
Claude-Sonnet-4.5 2026.04		51	-
GLM-4.7 2026.06		48.8	-
GLM-4.7 2026.04		48.75	-
Claude-Opus-4.5 2026.04		47.5	-
Claude-Opus-4.5 2026.06		47.5	-
Gemini 3 Pro Preview 2026.06		46.4	-
Gemini-3-Pro-Preview 2026.04		46.35	-
DeepSeek-V3.2 2026.04		46.25	-
LiberCoder-235B 2026.06		46.1	-
TACO 2026.04		45.25	23.43
Minimax-M2.5 2026.04		45.25	-
Kimi-K2-Instruct 2026.06		44.6	-
Kimi-K2-Instruct 2026.04		44.59	-
DeepSeek-V3.2 2026.04		43.93	-
Minimax-M2.1 2026.04		42.5	-
Minimax-M2.1 2026.06		42.5	-
Baseline 2026.04		42.3	29.74
Minimax-M2.5 2026.04		42.3	-
LiberCoder-32B 2026.06		38.9	-
CLI-Universe-32B 2026.06		38.8	-
Qwen3-Coder-480B-Instruct 2026.04		38.5	-
Qwen3-Coder-480B 2026.04		37.5	-
Qwen3-Coder-480B 2026.06		37.5	-
GPT-5.1 2026.04		35.5	-
TerminalTraj-32B 2026.06		35.3	-
SkillSynth-32B 2026.06		33.8	-
DeepSeek-V3.1-Nex-N1 2026.04		31.56	-
TerminalTraj-14B 2026.06		28.9	-
Qwen3-32B-Nex-N1 2026.04		28.75	-
CLI-Universe-14B 2026.06		27.5	-
Qwen3-30B-A3B-Nex-N1 2026.04		25	-
Qwen3-Coder-30B-A3B-Instruct 2026.04		23.8	-
Qwen3-Coder-30B-A3B 2026.06		23.8	-
TerminalTraj-7B 2026.06		23	-
SkillSynth-14B 2026.06		22.9	-
CLI-Universe-8B 2026.06		19.1	-
SkillSynth-8B 2026.06		17.1	-
Qwen3-235B-A22B-Instruct 2026.04		15	-
Qwen3-32B-Instruct 2026.04		14.13	-
Qwen3-14B 2026.06		11.6	-
Qwen3-32B-Instruct 2026.04		11.25	-
Qwen3-32B-Instruct 2026.04		11.25	-
Qwen3-14B-Instruct 2026.04		11.25	-
Qwen3-32B 2026.06		11.2	-
Qwen3-8B-Instruct 2026.04		9.22	-
Qwen3-8B-Instruct 2026.04		8.86	-
Qwen3-8B 2026.06		8.1	-
Qwen3-14B-Instruct 2026.04		5.23	-