Share your thoughts, 1 month free Claude Pro on usSee more

Bash Command Execution on InterCode Bash

72Execution Success Rate

GPT-5

Updated 1mo ago

Evaluation Results

Method	Links
GPT-5 2026.04		72
Meta-Tool (3B) 2026.04		54
QWEN3.5-397B-A17B 2026.06		51.34
OPD-Evolver-9B 2026.06		49.55
MemEvolve 2026.06		45.98
EvolveR 2026.06		44.64
STEP-3.5-FLASH (196B) 2026.06		44.2
Memp 2026.06		44.2
Llama-3.2-3B-Ins. 2026.04		44
ReasoningBank 2026.06		43.75
Cheatsheet 2026.06		41.96
No Memory 2026.06		41.52
ExpeL 2026.06		40.18
AgentLM-7B 2026.04		40
AWM 2026.06		39.73
OPD-Evolver-4B 2026.06		36.16
EvolveR 2026.06		33.93
MemEvolve 2026.06		33.93
Cheatsheet 2026.06		33.04
Memp 2026.06		31.7
ReasoningBank 2026.06		31.25
ExpeL 2026.06		30.8
No Memory 2026.06		30.36
AWM 2026.06		27.68