Share your thoughts, 1 month free Claude Pro on usSee more

Interactive Decision Making on InterCode NL2Bash

79.6Success Rate

GRASP

Updated 1mo ago

Evaluation Results

Method	Links
GRASP 2026.04		79.6	11.2
ReAct + Skills 2026.04		79.1	13.2
GRASP 2026.04		78.3	12
ReAct + Skills 2026.04		77.7	14.1
GRASP 2026.04		77.6	13.2
GRASP 2026.04		77.4	12.8
ReAct + Skills 2026.04		76.8	13.6
GRASP 2026.04		76.7	13.8
ReAct + Skills 2026.04		76.7	13.2
GRASP 2026.04		76.7	13.4
Reflexion 2026.04		75.8	14
GRASP 2026.04		75.8	12.5
ReAct + Skills 2026.04		75.6	14.6
ReAct + Skills 2026.04		75.1	13.3
Reflexion 2026.04		74.3	14.6
ExpeL 2026.04		74.2	14.3
GRASP 2026.04		74.2	13.4
Reflexion 2026.04		73.6	14
ReAct + Skills 2026.04		73.5	13.8
ExpeL 2026.04		73.4	14.8
ExpeL 2026.04		73.4	13.6
Reflexion 2026.04		73.4	14.2
ReAct 2026.04		73.2	15
ExpeL 2026.04		73.2	14.6
ReAct 2026.04		72.6	14.8
ReAct 2026.04		72.4	14.6
Reflexion 2026.04		72.4	13.8
Reflexion 2026.04		72.1	15.2
ReAct + Skills 2026.04		71.6	15.1
ReAct 2026.04		71.6	15.4
ReAct 2026.04		70.8	15.6
ExpeL 2026.04		70.8	14.6
Reflexion 2026.04		70.8	14.6
ReAct 2026.04		70.8	14.8
ExpeL 2026.04		70.6	14.2
Reflexion 2026.04		70.2	15.8
ReAct 2026.04		68.4	16.5
ExpeL 2026.04		67.9	16.2
ExpeL 2026.04		67.9	16
ReAct 2026.04		66.4	17.2