Share your thoughts, 1 month free Claude Pro on usSee more

Agent Task Completion on τ-bench-retail

70.2Success Rate

SkillMAS

Updated 1mo ago

Evaluation Results

Method	Links
SkillMAS 2026.05		70.2	-	-	-	-	-
CDMem 2026.05		68.4	-	-	-	-	-
Traj-Bootstrap 2026.05		68.4	-	-	-	-	-
ReAct 2026.05		62.3	-	-	-	-	-
Direct LLM 2026.05		61.4	-	-	-	-	-
Qwen3-8B 2026.06		39.1	-	-	-	-	-
IG-clarifier 2026.06		37.4	-	-	-	-	-
None 2026.06		36.5	-	-	-	-	-
IG-clarifier 2026.06		33.9	-	-	-	-	-
None 2026.06		31.3	-	-	-	-	-
Qwen3-8B 2026.06		26	-	-	-	-	-
IG-clarifier 2026.06		24.3	-	-	-	-	-
IG-clarifier 2026.06		24.2	-	-	-	-	-
None 2026.06		23.4	-	-	-	-	-
None 2026.06		22.8	-	-	-	-	-
Qwen3-8B 2026.06		21.9	-	-	-	-	-
Qwen3-8B 2026.06		21.7	-	-	-	-	-
None (Full User Intent) 2026.06		20	-	-	-	-	-
DeepSeek-V3.1 2026.06		19.1	-	-	-	-	-
IG-clarifier 2026.06		18.3	-	-	-	-	-
Ours (Qwen3-1.7B-trained) 2026.06		18.3	-	-	-	-	-
None 2026.06		16.5	-	-	-	-	-
None 2026.06		16.5	-	-	-	-	-
Qwen3-14B 2026.06		16.5	-	-	-	-	-
Qwen3-8B 2026.06		15.7	-	-	-	-	-
Qwen3-8B 2026.06		15.7	-	-	-	-	-
Qwen3-30B 2026.06		15.7	-	-	-	-	-
DeepSeek-R1 2026.06		14.8	-	-	-	-	-
Qwen3-8B 2026.06		7	-	-	-	-	-
IG-clarifier 2026.06		7	-	-	-	-	-
None 2026.06		6.1	-	-	-	-	-
ReAct 2026.04		-	25.2	17.8	14.7	13.2	12.1
FAMA 2026.04		-	37.9	25.7	19.7	16.3	14.7
SR 2026.04		-	32.1	19.3	14.69	12.52	11.3