Share your thoughts, 1 month free Claude Pro on usSee more

Agentic Tool Use on Tau2-Bench (Domain Scores)

90.4Retail Score

Seed 2.0

Updated 1d ago

Evaluation Results

Method
Seed 2.0 2026.04	90.4	94.2	64.4	83
Claude Sonnet-4.5 2026.04	86.2	98	70.1	84.7
Gemini-3 Pro 2026.04	85.3	98	72.7	85.4
GPT-5.2 High 2026.04	81.6	95.8	62.5	80.2
GPT-5 2026.05	81.1	96.7	62	-
MAVEN 2026.05	77.19	66.67	62	-
Agent-World-14B 2026.04	74.5	56.1	52	65.4
Kimi-K2 2026.05	73.9	65.8	51.2	-
Agent-World-8B 2026.04	72.8	50.9	40	61.8
Qwen3-235B-A22B 2026.04	71.9	58	45.6	58.5
o4-mini 2026.05	70.4	46.5	46	-
o3 2026.05	70.4	58.2	52	-
Gemini-2.5 2026.05	68.7	27.2	44	-
GPT-OSS-120B 2026.04	67.8	49.2	48	55
Qwen3-Th-235B 2026.05	67.8	45.6	46	-
DeepSeek-V3.1 2026.05	66.1	38.5	40	-
AWM-14B 2026.04	63.6	17.8	31.5	39
Qwen3-32B 2026.04	59.5	27.2	48	44.9
Qwen3-14B 2026.04	55.3	14.9	27	32.4
ScaleEnv-8B 2026.04	50.9	27.2	37.5	38.5
EnvScaler-8B 2026.04	49.6	32.7	31.5	37.9
GAIS 2026.06	47.4	8.8	40	-
GAIS 2026.06	46.5	15.8	24	-
GAIS 2026.06	46.5	15.8	24	-
GAIS 2026.06	46.5	19.3	28	-
Qwen3-8B 2026.06	43.9	17.5	28	-
GAIS 2026.06	43.9	17.5	40	-
AWM-8B 2026.04	41.2	38.5	23.5	34.4
Qwen3-14B 2026.06	40.4	21.1	38	-
Nemotron 2026.06	39.5	14	20	-
Qwen3-8B 2026.06	38.6	7	16	-
Qwen3-8B 2026.06	38.6	7	16	-
GAIS 2026.06	37.7	7.9	22	-
GAIS 2026.06	36.8	11.4	26	-
Qwen3-14B 2026.06	36.8	16.7	14	-
Qwen3-14B 2026.06	36.8	16.7	14	-
Nemotron 2026.06	35.1	15.8	32	-
Nemotron 2026.06	34.2	7.9	28	-
Qwen3-8B 2026.04	34	18	26.5	26.2
Nemotron 2026.06	33.3	4.4	20	-
Nemotron 2026.06	32.5	15.8	24	-
GAIS 2026.06	32.5	5.3	26	-
GAIS 2026.06	32.5	13.2	24	-
Simulator-8B 2026.04	32.2	29.2	34	31.8
Qwen3-4B 2026.06	30.7	9.7	32	-
Nemotron 2026.06	25.4	15.8	20	-
GAIS 2026.06	25.4	9.6	18	-
Nemotron 2026.06	25.4	15.8	20	-
Qwen3-4B 2026.06	23.7	13.2	24	-
Qwen3-4B 2026.06	23.7	13.2	24	-
Nemotron 2026.06	23.7	8.8	18	-
TOUCAN-7B 2026.04	22.8	10.5	20	17.7
Nemotron 2026.06	20.2	7.9	18	-
Nemotron 2026.06	12.3	5.3	14	-
Llama-3.1-8B-Ins. 2026.06	7	5.3	8	-
ToolLLM 2026.06	0	0	0	-
ToolACE 2026.06	0	0	0	-
ToolLLM 2026.06	0	0	0	-
ToolACE 2026.06	0	0	0	-
DeepSeek-V3.2-685B 2026.04	-	-	-	80.3