tau2-bench

Benchmarks

Task Name	Dataset Name	SOTA Result
Interactive Tool-Use Agent Performance	tau2-Bench	Retail Performance Score81.1	102
Agentic Tool-use	tau2-bench Airline	Pass@163.5	30
Agentic Tool-use	tau2-bench Retail	Pass@182	30
Task failure prediction and selective task completion	tau2-bench Telecom 1.0	AUROC0.809	15
Task failure prediction and selective task completion	tau2-bench Retail 1.0	AUROC0.707	15
Task failure prediction and selective task completion	tau2-bench Airline 1.0	AUROC74.2	15
Stateful Interaction	tau2-bench	Score86.69	12
Long-Horizon Tool Execution	tau2-Bench	Retail Success Rate75.2	12
Agent Task Completion	tau2-bench telecom	Pass Rate67	9
Agent Task Completion	tau2-bench airline	Pass Rate60	9
Agent Task Success	tau2-bench Retail Domain	Total Pass Rate61.4	9
Agentic Skill Acquisition	tau2-bench	Pass@181.2	9
Multi-turn agent decision making	tau2-Bench (test)	Success Rate22.3	7
General Task (Agentic Coding)	tau2-Bench Telecom	Score98.2	6
Tool Use	Tau2-Bench	Success Rate57.4	6
User Simulation Behavioral Alignment	tau2-bench Retail + Airline (test)	HL Score95.8	5
User Simulation Behavioral Alignment	tau2-bench Airline (test)	HL90.3	5
Stateful service dialogue	tau2-bench Telecom	Task Completion Score (TCS)85.1	4
Tool-use agent scalability and performance	Tau2-Bench	Runtime1	2
Agentic Tool Use	tau2-Bench	Accuracy64	2
Agent Task Success	tau2-bench Airline Domain	Metric-	0

Showing 21 of 21 rows