Tau2
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Conversational agents in customer-service environments | tau2 Airline | Success Rate78 | 20 | |
| Reasoning | Tau2 | Accuracy93.6 | 16 | |
| Agentic Tasks | Tau2 Retail | Score78.1 | 10 | |
| Agentic Tool Use | Tau2 Retail | Avg@873.68 | 8 | |
| Tool-use | TAU2 | Score31.3 | 4 | |
| Language Modeling | TAU2 | Perplexity1.148 | 3 | |
| Agent | Tau2 Telecom English | Score65.1 | 3 | |
| Agent | Tau2 Retail (English) | Score71.6 | 3 | |
| Agent | Tau2 Airline (English) | Score58 | 3 |
Showing 9 of 9 rows