Agent Performance on tau-bench
78.3Retail Accuracy
GPT-5-think
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.02 | 78.3 | 44 | 67.8 | - | |
2025.12 | 78.3 | 44 | - | - | |
2026.02 | 73.9 | 40 | 63.6 | - | |
2026.02 | 73.9 | 51.2 | 67 | - | |
2025.12 | 73.9 | 40 | - | - | |
2025.12 | 73.9 | 51.2 | - | - | |
2025.12 | 73.1 | 56.5 | - | - | |
2026.02 | 73 | 54 | 67.2 | - | |
2025.12 | 72.6 | 46.5 | - | - | |
2026.02 | 70.4 | 52 | 64.8 | - | |
2026.02 | 70.4 | 46 | 63 | - | |
2026.02 | 70.4 | 46 | 63 | - | |
2026.02 | 70.4 | 54 | 65.4 | - | |
2025.12 | 70.4 | 52 | - | - | |
2025.12 | 70.4 | 46 | - | - | |
2025.12 | 70.4 | 46 | - | - | |
2025.12 | 70.4 | 54 | - | - | |
2026.02 | 68.7 | 44 | 61.2 | - | |
2026.02 | 68.7 | 48 | 62.4 | - | |
2025.12 | 68.7 | 44 | - | - | |
2025.12 | 68.7 | 48 | - | - | |
2026.02 | 67.8 | 49.2 | 62.1 | - | |
2026.02 | 67.8 | 46 | 61.2 | - | |
2026.02 | 67.8 | 48 | 61.8 | - | |
2025.12 | 67.8 | 49.2 | - | - | |
2025.12 | 67.8 | 46 | - | - | |
2025.12 | 67.8 | 48 | - | - | |
2026.02 | 67.1 | 45.2 | 60.4 | - | |
2025.12 | 67.1 | 45.2 | - | - | |
2026.02 | 66.1 | 40 | 58.1 | - | |
2025.12 | 66.1 | 40 | - | - | |
2026.02 | 64.3 | 45 | 58.4 | - | |
2026.02 | 64.3 | 54 | 61.2 | - | |
2025.12 | 64.3 | 45 | - | - | |
2026.02 | 62.6 | 54 | 60 | - | |
2026.02 | 60 | 46 | 55.7 | - | |
2026.02 | 59.1 | 52.5 | 57.1 | - | |
2026.02 | 59.1 | 36 | 52.1 | - | |
2026.02 | 58.2 | 35.2 | 51.2 | - | |
2026.02 | 57.4 | 36 | 50.9 | - | |
2026.02 | 55.7 | 26 | 46.6 | - | |
2026.02 | 53.9 | 32 | 47.2 | - | |
2026.02 | 53 | 28 | 45.4 | - | |
2026.02 | 50.4 | 42 | 47.8 | - | |
2026.02 | 48.7 | 34 | 44.2 | - | |
2026.02 | 48.7 | 36 | 44.8 | - | |
2026.02 | 47 | 24 | 40 | - | |
2026.02 | 45.7 | 31 | 41.2 | - | |
2026.02 | 45.2 | 25 | 39 | - | |
2026.02 | 44.4 | 40 | 43.1 | - | |
2026.02 | 43.5 | 26 | 38.2 | - | |
2026.02 | 37.4 | 22 | 32.7 | - | |
2026.02 | 27 | 10 | 21.8 | - | |
2026.02 | 14.8 | 18 | 15.8 | - | |
2026.02 | 13 | 14 | 13.3 | - | |
2026.01 | - | - | - | 80.3 | |
2026.01 | - | - | - | 74.3 | |
2026.01 | - | - | - | 80.3 | |
2026.01 | - | - | - | 85.4 | |
2026.01 | - | - | - | 84.7 | |
2026.01 | - | - | - | 80.2 |