Tool-use agent evaluation on τ-bench airline
76Pass@1
Ledger
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.06 | 76 | - | - | 56 | - | 64.6 | |
2026.06 | 74 | - | - | 52 | - | 62.3 | |
| 69 | - | - | 44 | - | 54.4 | ||
| 66.5 | - | - | 40 | - | 51.3 | ||
2026.06 | 63 | - | - | 40 | - | 49.9 | |
| 61.5 | - | - | 36 | - | 46.2 | ||
2026.04 | 30.4 | 20 | 16.2 | 14.8 | 14 | - | |
2026.04 | 29.2 | 21.2 | 18.8 | 18 | 18 | - | |
2026.04 | 28 | 20.4 | 17.4 | 15.6 | 14 | - | |
2026.04 | 26.8 | 20 | 18.4 | 18 | 18 | - | |
2026.04 | 25.2 | 17 | 13.2 | 10.4 | 8 | - | |
2026.04 | 24.4 | 18.79 | 15.6 | 12.8 | 10 | - |