Tool-use agent evaluation on τ-bench retail (test)
57.5Pass@4 Success Rate
PG-CHECKLIST
Updated 26d ago
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
2026.06 | 57.5 | - | - | - | - | - | 100 | 52.8 | |
2026.06 | 50 | - | - | - | - | - | 75 | 47.2 | |
2026.06 | 22.5 | - | - | - | - | - | 100 | 13.9 | |
2026.04 | 16.3 | 34.6 | 24.1 | 19.3 | 13.9 | - | - | - | |
2026.04 | 11.82 | 31.3 | 19.3 | 14.34 | 10.43 | - | - | - | |
2026.04 | 9.57 | 17.22 | 12.35 | 10.61 | 8.7 | - | - | - | |
2026.06 | - | - | - | - | - | 41.7 | - | - | |
2026.06 | - | - | - | - | - | 41.7 | - | - | |
2026.06 | - | - | - | - | - | 51.7 | - | - | |
2026.06 | - | - | - | - | - | 40 | - | - | |
2026.06 | - | - | - | - | - | 36.7 | - | - | |
2026.06 | - | - | - | - | - | 40 | - | - |