LLM Agent Evaluation on tau-bench Airline
42Accuracy
Rule-Based (Medium)
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
2026.03 | 42 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 6 | 13.2 | 98 | 580 | 1,961 | 11,616 | 148 | 952 | |
2026.03 | 38 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 2 | 10.6 | 873 | 195 | 17,472 | 3,895 | 1,654 | 554 | |
| 36 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 0 | 12.6 | 239 | 439 | 4,779 | 8,798 | 379 | 721 | ||
2026.03 | 36 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 12.3 | 678 | - | 13,577 | - | 1,100 | - | |
2026.03 | 34 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 2 | 13.5 | 521 | 157 | 10,437 | 3,140 | 770 | 330 | |
2026.03 | 34 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 2 | 12.4 | 396 | 282 | 7,927 | 5,650 | 641 | 459 | |
2026.03 | 32 | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | - | 4 | 10.8 | 12 | 666 | 250 | 13,327 | 23 | 1,077 | |
2026.03 | - | 60 | 44 | 23.1 | 146.7 | 8.7 | 67 | 94 | 5.27 | 131 | 97 | 96 | 84 | 88 | 93 | 99 | 30 | 1 | 1 | 1 | - | - | - | - | - | - | - | - | |
2026.03 | - | 48 | 28 | 23.2 | 50.2 | 7 | 73.1 | 76 | 4.58 | 63 | 91 | 92 | 77 | 81 | 96 | 91 | 70 | 1 | 1 | 1 | - | - | - | - | - | - | - | - | |
2026.03 | - | 40 | 18 | 23.2 | 25.6 | 7.6 | 69.3 | 89 | 5.76 | 91 | 74 | 99 | 36 | 49 | 79 | 45 | 28 | 1 | 1 | 1 | - | - | - | - | - | - | - | - |