Task Failure Prediction and Selective Completion on tau2-bench Airline 1.0
74.2AUROC
TRACER
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 74.2 | 61.5 | |
2026.02 | 73.5 | 62.9 | |
2026.02 | 72.5 | 69.7 | |
2026.02 | 66.6 | 64.8 | |
2026.02 | 66.3 | 64.5 | |
2026.02 | 60.3 | 51.6 | |
2026.02 | 60 | 51.4 | |
2026.02 | 59.5 | 51.7 | |
2026.02 | 56.8 | 61.2 | |
2026.02 | 54.1 | 42.7 | |
2026.02 | 54 | 59.9 | |
2026.02 | 53.8 | 40.2 | |
2026.02 | 53.1 | 40.3 | |
2026.02 | 46.2 | 45.1 | |
2026.02 | 29 | 23.6 |