User simulator goal alignment on τ-Bench Retail
94.5User Profile Adherence
Gemma-3-27B-It
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2025.07 | 94.5 | 56.6 | 97.1 | 99.5 | 89.8 | 87.5 | |
2025.07 | 92.7 | 59.2 | 96 | 98.4 | 100 | 89.3 | |
2025.07 | 91.7 | 46.1 | 99.6 | 100 | 100 | 87.5 | |
2025.07 | 91 | 39.5 | 97.8 | 99.5 | 96.3 | 84.8 | |
2025.07 | 88.6 | 40.8 | 98.2 | 97.9 | 91.7 | 83.4 | |
2025.07 | 85.8 | 48.7 | 97.1 | 98.4 | 98.1 | 85.6 | |
2025.07 | 85.8 | 43.4 | 92.4 | 94.7 | 82.4 | 79.7 | |
2025.07 | 85.5 | 38.2 | 97.1 | 97.9 | 97.2 | 83.2 | |
2025.07 | 84.8 | 36.8 | 97.1 | 98.9 | 96.3 | 82.8 | |
2025.07 | 84.8 | 52.6 | 95.3 | 98.9 | 97.2 | 85.8 | |
2025.07 | 84.8 | 47.3 | 95.5 | 97.8 | 94.1 | 83.9 | |
2025.07 | 84.8 | 47.4 | 98.9 | 99.5 | 98.1 | 85.7 | |
2025.07 | 82 | 40.8 | 96 | 99.5 | 91.7 | 82 | |
2025.07 | 73 | 47.4 | 94.9 | 97.9 | 93.5 | 81.4 |