Web-based Agent Interaction on WebShop
100CoT Match Rate
Teacher (OPT13B)
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.05 | 100 | 73.2 | 35.9 | 5.9 | |
2025.05 | 100 | 71.8 | 34.8 | 5.8 | |
2025.05 | 100 | 75.6 | 34.6 | 5.8 | |
2025.05 | 100 | - | - | - | |
2025.05 | 100 | - | - | - | |
| 74.6 | 66.2 | 34.2 | 5.8 | ||
| 72.9 | 64.1 | 34.9 | 5.8 | ||
| 72.9 | - | - | - | ||
| 72.5 | 63.8 | 35.1 | 5.9 | ||
| 72.5 | - | - | - | ||
2025.05 | 70.2 | 61.7 | 36.9 | 6 | |
2025.05 | 69.4 | 60.4 | 37.2 | 6.1 | |
2025.05 | 68.7 | 59.2 | 37.8 | 6.2 | |
2025.05 | 68.3 | 59.3 | 37.5 | 6.1 | |
2025.05 | 68.3 | - | - | - | |
| 67.9 | 56.4 | 36.2 | 6.1 | ||
2025.05 | 67.9 | 58.6 | 37.2 | 6.2 | |
| 67.9 | - | - | - | ||
2025.05 | 67.9 | - | - | - | |
2025.05 | 67.1 | 58.1 | 37.9 | 6.2 | |
2025.05 | 67 | 56.9 | 37.8 | 6.3 | |
2025.05 | 66.5 | 55.8 | 38.4 | 6.4 | |
2025.05 | 66 | 56.9 | 38.3 | 6.3 | |
2025.05 | 65 | - | - | - | |
| 63.8 | 48.7 | 38 | 6.4 | ||
| 63.8 | - | - | - | ||
2025.05 | 63.8 | - | - | - | |
2025.05 | 63.5 | - | - | - | |
2025.05 | 62.7 | 51 | 39 | 6.6 | |
2025.05 | 62.7 | - | - | - | |
2025.05 | 61.9 | 49.7 | 39.5 | 6.7 | |
2025.05 | 61.5 | - | - | - | |
2025.05 | 61 | 48.3 | 40.1 | 6.9 | |
2025.05 | 59.8 | - | - | - | |
2025.05 | 57.9 | 43.2 | 41.8 | 7.1 | |
2025.05 | 57.9 | - | - | - | |
2025.05 | 57.3 | - | - | - | |
2025.05 | 56.1 | 41.8 | 42.5 | 7.2 | |
2025.05 | 55 | 40.7 | 43.9 | 7.3 | |
2025.05 | 54.1 | - | - | - | |
2025.05 | 52.4 | - | - | - |