Tool Use Evaluation on ShortcutsBench clear instructions 200 queries
92.5API Selection Accuracy
GPT-4o
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.08 | 92.5 | 42.5 | |
2024.08 | 91.5 | 53.5 | |
2024.08 | 89 | 53.5 | |
2024.08 | 89 | 46 | |
2024.08 | 88.5 | 50 | |
2024.08 | 87 | 46 | |
2024.08 | 86 | 45 | |
2024.08 | 83.5 | 46 |