Tool Use Accuracy on Unseen Tools
1SRt
ChatHuman
Updated 4d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2024.05 | 1 | 0.968 | 0.893 | 0.953 | 0.953 | |
2024.05 | 0.999 | 0.967 | 0.893 | 0.954 | 0.953 | |
2024.05 | 0.998 | 0.913 | 0.801 | 0.872 | 0.907 | |
2024.05 | 0.969 | 0.924 | 0.734 | 0.746 | 0.876 | |
2024.05 | 0.904 | 0.807 | 0.69 | 0.747 | 0.8 | |
2024.05 | 0.612 | 0.546 | 0.542 | 0.525 | 0.573 | |
2024.05 | 0.507 | 0.314 | 0.226 | 0.293 | 0.803 |