Tool Learning under Instruction with Error on NoisyToolBench IwE 1.0 (test)
74A1 Success Rate
CoT + AwN
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.08 | 74 | 48 | 28 | |
2024.08 | 72 | 42 | 36 | |
2024.08 | 66 | 36 | 26 | |
2024.08 | 64 | 46 | 38 | |
2024.08 | 60 | 44 | 32 | |
2024.08 | 58 | 28 | 22 | |
2024.08 | 58 | 42 | 32 | |
2024.08 | 58 | 38 | 36 | |
2024.08 | 54 | 12 | 10 | |
2024.08 | 54 | 38 | 36 | |
2024.08 | 54 | 38 | 22 | |
2024.08 | 52 | 26 | 24 | |
2024.08 | 52 | 38 | 36 | |
2024.08 | 50 | 24 | 16 | |
2024.08 | 50 | 34 | 22 | |
2024.08 | 48 | 14 | 14 | |
2024.08 | 48 | 34 | 34 | |
2024.08 | 40 | 30 | 26 | |
2024.08 | 36 | 6 | 2 | |
2024.08 | 36 | 36 | 30 | |
2024.08 | 34 | 34 | 26 | |
2024.08 | 22 | 12 | 12 | |
2024.08 | 18 | 6 | 4 | |
2024.08 | 12 | 12 | 10 | |
2024.08 | 12 | 20 | 18 | |
2024.08 | 10 | 14 | 14 | |
2024.08 | 8 | 12 | 6 | |
2024.08 | 8 | 26 | 24 | |
2024.08 | 0 | 4 | 4 | |
2024.08 | 0 | 6 | 2 | |
2024.08 | 0 | 8 | 6 | |
2024.08 | 0 | 8 | 4 |