Tool Learning under Instruction with Missing Key Information on NoisyToolBench IMKI 1.0 (test)
94A1 Success Rate
CoT + AwN
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.08 | 94 | 62 | 50 | |
2024.08 | 90 | 58 | 36 | |
2024.08 | 88 | 52 | 46 | |
2024.08 | 88 | 60 | 46 | |
2024.08 | 86 | 40 | 18 | |
2024.08 | 86 | 62 | 42 | |
2024.08 | 82 | 16 | 16 | |
2024.08 | 82 | 40 | 12 | |
2024.08 | 80 | 56 | 48 | |
2024.08 | 80 | 54 | 52 | |
2024.08 | 80 | 52 | 34 | |
2024.08 | 78 | 54 | 52 | |
2024.08 | 74 | 36 | 22 | |
2024.08 | 74 | 44 | 24 | |
2024.08 | 74 | 48 | 32 | |
2024.08 | 72 | 52 | 42 | |
2024.08 | 70 | 52 | 36 | |
2024.08 | 64 | 16 | 12 | |
2024.08 | 62 | 2 | 2 | |
2024.08 | 58 | 20 | 18 | |
2024.08 | 54 | 50 | 50 | |
2024.08 | 52 | 48 | 34 | |
2024.08 | 52 | 44 | 42 | |
2024.08 | 44 | 40 | 20 | |
2024.08 | 42 | 30 | 26 | |
2024.08 | 26 | 18 | 14 | |
2024.08 | 24 | 26 | 20 | |
2024.08 | 22 | 18 | 10 | |
2024.08 | 10 | 22 | 16 | |
2024.08 | 2 | 20 | 18 | |
2024.08 | 0 | 16 | 16 | |
2024.08 | 0 | 16 | 16 |