APIBench
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| API Usage | APIBench HF (test) | Accuracy83.2 | 12 | |
| Tool Invocation | APIBench | HuggingFace AST Accuracy79.2 | 8 | |
| Tool Use | APIBench OOD - TensorHub | Hallucination Rate2.04 | 6 | |
| Tool Use | APIBench OOD TorchHub | Hallucination Rate5.91 | 6 | |
| Tool Use | APIBench OOD HuggingFace | Hallucination Rate0.0642 | 6 | |
| Tool Selection | APIBench (test) | Recall@130.64 | 4 | |
| API Question Answering | APIBench TensorFlow Hub (test) | Accuracy88.91 | 4 | |
| API Question Answering | APIBench Torch Hub (test) | Accuracy93.55 | 4 | |
| API Question Answering | APIBench Hugging Face (test) | Accuracy77.21 | 4 |
Showing 9 of 9 rows