LLM Inference on ToolBench (Goodput)
3.9Goodput (req/s)
AugServe
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 3.9 | |
2025.12 | 2.92 | |
2025.12 | 2.91 | |
2025.12 | 2.81 | |
2025.12 | 2.8 | |
2025.12 | 2.04 | |
2025.12 | 1.65 | |
2025.12 | 1.51 | |
2025.12 | 1.39 | |
2025.12 | 1.06 | |
2025.12 | 0.16 | |
2025.12 | 0.14 | |
2025.12 | 0.11 | |
2025.12 | 0.1 | |
2025.12 | 0.08 | |
2025.12 | 0.07 | |
2025.12 | 0.05 | |
2025.12 | 0.05 |