LLM Inference on Merge
1.16Goodput (req/s)
AugServe
Updated 3mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.12 | 1.16 | |
2025.12 | 1.15 | |
2025.12 | 0.87 | |
2025.12 | 0.58 | |
2025.12 | 0.47 | |
2025.12 | 0.35 | |
2025.12 | 0.28 | |
2025.12 | 0.22 | |
2025.12 | 0.2 | |
2025.12 | 0.15 | |
2025.12 | 0.13 | |
2025.12 | 0.11 | |
2025.12 | 0.1 | |
2025.12 | 0.08 | |
2025.12 | 0.07 | |
2025.12 | 0.06 | |
2025.12 | 0.05 | |
2025.12 | 0.04 |