Language Model Inference on vLLM benchmark (1024 prompts)
1.839Latency (s)
Fisher-IntDim-E
Updated 1mo ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.06 | 1.839 | 8,909 | 251 | 15.09 | 2.274 | |
2026.06 | 2.233 | 7,336 | 187 | 26.67 | 2.689 |
Fisher-IntDim-E
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.06 | 1.839 | 8,909 | 251 | 15.09 | 2.274 | |
2026.06 | 2.233 | 7,336 | 187 | 26.67 | 2.689 |