LLM Generation Latency on Llama-2-7B
22.1Latency (LAN)
Protocol 2 (SIGMA)
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 22.1 | 22.2 | |
2026.02 | 44.4 | 44.4 | |
2026.02 | 118.3 | 118.9 | |
2026.02 | 227.7 | 236.6 | |
2026.02 | 369.7 | - | |
2026.02 | 726.5 | - | |
2026.02 | 1,189 | 1,194 | |
2026.02 | 1,798.1 | - | |
2026.02 | 2,260 | 2,301 | |
2026.02 | 3,889.3 | - | |
2026.02 | 19,550.8 | - | |
2026.02 | 35,860.1 | - |