LLM Inference on Long-Context LLM Inference Decode
0.13Latency (ms)
Reuse
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.12 | 0.13 | 0.18 | - | - | |
2025.12 | 0.24 | - | 2.91 | 2.95 | |
2025.12 | 0.7 | - | - | - | |
2025.12 | 0.71 | - | - | - | |
2025.12 | 0.82 | 1.15 | - | - | |
2025.12 | 0.92 | 1.3 | - | - | |
2025.12 | 5.33 | - | 4.1 | 4.08 | |
2025.12 | 10.17 | - | 2.15 | 2.14 |