KV Cache Efficiency on Trace-driven Simulation (1GB Budget, 100k Pool)
3.47Low Skewness Hit Ratio
LazyAttention
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 3.47 | 11.11 | 13.57 | |
2026.06 | 1.84 | 6.03 | 7.27 | |
2026.06 | 1.51 | 4.95 | 5.96 | |
2026.06 | 0 | 0 | 0 |
LazyAttention
| Method | Links | |||
|---|---|---|---|---|
2026.06 | 3.47 | 11.11 | 13.57 | |
2026.06 | 1.84 | 6.03 | 7.27 | |
2026.06 | 1.51 | 4.95 | 5.96 | |
2026.06 | 0 | 0 | 0 |