Inference Efficiency on LLaMA 8B 8K context length 3.1
159Theoretical Compute (TFLOPs)
SpecKV
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2026.03 | 159 | 81 | 337 | 79.53 | 411 | 121 | |
2026.03 | 159 | 81 | 337 | 79.53 | 411 | 120.51 | |
2026.03 | 137 | 13 | 258 | 1.03 | 302 | 11 | |
2026.03 | 137 | 445 | 492 | 234.59 | 800 | 509 | |
2026.03 | 137 | 13 | 258 | 1.03 | 302 | 10.88 | |
2026.03 | 137 | 445 | 492 | 234.59 | 800 | 509.38 | |
2026.03 | 136 | 13 | 257 | - | 291 | - | |
2026.03 | 136 | 13 | 257 | 0.01 | 311 | 20 | |
2026.03 | 136 | 13 | 257 | - | 291 | - | |
2026.03 | 136 | 13 | 257 | 0.01 | 311 | 20.17 |