Efficiency Benchmarking on DeepSeek-R1-Distill-Llama-8B (8K Generation Length)
8Max Batch Size
SnapKV
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.06 | 8 | 221.58 | 3.15 | 295.77 | |
2026.06 | 8 | 186.41 | 2.65 | 351.57 | |
2026.06 | 8 | 163.26 | 2.32 | 401.41 | |
2026.06 | 8 | 217.35 | 3.09 | 301.52 | |
2026.06 | 8 | 183.54 | 2.61 | 357.07 | |
2026.06 | 8 | 161.39 | 2.29 | 406.07 | |
2026.06 | 8 | 218.78 | 3.11 | 299.56 | |
2026.06 | 8 | 184.62 | 2.62 | 354.97 | |
2026.06 | 8 | 161.91 | 2.3 | 404.77 | |
2026.06 | 4 | 70.45 | 1 | 465.1 |