Prefill Latency Measurement on LLaMA 8B Instruct 16K context length 3.1
1,224Attention Prefill Latency
Dense
Updated 2mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 1,224 | 4,858 | |
2026.05 | 1,356.2 | 4,978.7 | |
2026.05 | 1,393.6 | 4,953.2 | |
2026.05 | 1,599.5 | 5,156.3 | |
2026.05 | 2,548.7 | 6,286.4 | |
2026.05 | 2,675.7 | 6,382.9 | |
2026.05 | 2,700.5 | 6,243.9 |