Prefill Latency Measurement on LLaMA 8B Instruct 128K context length 3.1
24,055.4Attention Latency (ms)
CompactAttention-FP
Updated 2mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 24,055.4 | 54,130.6 | |
2026.05 | 32,846 | 64,126.7 | |
2026.05 | 43,750.5 | 80,108.5 | |
2026.05 | 49,839.8 | 81,774.4 | |
2026.05 | 56,475.3 | 85,375.3 | |
2026.05 | 65,971.1 | 94,944.3 | |
2026.05 | 82,617 | 113,016.5 |