Attention Operator Throughput on Llama2 7B (32 Q-heads/32 KV-heads/128 Head-dimension)
207.3Attention TFLOPS
flash-attn v2
Updated 27d ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2025.06 | 207.3 | - | - | - | - | |
2025.06 | 202.7 | - | - | - | - | |
2025.06 | 201.5 | - | - | - | - | |
2025.06 | 201.2 | - | - | - | - | |
2025.06 | 198.3 | - | - | - | - | |
2025.06 | 197.2 | - | - | - | - | |
2025.06 | 188.3 | - | - | - | - | |
2025.06 | 186.7 | - | - | - | - | |
2025.06 | 180.3 | - | - | - | - | |
2025.06 | 176.8 | - | - | - | - | |
2025.06 | 173.4 | - | - | - | - | |
2025.06 | 167.1 | - | - | - | - | |
2025.06 | 164.1 | - | - | - | - | |
2025.06 | 160.6 | - | - | - | - | |
2025.06 | 158.4 | - | - | - | - | |
2025.06 | 152.5 | - | - | - | - | |
2025.06 | 150.2 | - | - | - | - | |
2026.05 | 145.69 | - | - | - | - | |
2025.06 | 142.6 | - | - | - | - | |
2025.06 | 137.1 | - | - | - | - | |
2026.05 | 131.67 | - | - | - | - | |
2025.06 | 128.6 | - | - | - | - | |
2025.06 | 122.5 | - | - | - | - | |
2026.05 | 116.69 | - | - | - | - | |
2025.06 | 112.4 | - | - | - | - | |
2026.05 | 110.44 | - | - | - | - | |
2025.06 | 108.6 | - | - | - | - | |
2026.05 | 105.55 | - | - | - | - | |
2026.05 | 92.5 | - | - | - | - | |
2025.06 | 82.8 | - | - | - | - | |
2026.05 | 79.37 | - | - | - | - | |
2026.05 | 77.09 | - | - | - | - | |
2026.05 | 44.46 | - | - | - | - | |
2025.06 | 15.1 | - | - | - | - | |
2025.06 | 15.1 | - | - | - | - | |
2025.06 | 14.6 | - | - | - | - | |
2025.06 | 14.6 | - | - | - | - | |
2025.06 | 13.3 | - | - | - | - | |
2026.05 | 13.12 | - | - | - | - | |
2026.05 | 12.36 | - | - | - | - | |
2026.05 | 10.99 | - | - | - | - | |
2025.06 | 10.9 | - | - | - | - | |
2026.05 | - | 27.22 | 19.72 | 25.48 | 29.61 | |
2026.05 | - | 211.17 | 319.03 | 374.71 | 404.09 | |
2026.05 | - | 81.07 | 126.08 | 175.6 | 215.75 | |
2026.05 | - | 304.35 | 414.05 | 577.03 | 551.73 | |
2026.05 | - | 23.65 | 9.25 | 6 | 3.4 | |
2026.05 | - | 109.37 | 111.62 | 113.39 | 115.7 | |
2026.05 | - | 65.43 | 53.43 | 38.77 | 24.62 | |
2026.05 | - | 137.8 | 176.88 | 182.44 | 151.9 |