Attention Operator Throughput on Llama 405B (128 Q-heads/8 KV-heads/128 Head-dimension) 3.1
225.3TFLOPS
flash-attn v2
Updated 4d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.06 | 225.3 | |
2025.06 | 221.1 | |
2025.06 | 211.2 | |
2025.06 | 209.1 | |
2025.06 | 206.9 | |
2025.06 | 206.4 | |
2025.06 | 204.4 | |
2025.06 | 200.3 | |
2025.06 | 196.7 | |
2025.06 | 192.2 | |
2025.06 | 187.5 | |
2025.06 | 183.4 | |
2025.06 | 175.3 | |
2025.06 | 169.7 | |
2025.06 | 168.4 | |
2025.06 | 164.1 | |
2025.06 | 157.7 | |
2025.06 | 157.2 | |
2025.06 | 146.5 | |
2025.06 | 144.4 | |
2025.06 | 129.1 | |
2025.06 | 121.9 | |
2025.06 | 117.2 | |
2025.06 | 93.2 | |
2025.06 | 11.2 | |
2025.06 | 11.1 | |
2025.06 | 10.2 | |
2025.06 | 8.9 |