Relative Pos. Attention on Llama2-7b (q=32, k=32) (1k)
114.85TFLOPS (Relative Pos. Attention)
FlexAttention
Updated 27d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.05 | 114.85 | |
2026.05 | 105.8 | |
2026.05 | 71.05 | |
2026.05 | 14.7 |
FlexAttention
| Method | Links | |
|---|---|---|
2026.05 | 114.85 | |
2026.05 | 105.8 | |
2026.05 | 71.05 | |
2026.05 | 14.7 |