Decoding on Llama 70B 3.1 (inference)
1,410.39Throughput
DeepFusionKernel
Updated 4d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.02 | 1,410.39 | 1.3 | |
2026.02 | 1,391.76 | - | |
2026.02 | 847.42 | 3.9 | |
2026.02 | 815.37 | - | |
2026.02 | 497.69 | 9.7 | |
2026.02 | 453.75 | - | |
2026.02 | 270.74 | 6.1 | |
2026.02 | 255.29 | - | |
2026.02 | 169.33 | - | |
2026.02 | 140.55 | 4.9 | |
2026.02 | 134.02 | - | |
2026.02 | 86.43 | - | |
2026.02 | 72.6 | 7.7 | |
2026.02 | 67.43 | - | |
2026.02 | 40.57 | - | |
2026.02 | 37.66 | 5.7 | |
2026.02 | 35.64 | - | |
2026.02 | 22.98 | - | |
2026.02 | 11.83 | - | |
2026.02 | 5.65 | - | |
2026.02 | 2.97 | - |