Decoding Performance on RTX 4090 platform
426Throughput (tokens/sec)
LAQuant
Updated 22d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 426 | 2.27 | |
2026.05 | 365.8 | 1.95 | |
2026.05 | 322.11 | 5.72 | |
2026.05 | 322.1 | 3.48 | |
2026.05 | 302.1 | 1.61 | |
2026.05 | 282.94 | 5.3 | |
2026.05 | 279.6 | 3.02 | |
2026.05 | 276.6 | 5.03 | |
2026.05 | 271.6 | 1.45 | |
2026.05 | 243.2 | 4.42 | |
2026.05 | 187.3 | - | |
2026.05 | 183.5 | 1.99 | |
2026.05 | 168.4 | 1.82 | |
2026.05 | 129.71 | 2.3 | |
2026.05 | 122.66 | 2.18 | |
2026.05 | 121.8 | 2.21 | |
2026.05 | 114.6 | 2.08 | |
2026.05 | 92.5 | - | |
2026.05 | 56.3 | - | |
2026.05 | 55 | - |