Decoding on RTX 6000 Ada platform
468.7Throughput (tokens/sec)
LAQuant
Updated 22d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 468.7 | 2.5 | |
2026.05 | 392.9 | 2.1 | |
2026.05 | 345.47 | 6.45 | |
2026.05 | 325 | 3.58 | |
2026.05 | 313.9 | 1.68 | |
2026.05 | 298.15 | 5.57 | |
2026.05 | 279.7 | 1.49 | |
2026.05 | 278.2 | 3.06 | |
2026.05 | 276.9 | 5.27 | |
2026.05 | 241.3 | 4.59 | |
2026.05 | 191.4 | 2.11 | |
2026.05 | 187.1 | - | |
2026.05 | 174.4 | 1.92 | |
2026.05 | 129.26 | 2.41 | |
2026.05 | 122.5 | 2.33 | |
2026.05 | 120.93 | 2.26 | |
2026.05 | 112.6 | 2.14 | |
2026.05 | 90.8 | - | |
2026.05 | 53.55 | - | |
2026.05 | 52.5 | - |