LLM Decoding on LLM Decoding
40,000cuBLASLt Throughput
cuBLASLt
Updated 2mo ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.03 | 40,000 | - | - | - | - | |
2026.03 | 33,300 | - | - | - | - | |
2026.03 | 30,400 | - | - | - | - | |
2026.03 | 29,900 | - | - | - | - | |
2026.03 | 29,100 | - | - | - | - | |
2026.03 | 26,500 | - | - | - | - | |
2026.03 | 26,500 | - | - | - | - | |
2026.03 | 26,200 | - | - | - | - | |
2026.03 | 25,900 | - | - | - | - | |
2026.03 | 25,400 | - | - | - | - | |
2026.03 | 24,700 | - | - | - | - | |
2026.03 | 23,000 | - | - | - | - | |
2026.03 | 22,900 | - | - | - | - | |
2026.03 | 21,300 | - | - | - | - | |
2026.03 | 20,700 | - | - | - | - | |
2026.03 | 20,300 | - | - | - | - | |
2026.03 | 20,200 | - | - | - | - | |
2026.03 | 20,100 | - | - | - | - | |
2026.03 | 18,100 | - | - | - | - | |
2026.03 | 18,000 | - | - | - | - | |
2026.03 | 17,200 | - | - | - | - | |
2026.03 | 17,200 | - | - | - | - | |
2026.03 | 17,100 | - | - | - | - | |
2026.03 | 16,000 | - | - | - | - | |
2026.03 | 15,800 | - | - | - | - | |
2026.03 | 15,400 | - | - | - | - | |
2026.03 | 15,000 | - | - | - | - | |
2026.03 | 14,700 | - | - | - | - | |
2026.03 | 14,600 | - | - | - | - | |
2026.03 | 14,600 | - | - | - | - | |
2026.03 | 14,200 | - | - | - | - | |
2026.03 | 14,000 | - | - | - | - | |
2026.03 | 14,000 | - | - | - | - | |
2026.03 | 13,300 | - | - | - | - | |
2026.03 | 13,200 | - | - | - | - | |
2026.03 | 13,100 | - | - | - | - | |
2026.03 | 11,600 | - | - | - | - | |
2026.03 | 11,500 | - | - | - | - | |
2026.03 | 11,400 | - | - | - | - | |
2026.03 | 11,200 | - | - | - | - | |
2026.03 | 11,100 | - | - | - | - | |
2026.03 | 10,900 | - | - | - | - | |
2026.03 | 10,600 | - | - | - | - | |
2026.03 | 10,300 | - | - | - | - | |
2026.03 | 10,100 | - | - | - | - | |
2026.03 | 10,000 | - | - | - | - | |
2026.03 | 9,970 | - | - | - | - | |
2026.03 | 9,930 | - | - | - | - | |
2026.03 | 9,820 | - | - | - | - | |
2026.03 | 9,570 | - | - | - | - | |
2026.03 | 9,370 | - | - | - | - | |
2026.03 | 8,700 | - | - | - | - | |
2026.03 | 8,690 | - | - | - | - | |
2026.03 | 8,230 | - | - | - | - | |
2026.03 | 8,190 | - | - | - | - | |
2026.03 | 8,170 | - | - | - | - | |
2026.03 | 8,110 | - | - | - | - | |
2026.03 | 8,080 | - | - | - | - | |
2026.03 | 7,340 | - | - | - | - | |
2026.03 | 7,090 | - | - | - | - | |
2026.03 | 6,990 | - | - | - | - | |
2026.03 | 6,690 | - | - | - | - | |
2026.03 | 6,130 | - | - | - | - | |
2026.03 | 6,080 | - | - | - | - | |
2026.03 | 5,770 | - | - | - | - | |
2026.03 | 5,720 | - | - | - | - | |
2026.03 | 5,670 | - | - | - | - | |
2026.03 | 5,670 | - | - | - | - | |
2026.03 | 5,390 | - | - | - | - | |
2026.03 | 5,000 | - | - | - | - | |
2026.03 | 4,840 | - | - | - | - | |
2026.03 | 3,990 | - | - | - | - | |
2026.03 | 3,310 | - | - | - | - | |
2026.03 | 3,080 | - | - | - | - | |
2026.03 | 3,030 | - | - | - | - | |
2026.03 | 2,430 | - | - | - | - | |
2026.03 | 1,530 | - | - | - | - | |
2026.03 | 1,370 | - | - | - | - | |
2026.03 | - | 1.1 | 1 | 0.91 | 0.96 | |
2026.03 | - | 1.05 | 0.98 | 1.01 | 0.97 | |
2026.03 | - | 1.07 | 1.03 | 1.01 | 0.99 | |
2026.03 | - | 1.09 | 1.06 | 1.06 | 1.02 | |
2026.03 | - | 1.16 | 1.11 | 1.1 | 1.07 | |
2026.03 | - | 1.14 | 1.07 | 1.05 | 1.03 | |
2026.03 | - | 1.14 | 1.06 | 1.05 | 1.03 | |
2026.03 | - | 1.21 | 1.14 | 1.13 | 1.07 | |
2026.03 | - | 1.09 | 1.04 | 1.01 | 0.99 | |
2026.03 | - | 1.16 | 1.08 | 1.06 | 1.05 | |
2026.03 | - | 1.13 | 1.06 | 1.05 | 1.03 | |
2026.03 | - | 1.18 | 1.1 | 1.07 | 1.04 | |
2026.03 | - | 1.25 | 1.14 | 1.12 | 1.08 | |
2026.03 | - | 1.21 | 1.09 | 1.05 | 1.03 | |
2026.03 | - | 1.26 | 1.12 | 1.08 | 1.04 | |
2026.03 | - | 1.31 | 1.16 | 1.12 | 1.09 | |
2026.03 | - | 1.28 | 1.14 | 1.1 | 1.08 | |
2026.03 | - | 1.24 | 1.12 | 1.09 | 1.04 | |
2026.03 | - | 1.35 | 1.19 | 1.13 | 1.1 | |
2026.03 | - | 1.4 | 1.23 | 1.17 | 1.14 | |
2026.03 | - | 1.15 | 1.06 | 0.93 | 0.94 | |
2026.03 | - | 1.03 | 1.01 | 1 | 0.96 |
Showing 100 of 156 rows