LLM Decoding Throughput on NOSA-8B 64K context length
1,996.3Throughput (tok/s)
SparDA
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.06 | 1,996.3 | |
2026.06 | 1,905.2 | |
2026.06 | 1,793.1 | |
2026.06 | 1,553.1 | |
2026.06 | 1,392.3 | |
2026.06 | 1,071.1 | |
2026.06 | 870.9 | |
2026.06 | 704.6 | |
2026.06 | 439.7 | |
2026.06 | 431.2 | |
2026.06 | 397.9 | |
2026.06 | 233.2 | |
2026.06 | 221 | |
2026.06 | 220.4 | |
2026.06 | 218.8 | |
2026.06 | 217.6 | |
2026.06 | 181 | |
2026.06 | 174.3 | |
2026.06 | 139.1 | |
2026.06 | 106.2 | |
2026.06 | 78.1 |