Max token throughput on 64K/64K serving scenario 8xH100 node 1.0
9.3Max Throughput (K tok/s)
gpt-oss-puzzle-88B
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.02 | 9.3 | |
2026.02 | 6.9 | |
2026.02 | 6.5 | |
2026.02 | 5.8 | |
2026.02 | 4 |
gpt-oss-puzzle-88B
| Method | Links | |
|---|---|---|
2026.02 | 9.3 | |
2026.02 | 6.9 | |
2026.02 | 6.5 | |
2026.02 | 5.8 | |
2026.02 | 4 |