Inference Efficiency on 1x V100 (16GB) (synthetic)
28,298Throughput (tokens/s)
SRM
Updated 22d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 28,298 | 64,000 | 14.75 | |
2026.05 | 28,091 | 64,000 | 9.66 | |
2026.05 | 27,445 | 32,000 | 43.29 | |
2026.05 | 27,441 | 32,000 | 24.59 | |
2026.05 | 2,908 | 400 | - | |
2026.05 | 1,918 | 200 | - | |
2026.05 | 1,116 | 100 | - | |
2026.05 | 634 | 50 | - |