Text Generation Inference Performance on Synthetic 1k Tokens
2,626Throughput (k tokens/s)
SRM
Updated 22d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2026.05 | 2,626 | 1,200 | |
2026.05 | 1,203 | 800 | |
2026.05 | 184 | 50 | |
2026.05 | 101 | 5.32 | |
2026.05 | 44 | 20 |
SRM
| Method | Links | ||
|---|---|---|---|
2026.05 | 2,626 | 1,200 | |
2026.05 | 1,203 | 800 | |
2026.05 | 184 | 50 | |
2026.05 | 101 | 5.32 | |
2026.05 | 44 | 20 |