Inference Efficiency on 128K-context
101TTFT
IT-SPEED-16
Updated 26d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.05 | 101 | 55 | 50 | |
2026.05 | 101 | 55 | 50 | |
2026.05 | 60 | 36 | 37.5 | |
2026.05 | 60 | 36 | 37.5 | |
2026.05 | 33 | 22 | 25 | |
2026.05 | 33 | 22 | 25 | |
2026.05 | 14 | 10 | 12.5 | |
2026.05 | 14 | 10 | 12.5 |