Inference Efficiency Benchmark
20TTFT (ms)
ACT
Updated 1mo ago
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
2026.02 | 20 | - | 3.8 | - | - | |
2026.04 | 60 | 64.3 | 6.02 | 10.7 | 1.554 | |
2026.02 | 70 | - | 5.4 | - | - | |
2026.04 | 93 | 44.2 | 14.51 | 3 | 2.263 | |
2026.04 | 236 | 39.7 | 16.81 | 2.4 | 2.518 | |
2026.04 | 253 | 30.8 | 22.31 | 1.4 | 3.247 | |
2026.04 | 307 | 28.7 | 17.58 | 1.6 | 3.481 | |
2026.04 | 347 | 39 | 15.71 | 2.5 | 2.566 |