LLM Inference Scheduling on LMSYS-Chat-1M
0.1432Average Per-token Latency (s/token)
Oracle SJF
Updated 27d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.09 | 0.1432 | - | - | - | |
2025.09 | 0.1532 | - | - | - | |
2025.09 | 0.1864 | - | - | - | |
2025.09 | 0.1879 | - | - | - | |
2025.09 | 0.2069 | - | - | - | |
2025.09 | 0.2146 | - | - | - | |
2025.09 | 0.2559 | - | - | - | |
2025.09 | 0.2749 | - | - | - | |
2025.09 | 0.3217 | - | - | - | |
2025.09 | 0.3427 | - | - | - | |
2025.09 | 0.521 | - | - | - | |
2025.09 | 1.2699 | - | - | - | |
2026.04 | 2.41 | 4.05 | 204.03 | 475.1 | |
2026.04 | 4.34 | 7.03 | 252.2 | 507.35 | |
2026.04 | 5.5 | 8.24 | 273.3 | 551.15 | |
2026.04 | 9.08 | 16.13 | 319.51 | 618.21 | |
2025.09 | - | 1.0911 | - | - | |
2025.09 | - | 0.6668 | - | - | |
2025.09 | - | 0.5855 | - | - | |
2025.09 | - | 0.4226 | - | - | |
2025.09 | - | 0.5485 | - | - | |
2025.09 | - | 0.259 | - | - | |
2025.09 | - | 2.3075 | - | - | |
2025.09 | - | 0.5535 | - | - | |
2025.09 | - | 0.3061 | - | - | |
2025.09 | - | 0.261 | - | - | |
2025.09 | - | 0.2621 | - | - | |
2025.09 | - | 0.2088 | - | - |