LLM Serving on Evol-CodeAlpaca (Average Latency)
154.52Average Latency (ms/token)
Oracle SJF
Updated 26d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.09 | 154.52 | |
2025.09 | 155.97 | |
2025.09 | 171.62 | |
2025.09 | 171.69 | |
2025.09 | 182.05 | |
2025.09 | 182.4 | |
2025.09 | 184.75 | |
2025.09 | 200.65 | |
2025.09 | 201.04 | |
2025.09 | 203.79 | |
2025.09 | 384.18 | |
2025.09 | 384.28 |