LLM Serving on Evol-CodeAlpaca
234.09p90 Latency (ms/token)
Oracle SJF
Updated 26d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.09 | 234.09 | |
2025.09 | 269.06 | |
2025.09 | 279.26 | |
2025.09 | 290.88 | |
2025.09 | 292.19 | |
2025.09 | 310.87 | |
2025.09 | 327.73 | |
2025.09 | 412.53 | |
2025.09 | 435.29 | |
2025.09 | 446.98 | |
2025.09 | 699.22 | |
2025.09 | 860.7 |