LLM Serving on MATH-plus (Average latency)
107.1Average Latency (ms/token)
Oracle SJF
Updated 26d ago
Evaluation Results
| Method | Links | |
|---|---|---|
2025.09 | 107.1 | |
2025.09 | 115.65 | |
2025.09 | 123.69 | |
2025.09 | 132.91 | |
2025.09 | 134.11 | |
2025.09 | 140.78 | |
2025.09 | 154.25 | |
2025.09 | 164.8 | |
2025.09 | 165.87 | |
2025.09 | 167.76 | |
2025.09 | 289.41 | |
2025.09 | 298.35 |