Inference Efficiency on HumanEval
5.15Speedup Factor
FLy
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2025.11 | 5.15 | - | - | 15.83 | |
2025.11 | 5 | - | - | 16.29 | |
2025.11 | 3.97 | - | - | 5.73 | |
2025.11 | 3.74 | - | - | 5.4 | |
2024.11 | 3.35 | 4.95 | 130.28 | - | |
2026.01 | 3.25 | - | - | - | |
2024.11 | 3.24 | 5.13 | 125.77 | - | |
2026.01 | 2.98 | - | - | - | |
2025.11 | 2.86 | - | - | 12.61 | |
2025.11 | 2.84 | - | - | 11.62 | |
2026.01 | 2.8 | - | - | - | |
2026.01 | 2.79 | - | - | - | |
2026.01 | 2.79 | - | - | - | |
2025.11 | 2.75 | - | - | 12.2 | |
2025.11 | 2.75 | - | - | 12.55 | |
2026.01 | 2.6 | - | - | - | |
2025.11 | 2.6 | - | - | 12.74 | |
2025.11 | 2.56 | - | - | 4.24 | |
2025.11 | 2.53 | - | - | 12.67 | |
2025.11 | 2.52 | - | - | 11.96 | |
2026.01 | 2.48 | - | - | - | |
2024.11 | 2.45 | 2.94 | 95.08 | - | |
2025.11 | 2.39 | - | - | 9.78 | |
2025.11 | 2.38 | - | - | 3.95 | |
2026.01 | 2.37 | - | - | - | |
2026.01 | 2.37 | - | - | - | |
2024.11 | 2.29 | 2.64 | 88.91 | - | |
2026.01 | 2.27 | - | - | - | |
2026.01 | 2.22 | - | - | - | |
2026.01 | 2.2 | - | - | - | |
2026.01 | 2.19 | - | - | - | |
2026.01 | 2.19 | - | - | - | |
2026.01 | 2.17 | - | - | - | |
2025.11 | 2.15 | - | - | 3.06 | |
2025.11 | 2.14 | - | - | 2.41 | |
2025.11 | 2.12 | - | - | 3.07 | |
2026.01 | 2.08 | - | - | - | |
2024.11 | 1.94 | 2.78 | 75.44 | - | |
2026.01 | 1.94 | - | - | - | |
2025.11 | 1.89 | - | - | 2.22 | |
2026.01 | 1.84 | - | - | - | |
2025.11 | 1.83 | - | - | 2.07 | |
2025.11 | 1.81 | - | - | 2.13 | |
2024.11 | 1.74 | 1.85 | 34.6 | - | |
2024.11 | 1.68 | 2.62 | 65.49 | - | |
2026.01 | 1.64 | - | - | - | |
2025.11 | 1.64 | - | - | 9.89 | |
2025.11 | 1.56 | - | - | 2.91 | |
2024.11 | 1.54 | 1.76 | 30.81 | - | |
2025.11 | 1.54 | - | - | 2.88 | |
2024.11 | 1.52 | 1.65 | 59.04 | - | |
2025.11 | 1.07 | - | - | 6.29 | |
2026.01 | 1.06 | - | - | - | |
2026.01 | 0.96 | - | - | - |