Inference Efficiency on HumanEval
5.33Speedup Factor
CATS w/ EAGLE
Updated 21d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2026.05 | 5.33 | - | - | 5.3969 | |
2026.05 | 5.17 | - | - | 5.1741 | |
2025.11 | 5.15 | - | - | 15.83 | |
2026.05 | 5.12 | - | - | 5.1758 | |
2026.05 | 5.03 | - | - | 5.0678 | |
2025.11 | 5 | - | - | 16.29 | |
2026.05 | 4.99 | - | - | 4.9882 | |
2026.05 | 4.95 | - | - | 5.0178 | |
2026.05 | 4.72 | - | - | 4.724 | |
2026.05 | 4.69 | - | - | 4.7135 | |
2026.05 | 4.68 | - | - | 4.695 | |
2026.05 | 4.67 | - | - | 4.7269 | |
2026.05 | 4.66 | - | - | 4.6959 | |
2026.05 | 4.65 | - | - | 4.6993 | |
2026.05 | 4.44 | - | - | 4.4388 | |
2026.05 | 4.19 | - | - | 4.2428 | |
2026.05 | 4.11 | - | - | 4.7703 | |
2026.05 | 4.1 | - | - | 4.1133 | |
2026.05 | 4.09 | - | - | 4.1082 | |
2025.11 | 3.97 | - | - | 5.73 | |
2026.05 | 3.95 | - | - | 4.5866 | |
2026.05 | 3.94 | - | - | 3.9784 | |
2025.11 | 3.74 | - | - | 5.4 | |
2026.05 | 3.7 | - | - | 4.2946 | |
2026.05 | 3.68 | - | - | 4.2687 | |
2026.05 | 3.58 | - | - | 3.6168 | |
2026.05 | 3.5 | - | - | 4.0588 | |
2026.05 | 3.5 | - | - | 4.0587 | |
2026.05 | 3.45 | - | - | 3.4792 | |
2024.11 | 3.35 | 4.95 | 130.28 | - | |
2026.05 | 3.27 | - | - | 3.2753 | |
2026.01 | 3.25 | - | - | - | |
2024.11 | 3.24 | 5.13 | 125.77 | - | |
2026.05 | 3.2 | - | - | 3.2218 | |
2026.05 | 3.2 | - | - | 3.2212 | |
2026.01 | 2.98 | - | - | - | |
2026.05 | 2.91 | - | - | 2.9183 | |
2026.05 | 2.9 | - | - | 2.9163 | |
2025.11 | 2.86 | - | - | 12.61 | |
2025.11 | 2.84 | - | - | 11.62 | |
2026.01 | 2.8 | - | - | - | |
2026.01 | 2.79 | - | - | - | |
2026.01 | 2.79 | - | - | - | |
2025.11 | 2.75 | - | - | 12.2 | |
2025.11 | 2.75 | - | - | 12.55 | |
2026.01 | 2.6 | - | - | - | |
2025.11 | 2.6 | - | - | 12.74 | |
2025.11 | 2.56 | - | - | 4.24 | |
2025.11 | 2.53 | - | - | 12.67 | |
2025.11 | 2.52 | - | - | 11.96 | |
2026.05 | 2.51 | - | - | 2.9535 | |
2026.01 | 2.48 | - | - | - | |
2024.11 | 2.45 | 2.94 | 95.08 | - | |
2025.11 | 2.39 | - | - | 9.78 | |
2026.05 | 2.39 | - | - | 2.8035 | |
2025.11 | 2.38 | - | - | 3.95 | |
2026.01 | 2.37 | - | - | - | |
2026.01 | 2.37 | - | - | - | |
2024.11 | 2.29 | 2.64 | 88.91 | - | |
2026.05 | 2.28 | - | - | 2.2848 | |
2026.01 | 2.27 | - | - | - | |
2026.01 | 2.22 | - | - | - | |
2026.01 | 2.2 | - | - | - | |
2026.01 | 2.19 | - | - | - | |
2026.01 | 2.19 | - | - | - | |
2026.01 | 2.17 | - | - | - | |
2025.11 | 2.15 | - | - | 3.06 | |
2025.11 | 2.14 | - | - | 2.41 | |
2025.11 | 2.12 | - | - | 3.07 | |
2026.01 | 2.08 | - | - | - | |
2026.05 | 1.97 | - | - | 1.9657 | |
2026.05 | 1.95 | - | - | 2.2848 | |
2024.11 | 1.94 | 2.78 | 75.44 | - | |
2026.01 | 1.94 | - | - | - | |
2025.11 | 1.89 | - | - | 2.22 | |
2026.01 | 1.84 | - | - | - | |
2025.11 | 1.83 | - | - | 2.07 | |
2025.11 | 1.81 | - | - | 2.13 | |
2024.11 | 1.74 | 1.85 | 34.6 | - | |
2024.11 | 1.68 | 2.62 | 65.49 | - | |
2026.05 | 1.65 | - | - | 1.9425 | |
2026.01 | 1.64 | - | - | - | |
2025.11 | 1.64 | - | - | 9.89 | |
2025.11 | 1.56 | - | - | 2.91 | |
2024.11 | 1.54 | 1.76 | 30.81 | - | |
2025.11 | 1.54 | - | - | 2.88 | |
2024.11 | 1.52 | 1.65 | 59.04 | - | |
2025.11 | 1.07 | - | - | 6.29 | |
2026.01 | 1.06 | - | - | - | |
2026.01 | 0.96 | - | - | - |