Code Generation on HumanEval (SR, tau)
6.06Success Rate (SR)
GTO
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.09 | 6.06 | 7.95 | - | |
2025.09 | 5.61 | 7.33 | - | |
2025.09 | 4.77 | 6.52 | - | |
2025.09 | 4.77 | 6.52 | - | |
2025.09 | 4.71 | 5.37 | - | |
2025.09 | 4.68 | 6.51 | - | |
2025.09 | 4.61 | 6.36 | - | |
2025.09 | 4.41 | 6.26 | - | |
2025.09 | 4.21 | 6.2 | - | |
2025.09 | 4.17 | 6.95 | - | |
2025.09 | 4.05 | 5.85 | - | |
2025.09 | 3.98 | 6.58 | - | |
2025.09 | 3.84 | 4.87 | - | |
2025.09 | 3.73 | 5.9 | - | |
2025.09 | 3.68 | 6.41 | - | |
2025.09 | 3.59 | 5.88 | - | |
2025.09 | 3.34 | 5.44 | - | |
2025.09 | 3.31 | 4.7 | - | |
2025.09 | 3.24 | 5.39 | - | |
2025.09 | 3.23 | 4.12 | - | |
2025.09 | 3.19 | 5.23 | - | |
2025.09 | 3.17 | 5.92 | - | |
2025.09 | 3.15 | 5.1 | - | |
2025.09 | 3.07 | 5.73 | - | |
2025.09 | 3.02 | 3.68 | - | |
2025.09 | 2.83 | 4.68 | - | |
2025.09 | 2.78 | 5.37 | - | |
2025.09 | 2.62 | 4.37 | - | |
2025.09 | 2.56 | 4.88 | - | |
2025.09 | 2.49 | 5.03 | - | |
2025.09 | 2.48 | 3.46 | - | |
2025.09 | 2.43 | 3.26 | - | |
2025.09 | 2.37 | 2.74 | - | |
2025.09 | 2.32 | 4.77 | - | |
2025.09 | 2.18 | 2.52 | - | |
2025.09 | 1.97 | 3.08 | - | |
2025.09 | 1.73 | 1.99 | - | |
2025.09 | 1.72 | 1.78 | - | |
2025.09 | 1.71 | 1.79 | - | |
2025.09 | 1.69 | 1.73 | - | |
2025.09 | 1.64 | 1.71 | - | |
2025.09 | 1.58 | 1.67 | - | |
2025.09 | 1.53 | 1.62 | - | |
2026.06 | - | - | 3.778 | |
2026.06 | - | - | 4.096 | |
2026.06 | - | - | 4.347 | |
2026.06 | - | - | 5.196 | |
2026.06 | - | - | 2.803 | |
2026.06 | - | - | 3.126 | |
2026.06 | - | - | 3.521 | |
2026.06 | - | - | 4.336 | |
2026.06 | - | - | 2.738 | |
2026.06 | - | - | 3.002 | |
2026.06 | - | - | 3.126 | |
2026.06 | - | - | 3.507 | |
2026.06 | - | - | 2.48 | |
2026.06 | - | - | 2.779 | |
2026.06 | - | - | 2.969 | |
2026.06 | - | - | 3.384 |