Code Generation on HumanEval (SR, tau)
6.06Success Rate (SR)
GTO
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2025.09 | 6.06 | 7.95 | |
2025.09 | 5.61 | 7.33 | |
2025.09 | 4.77 | 6.52 | |
2025.09 | 4.77 | 6.52 | |
2025.09 | 4.71 | 5.37 | |
2025.09 | 4.68 | 6.51 | |
2025.09 | 4.61 | 6.36 | |
2025.09 | 4.41 | 6.26 | |
2025.09 | 4.21 | 6.2 | |
2025.09 | 4.17 | 6.95 | |
2025.09 | 4.05 | 5.85 | |
2025.09 | 3.98 | 6.58 | |
2025.09 | 3.84 | 4.87 | |
2025.09 | 3.73 | 5.9 | |
2025.09 | 3.68 | 6.41 | |
2025.09 | 3.59 | 5.88 | |
2025.09 | 3.34 | 5.44 | |
2025.09 | 3.31 | 4.7 | |
2025.09 | 3.24 | 5.39 | |
2025.09 | 3.23 | 4.12 | |
2025.09 | 3.19 | 5.23 | |
2025.09 | 3.17 | 5.92 | |
2025.09 | 3.15 | 5.1 | |
2025.09 | 3.07 | 5.73 | |
2025.09 | 3.02 | 3.68 | |
2025.09 | 2.83 | 4.68 | |
2025.09 | 2.78 | 5.37 | |
2025.09 | 2.62 | 4.37 | |
2025.09 | 2.56 | 4.88 | |
2025.09 | 2.49 | 5.03 | |
2025.09 | 2.48 | 3.46 | |
2025.09 | 2.43 | 3.26 | |
2025.09 | 2.37 | 2.74 | |
2025.09 | 2.32 | 4.77 | |
2025.09 | 2.18 | 2.52 | |
2025.09 | 1.97 | 3.08 | |
2025.09 | 1.73 | 1.99 | |
2025.09 | 1.72 | 1.78 | |
2025.09 | 1.71 | 1.79 | |
2025.09 | 1.69 | 1.73 | |
2025.09 | 1.64 | 1.71 | |
2025.09 | 1.58 | 1.67 | |
2025.09 | 1.53 | 1.62 |