Code Generation on HumanEval (pass@1, Final Gap)
96.95pass@1
Qwen3 Model
Updated 26d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2025.09 | 96.95 | - | - | |
2026.05 | 93.1 | - | - | |
2026.05 | 90.9 | - | - | |
2026.04 | 90.3 | 17.8 | - | |
2025.02 | 90.2 | - | - | |
2025.09 | 89.63 | - | - | |
2026.05 | 89.2 | - | - | |
2026.04 | 89 | 17.8 | - | |
2026.05 | 88.1 | - | - | |
2026.06 | 87.8 | - | - | |
2026.06 | 87.8 | - | - | |
2026.06 | 87.2 | - | - | |
2025.09 | 87.2 | - | - | |
2026.06 | 86.6 | - | - | |
2026.06 | 86.6 | - | - | |
2026.06 | 86 | - | - | |
2026.06 | 85.98 | - | - | |
2026.06 | 85.4 | - | - | |
2026.06 | 85.4 | - | - | |
2026.06 | 85.4 | - | - | |
2026.06 | 85.37 | - | - | |
2026.06 | 85.1 | - | - | |
2026.06 | 84.8 | - | - | |
2026.06 | 84.76 | - | - | |
2026.06 | 84.76 | - | - | |
2026.05 | 84.2 | - | - | |
2026.06 | 84.2 | - | - | |
2026.06 | 84.2 | - | - | |
2026.06 | 84.15 | - | - | |
2025.09 | 83.54 | - | - | |
2026.06 | 82.93 | - | - | |
2025.02 | 82.9 | - | - | |
2026.06 | 82.6 | - | - | |
2026.06 | 82.3 | - | - | |
2026.06 | 82.3 | - | - | |
2026.06 | 81.71 | - | - | |
2025.09 | 81.71 | - | - | |
2026.05 | 81.1 | - | - | |
2025.02 | 79.9 | - | - | |
2026.06 | 79.4 | - | - | |
2026.06 | 79.2 | - | - | |
2026.06 | 78.8 | - | - | |
2026.06 | 78.66 | - | - | |
2026.06 | 78.05 | - | - | |
2026.06 | 78.05 | - | - | |
2026.06 | 77.44 | - | - | |
2026.06 | 77.44 | - | - | |
2026.06 | 76.83 | - | - | |
2026.06 | 76.83 | - | - | |
2026.06 | 76.8 | - | - | |
2026.06 | 76.22 | - | - | |
2025.09 | 75.61 | - | - | |
2025.02 | 75.6 | - | - | |
2026.05 | 75.6 | - | - | |
2025.02 | 75 | - | - | |
2026.05 | 75 | - | - | |
2026.05 | 75 | - | - | |
2026.04 | 74.4 | 17.8 | - | |
2025.02 | 73.8 | - | - | |
2026.05 | 73.8 | - | - | |
2026.05 | 73.2 | - | - | |
2026.06 | 73.17 | - | - | |
2025.05 | 72.644 | - | - | |
2026.06 | 72.56 | - | - | |
2026.06 | 72.56 | - | - | |
2026.06 | 72.56 | - | - | |
2026.04 | 72.5 | 17.8 | - | |
2026.05 | 72.4 | - | - | |
2026.04 | 71.3 | - | 61.5 | |
2026.06 | 70.12 | - | - | |
2026.05 | 68.9 | - | - | |
2026.04 | 67.7 | - | 59.8 | |
2026.02 | 67.07 | - | - | |
2025.09 | 67.07 | - | - | |
2026.06 | 66.7 | - | - | |
2026.02 | 66.46 | - | - | |
2026.06 | 65.9 | - | - | |
2026.06 | 65.24 | - | - | |
2026.06 | 65.24 | - | - | |
2026.06 | 65.2 | - | - | |
2026.06 | 65 | - | - | |
2026.06 | 64.8 | - | - | |
2026.02 | 64.63 | - | - | |
2026.02 | 64.63 | - | - | |
2026.06 | 64.63 | - | - | |
2026.02 | 64.02 | - | - | |
2026.02 | 64.02 | - | - | |
2026.06 | 64.02 | - | - | |
2025.02 | 64 | - | - | |
2026.06 | 64 | - | - | |
2026.02 | 63.42 | - | - | |
2026.06 | 62.8 | - | - | |
2025.02 | 62.2 | - | - | |
2026.04 | 62.2 | - | 53 | |
2026.06 | 62.19 | - | - | |
2026.05 | 61.6 | - | - | |
2026.06 | 61.59 | - | - | |
2026.06 | 61 | - | - | |
2026.06 | 60.98 | - | - | |
2025.05 | 60.256 | - | - |
Showing 100 of 329 rows