Code Generation on HumanEval (Acc, TPF, AUP)
97.56Accuracy
Agent Q-Mix
Updated 5d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.04 | 97.56 | - | - | |
2026.04 | 97.56 | - | - | |
2026.04 | 96.95 | - | - | |
2026.04 | 96.34 | - | - | |
2026.04 | 95.73 | - | - | |
2026.04 | 95.73 | - | - | |
2026.04 | 95.73 | - | - | |
2026.04 | 95.12 | - | - | |
2026.04 | 95.12 | - | - | |
2026.04 | 94.51 | - | - | |
2026.04 | 93.9 | - | - | |
2026.04 | 93.9 | - | - | |
2026.04 | 93.9 | - | - | |
2026.04 | 93.7 | - | - | |
2026.04 | 92.68 | - | - | |
2026.04 | 92.68 | - | - | |
2026.04 | 92.68 | - | - | |
2026.04 | 92.08 | - | - | |
2026.04 | 92.07 | - | - | |
2026.04 | 92.07 | - | - | |
2026.04 | 91.46 | - | - | |
2026.04 | 91.46 | - | - | |
2026.04 | 90.24 | - | - | |
2026.04 | 90.04 | - | - | |
2026.04 | 89.63 | - | - | |
2026.04 | 88.41 | - | - | |
2026.03 | 84.6 | - | - | |
2026.03 | 84.5 | - | - | |
2026.03 | 84 | - | - | |
2026.03 | 77.8 | - | - | |
2026.03 | 76.3 | - | - | |
2026.03 | 73.5 | 2.39 | 123.8 | |
2026.03 | 72.6 | 6.3 | 450.1 | |
2026.03 | 69.7 | - | - | |
2026.03 | 67.7 | 1 | 67.7 | |
2026.03 | 67.6 | 5.98 | 344.8 | |
2026.03 | 66.1 | - | - | |
2026.03 | 61.7 | 2.58 | 128.9 | |
2026.03 | 61.6 | - | - | |
2026.03 | 58.54 | - | - | |
2026.03 | 57.93 | - | - | |
2026.03 | 57.1 | 3.2 | 129.5 | |
2026.03 | 55.5 | - | - | |
2026.03 | 55.49 | - | - | |
2026.03 | 55.2 | 1 | 55.2 | |
2026.03 | 54.88 | - | - | |
2026.03 | 54.3 | 1.33 | 63.5 | |
2026.03 | 54.3 | 2.57 | 98.8 | |
2026.03 | 54.27 | - | - | |
2026.03 | 54.27 | - | - | |
2025.07 | 53.05 | - | - | |
2025.07 | 53.05 | - | - | |
2026.03 | 52.5 | - | - | |
2025.07 | 51.22 | - | - | |
2026.03 | 51.22 | - | - | |
2025.07 | 50 | - | - | |
2025.07 | 50 | - | - | |
2025.07 | 48.78 | - | - | |
2025.07 | 46.34 | - | - | |
2026.03 | 43.29 | - | - | |
2026.03 | 42.68 | - | - | |
2026.03 | 42.07 | - | - | |
2026.03 | 41.46 | - | - | |
2026.03 | 40.85 | - | - | |
2026.03 | 40.85 | - | - | |
2026.03 | 40.24 | - | - | |
2026.03 | 39.63 | - | - | |
2026.03 | 39.63 | - | - | |
2026.03 | 39.6 | 5.95 | 96.6 | |
2026.03 | 39 | 4.93 | 83.7 | |
2026.03 | 38.42 | - | - | |
2026.03 | 38.3 | 1 | 38.3 | |
2026.03 | 37.8 | 2.56 | 54 | |
2026.03 | 37.2 | - | - | |
2025.07 | 37.19 | - | - | |
2026.03 | 37.19 | - | - | |
2026.03 | 37.19 | - | - | |
2026.03 | 37.19 | - | - | |
2026.03 | 36.6 | 2.69 | 62 | |
2025.07 | 36.58 | - | - | |
2025.07 | 35.97 | - | - | |
2025.07 | 35.36 | - | - | |
2025.07 | 33.54 | - | - | |
2025.07 | 30.49 | - | - | |
2026.03 | 22.56 | - | - | |
2025.06 | 21.96 | - | - | |
2026.03 | 21.95 | - | - | |
2025.06 | 20.7 | - | - | |
2025.06 | 18.75 | - | - | |
2025.06 | 18.6 | - | - | |
2025.06 | 18 | - | - | |
2025.06 | 17.85 | - | - | |
2025.07 | 17.68 | - | - | |
2025.06 | 17.25 | - | - | |
2025.06 | 16 | - | - | |
2025.07 | 14.02 | - | - | |
2025.07 | 8.54 | - | - | |
2025.07 | 7.32 | - | - | |
2025.07 | 6.1 | - | - |