Code Generation on HumanEval (Acc, TPF, AUP)
97.56Accuracy
Agent Q-Mix
Updated 13d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2026.04 | 97.56 | - | - | |
2026.04 | 97.56 | - | - | |
2026.04 | 96.95 | - | - | |
2026.04 | 96.34 | - | - | |
2026.04 | 95.73 | - | - | |
2026.04 | 95.73 | - | - | |
2026.04 | 95.73 | - | - | |
2026.04 | 95.12 | - | - | |
2026.04 | 95.12 | - | - | |
2025.07 | 95.12 | - | - | |
2026.04 | 94.7 | - | - | |
2026.04 | 94.65 | - | - | |
2026.04 | 94.51 | - | - | |
2025.07 | 94.51 | - | - | |
2026.04 | 93.9 | - | - | |
2026.04 | 93.9 | - | - | |
2026.04 | 93.9 | - | - | |
2026.04 | 93.74 | - | - | |
2026.04 | 93.7 | - | - | |
2026.04 | 92.68 | - | - | |
2026.04 | 92.68 | - | - | |
2026.04 | 92.68 | - | - | |
2025.07 | 92.68 | - | - | |
2026.04 | 92.08 | - | - | |
2026.04 | 92.07 | - | - | |
2026.04 | 92.07 | - | - | |
2025.07 | 92.07 | - | - | |
2026.04 | 91.6 | - | - | |
2026.04 | 91.6 | - | - | |
2026.04 | 91.46 | - | - | |
2026.04 | 91.46 | - | - | |
2026.04 | 90.24 | - | - | |
2026.04 | 90.04 | - | - | |
2026.04 | 89.63 | - | - | |
2026.04 | 89.3 | - | - | |
| 89 | - | - | ||
2026.04 | 88.6 | - | - | |
2026.04 | 88.41 | - | - | |
| 88.1 | - | - | ||
| 88.1 | - | - | ||
| 87.9 | - | - | ||
2026.04 | 87.8 | - | - | |
| 87.8 | - | - | ||
| 87.1 | - | - | ||
2026.04 | 87 | - | - | |
2026.04 | 86.6 | - | - | |
2026.04 | 85.5 | - | - | |
2026.04 | 85.4 | - | - | |
2026.04 | 85.3 | - | - | |
2026.04 | 84.8 | - | - | |
2026.03 | 84.6 | - | - | |
2026.03 | 84.5 | - | - | |
2026.03 | 84 | - | - | |
2026.04 | 83.7 | - | - | |
2026.04 | 82.4 | - | - | |
2026.04 | 80.4 | - | - | |
2026.04 | 77.93 | - | - | |
2026.03 | 77.8 | - | - | |
2026.04 | 77.44 | - | - | |
2026.03 | 76.3 | - | - | |
2026.03 | 73.5 | 2.39 | 123.8 | |
2026.03 | 72.6 | 6.3 | 450.1 | |
2026.04 | 72.6 | - | - | |
2026.03 | 69.7 | - | - | |
2026.04 | 67.93 | - | - | |
2026.03 | 67.7 | 1 | 67.7 | |
2026.04 | 67.7 | - | - | |
2026.03 | 67.6 | 5.98 | 344.8 | |
2026.03 | 66.1 | - | - | |
2026.05 | 64.63 | - | - | |
2026.04 | 64.6 | - | - | |
2026.04 | 64 | - | - | |
2026.04 | 63.4 | - | - | |
2026.03 | 61.7 | 2.58 | 128.9 | |
2026.03 | 61.6 | - | - | |
2026.05 | 61.15 | - | - | |
2026.03 | 58.54 | - | - | |
2026.03 | 57.93 | - | - | |
2026.04 | 57.9 | - | - | |
2026.03 | 57.1 | 3.2 | 129.5 | |
2026.03 | 55.5 | - | - | |
2026.03 | 55.49 | - | - | |
2026.03 | 55.2 | 1 | 55.2 | |
2026.03 | 54.88 | - | - | |
2026.03 | 54.3 | 1.33 | 63.5 | |
2026.03 | 54.3 | 2.57 | 98.8 | |
| 54.3 | - | - | ||
2026.03 | 54.27 | - | - | |
2026.03 | 54.27 | - | - | |
2026.05 | 53.37 | - | - | |
2025.07 | 53.05 | - | - | |
2025.07 | 53.05 | - | - | |
2026.04 | 52.8 | - | - | |
2026.03 | 52.5 | - | - | |
2026.05 | 52.03 | - | - | |
2026.05 | 51.42 | - | - | |
2025.07 | 51.22 | - | - | |
2026.03 | 51.22 | - | - | |
2026.05 | 50.41 | - | - | |
2025.07 | 50 | - | - |
Showing 100 of 217 rows