Code Generation on HumanEval and MBPP (Aggregated)
85.6Overall Average Score
GPT-4-1106-preview
Updated 1mo ago
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
2024.05 | 85.6 | - | - | - | - | - | 77.5 | |
2024.05 | 79.7 | - | - | - | - | - | 70.2 | |
2025.12 | 78.9 | 77.4 | - | 80.4 | - | - | - | |
2025.12 | 78.9 | 82.9 | - | 74.9 | - | - | - | |
2025.12 | 78.8 | 75.6 | - | 82 | - | - | - | |
2025.12 | 77.9 | 79.9 | - | 75.9 | - | - | - | |
2025.12 | 74.8 | 73.8 | - | 75.7 | - | - | - | |
2025.12 | 73.6 | 71.3 | - | 75.9 | - | - | - | |
2024.05 | 66.1 | - | - | - | - | - | 58.2 | |
2024.05 | 65.8 | - | - | - | - | - | 58 | |
2024.05 | 63.3 | - | - | - | - | - | 55.3 | |
2024.05 | 61.9 | - | - | - | - | - | 53.3 | |
2025.03 | 60.9 | 65.9 | 62.2 | 63.4 | 51.9 | - | - | |
2025.03 | 60.3 | 64.6 | 60.4 | 63.7 | 52.4 | - | - | |
2025.03 | 60.2 | 64.6 | 61 | 63.9 | 51.4 | - | - | |
2024.07 | 58.7 | 59.5 | 53.8 | 65.4 | 56.1 | - | - | |
2024.07 | 58.4 | 59.1 | 52.9 | 65.7 | 55.8 | - | - | |
2024.07 | 57.6 | 57.9 | 52.4 | 64.8 | 55.3 | - | - | |
2024.07 | 56.2 | 56.3 | 50.8 | 64 | 53.6 | - | - | |
2024.05 | 52.3 | - | - | - | - | - | 44.7 | |
2024.05 | 51.2 | - | - | - | - | - | 43 | |
2024.07 | 44 | 33.5 | 29.3 | 61.4 | 51.6 | - | - | |
2024.05 | 43.4 | - | - | - | - | - | 36.5 | |
2024.05 | 38.7 | - | - | - | - | - | 32.6 | |
2024.07 | 32.8 | 33.8 | 29 | 36.5 | 31.9 | - | - | |
2024.07 | 32.7 | 33.2 | 28.8 | 36.8 | 31.8 | - | - | |
2024.07 | 31.4 | 31.7 | 28 | 35.4 | 30.4 | - | - | |
2024.05 | 31.4 | - | - | - | - | - | 26.5 | |
2024.07 | 29.5 | 28.9 | 24.6 | 35.1 | 29.6 | - | - | |
2026.03 | 21.34 | 17.07 | - | 25.6 | - | - | - | |
2026.03 | 20.33 | 15.85 | - | 24.8 | - | - | - | |
2026.03 | 20.23 | 16.46 | - | 24 | - | - | - | |
2026.03 | 19.62 | 15.24 | - | 24 | - | - | - | |
2026.03 | 19.32 | 15.24 | - | 23.4 | - | - | - | |
2024.07 | 18.8 | 11 | 9.8 | 30.2 | 24.1 | - | - | |
2026.03 | 18.21 | 13.41 | - | 23 | - | - | - | |
2026.03 | 17.8 | 12.19 | - | 23.4 | - | - | - | |
2025.02 | - | 7.9 | - | 16.5 | - | - | - | |
2025.02 | - | 15.9 | - | 28.8 | - | - | - | |
2025.02 | - | 10.4 | - | 21.3 | - | - | - | |
2025.02 | - | 9.1 | - | 24.1 | - | - | - | |
| - | 20.1 | - | 42.6 | - | - | - | ||
2025.02 | - | 21.3 | - | 40.4 | - | - | - | |
2025.02 | - | 20.6 | - | 41.3 | - | - | - | |
2025.02 | - | 20.1 | - | 39.1 | - | - | - | |
2025.02 | - | 20.7 | - | 39.3 | - | - | - |