Programming on HumanEval (test)
79.5ACC1
o1-mini
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.12 | 79.5 | 4.3 | 14.8 | |
2024.12 | 72.6 | 6.8 | 21.9 | |
2023.03 | 67 | - | - | |
2023.03 | 65.8 | - | - | |
2023.11 | 57.31 | - | - | |
2023.11 | 52.43 | - | - | |
2024.12 | 50.9 | 10.6 | 28.3 | |
2023.03 | 48.1 | - | - | |
2023.11 | 47.56 | - | - | |
2023.11 | 45.12 | - | - | |
2023.03 | 26.2 | - | - |