Code Generation on HumanEval-ET
89.6Pass@1
ThinkCoder
Updated 4d ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2024.12 | 89.6 | - | - | - | |
2024.12 | 89.6 | - | - | - | |
2024.12 | 89 | - | - | - | |
2024.12 | 87.8 | - | - | - | |
2023.12 | 86 | 70 | - | - | |
2024.12 | 86 | - | - | - | |
2024.12 | 85.8 | - | - | - | |
2024.12 | 84.8 | - | - | - | |
2024.12 | 84.8 | - | - | - | |
2024.12 | 84.8 | - | - | - | |
2024.12 | 84.8 | - | - | - | |
2024.05 | 82.9 | - | - | - | |
2024.12 | 82.9 | - | - | - | |
2024.12 | 81.7 | - | - | - | |
2024.12 | 81 | - | - | - | |
2024.12 | 81 | - | - | - | |
| 80.5 | - | - | - | ||
| 80.5 | - | - | - | ||
| 80.5 | - | - | - | ||
2024.12 | 79.9 | - | - | - | |
2024.12 | 79.3 | - | - | - | |
2024.12 | 79.3 | - | - | - | |
2024.05 | 78.7 | - | - | - | |
2023.12 | 77.4 | 81.3 | - | - | |
2024.12 | 77.4 | - | - | - | |
2023.12 | 76.2 | 56.1 | - | - | |
2024.12 | 76.2 | - | - | - | |
2024.05 | 73.8 | - | - | - | |
2024.12 | 73.4 | - | - | - | |
2024.12 | 71 | - | - | - | |
2023.12 | 70.7 | 39.7 | - | - | |
2024.05 | 70.1 | - | - | - | |
2024.12 | 70.1 | - | - | - | |
2023.12 | 69.5 | 62.8 | - | - | |
2024.03 | 67.7 | - | - | - | |
2024.03 | 66.9 | - | - | - | |
2024.03 | 65.5 | - | - | - | |
2024.05 | 62.2 | - | - | - | |
2024.05 | 61.6 | - | - | - | |
2023.12 | 57.9 | 106 | - | - | |
2024.05 | 56.1 | - | - | - | |
2023.12 | 56.1 | 31.4 | - | - | |
2024.03 | 55.7 | - | - | - | |
2024.05 | 55.5 | - | - | - | |
2023.12 | 55.5 | 51.6 | - | - | |
2023.12 | 54.9 | 28.6 | - | - | |
2023.12 | 54.8 | 28.3 | - | - | |
2023.12 | 54.3 | 27.2 | - | - | |
2023.12 | 52.4 | 22.7 | - | - | |
2023.12 | 51.7 | - | - | - | |
2024.05 | 50.6 | - | - | - | |
2023.12 | 50.6 | - | - | - | |
2023.12 | 50.6 | 18.5 | - | - | |
2024.05 | 49.4 | - | - | - | |
2023.12 | 49.4 | 15.7 | - | - | |
2024.05 | 48.8 | - | - | - | |
2023.12 | 48.8 | - | - | - | |
2023.12 | 48.8 | 14.3 | - | - | |
2024.05 | 46.2 | - | - | - | |
2023.12 | 45.8 | 7.3 | - | - | |
2023.12 | 42.7 | - | - | - | |
2023.12 | 42.7 | 0 | - | - | |
2024.05 | 37.2 | - | - | - | |
2023.12 | 37.2 | -12.9 | - | - | |
2023.12 | 36.6 | - | - | - | |
2023.12 | 31.7 | - | - | - | |
2023.12 | 28.1 | - | - | - | |
2023.12 | 25.6 | - | - | - | |
2023.12 | 25 | - | - | - | |
2023.12 | 15.2 | - | - | - | |
2024.12 | 12.9 | - | - | - | |
2024.12 | 12.2 | - | - | - | |
2023.12 | 11.6 | - | - | - | |
2024.12 | 11.6 | - | - | - | |
2024.12 | 11.2 | - | - | - | |
2025.06 | - | - | 79.2 | 0 | |
2025.06 | - | - | 89.02 | 47.21 | |
2025.06 | - | - | 81.7 | 12.02 | |
2025.06 | - | - | 81.09 | 9.09 | |
2025.06 | - | - | 84.74 | 26.63 | |
2025.06 | - | - | 50.6 | - | |
2025.06 | - | - | 70.1 | - | |
2025.06 | - | - | 45.8 | - | |
2025.06 | - | - | 70.1 | - | |
2025.06 | - | - | 84.8 | - |