Code Correctness Evaluation on HE-PY
72.6F1 Score
CoCoA
Updated 16d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.10 | 72.6 | 71.5 | |
2024.10 | 67.2 | 58.4 | |
2024.10 | 59.5 | 58.2 | |
2024.10 | 57.8 | 58.7 | |
2024.10 | 55.2 | 60 | |
2024.10 | 48.4 | 60.5 | |
2024.10 | 47.8 | 58.7 | |
2024.10 | 47.4 | 58.9 | |
2024.10 | 47.3 | 58.7 | |
2024.10 | 46.4 | 61.2 | |
2024.10 | 44.6 | 58.4 | |
2024.10 | 43.9 | 58.4 | |
2024.10 | 43.5 | 61 | |
2024.10 | 43.2 | 61.5 | |
2024.10 | 42.9 | 57.4 | |
2024.10 | 42.2 | 58.9 | |
2024.10 | 40.3 | 60.8 | |
2024.10 | 37.4 | 60 | |
2024.10 | 35.2 | 57.3 | |
2024.10 | 33.9 | 56.6 | |
2024.10 | 27.1 | 56.6 | |
2024.10 | 24.1 | 54.2 | |
2024.10 | 23.3 | 55.3 | |
2024.10 | 12.7 | 51.3 | |
2024.10 | 6 | 66.5 |