Code Correctness Evaluation on HE-JA
72.9F1 Score
CoCoA
Updated 16d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.10 | 72.9 | 70.8 | |
2024.10 | 65.2 | 56.6 | |
2024.10 | 59.9 | 58.6 | |
2024.10 | 59.1 | 59.4 | |
2024.10 | 55.9 | 58.6 | |
2024.10 | 52.9 | 60.2 | |
2024.10 | 49.3 | 60.6 | |
2024.10 | 45.8 | 57.6 | |
2024.10 | 44.6 | 58.2 | |
2024.10 | 43.2 | 57.7 | |
2024.10 | 39.9 | 56.8 | |
2024.10 | 37.5 | 55.7 | |
2024.10 | 37.4 | 56.2 | |
2024.10 | 36.8 | 56 | |
2024.10 | 36.6 | 59.4 | |
2024.10 | 35.1 | 59 | |
2024.10 | 35 | 58.8 | |
2024.10 | 34.5 | 58.3 | |
2024.10 | 31.9 | 55.1 | |
2024.10 | 30 | 57.6 | |
2024.10 | 29.6 | 53.7 | |
2024.10 | 24.6 | 55.6 | |
2024.10 | 21.6 | 51.7 | |
2024.10 | 16.6 | 52 | |
2024.10 | 8.4 | 49.2 |