Code Correctness Evaluation on DB
68.6F1 Score
CoCoA
Updated 16d ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2024.10 | 68.6 | 58.5 | |
2024.10 | 67.6 | 52.8 | |
2024.10 | 63 | 56.3 | |
2024.10 | 62.2 | 50 | |
2024.10 | 60.4 | 58.2 | |
2024.10 | 59.6 | 58.4 | |
2024.10 | 57.2 | 55.4 | |
2024.10 | 53 | 59.1 | |
2024.10 | 45.6 | 59.4 | |
2024.10 | 45.5 | 62.2 | |
2024.10 | 44 | 62 | |
2024.10 | 40.1 | 59.1 | |
2024.10 | 38.8 | 60.3 | |
2024.10 | 33.8 | 56.7 | |
2024.10 | 31.8 | 53.9 | |
2024.10 | 29.4 | 55.7 | |
2024.10 | 28.1 | 55 | |
2024.10 | 27.7 | 52.5 | |
2024.10 | 27.5 | 55 | |
2024.10 | 25.8 | 55 | |
2024.10 | 20.2 | 52.7 | |
2024.10 | 15.9 | 54.3 | |
2024.10 | 13.2 | 52.4 | |
2024.10 | 13 | 53.2 |