Code Generation on EvoEval semantic-altering
48Pass@1 Average
CodeQwen1.5-7B-Chat
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2024.10 | 48 | 39 | 38 | 71 | 31 | 61 | |
2024.10 | 43.6 | 33 | 40 | 60 | 20 | 65 | |
2024.10 | 42.2 | 35 | 36 | 59 | 22 | 59 | |
2024.10 | 41.4 | 40 | 37 | 61 | 18 | 51 | |
2024.10 | 40.6 | 34 | 39 | 57 | 15 | 58 | |
2024.10 | 36.2 | 26 | 30 | 46 | 18 | 61 | |
2024.10 | 35.4 | 31 | 32 | 49 | 9 | 56 | |
2024.10 | 30.6 | 19 | 26 | 43 | 11 | 54 | |
2024.10 | 25.8 | 16 | 19 | 41 | 5 | 48 |