Code Generation on CoderEval-Python class-runnable
35.45Pass@1
RepoCoder
Updated 1mo ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.03 | 35.45 | 40.46 | 41.82 | |
2024.03 | 28 | 44.92 | 49.09 | |
2024.03 | 26.36 | 39.42 | 41.82 | |
2024.03 | 21.3 | 36.73 | 39.13 | |
2024.03 | 20.36 | 33.27 | 38.18 | |
2024.03 | 20.36 | 33.27 | 38.18 | |
2024.03 | 18.91 | 30.65 | 34.55 | |
2024.03 | 17.82 | 35.22 | 40 | |
2024.03 | 16.96 | 19.57 | 21.74 | |
2024.03 | 16.09 | 21.36 | 21.74 | |
2024.03 | 13.04 | 28.04 | 34.78 | |
2024.03 | 11.3 | 19.53 | 21.74 | |
2024.03 | 11.3 | 19.53 | 21.74 | |
2024.03 | 9.57 | 12.08 | 13.04 | |
2024.03 | 8.73 | 12.57 | 14.55 | |
2024.03 | 5.22 | 8.7 | 13.04 |