Line Completion on RepoEval 1.0 (test)
57.75Exact Match
Oracle
Updated 1mo ago
Evaluation Results
| Method | Links | ||
|---|---|---|---|
2023.03 | 57.75 | 75.43 | |
2023.03 | 57 | 75.3 | |
2023.03 | 56.81 | 75.11 | |
2023.03 | 56.63 | 75.1 | |
2023.03 | 55.31 | 74.38 | |
2023.03 | 48.81 | 71.02 | |
2023.03 | 47.75 | 70.73 | |
2023.03 | 47.44 | 70.19 | |
2023.03 | 47.31 | 69.8 | |
2023.03 | 47.13 | 68.92 | |
2023.03 | 47.06 | 70.1 | |
2023.03 | 46.94 | 68.82 | |
2023.03 | 46.69 | 68.62 | |
2023.03 | 45.81 | 69.21 | |
2023.03 | 45.19 | 67.2 | |
2023.03 | 44.56 | 67.68 | |
2023.03 | 43.94 | 65.97 | |
2023.03 | 43.06 | 65.66 | |
2023.03 | 43.06 | 65.62 | |
2023.03 | 41.88 | 65.05 | |
2023.03 | 40.56 | 65.06 | |
2023.03 | 34.56 | 60.67 | |
2023.03 | 33.63 | 58.99 | |
2023.03 | 29.56 | 55.39 |