Multilingual Code Completion on Multipl-E (Pass@k)
31.14Pass@1
IRCoder
Updated 4d ago
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
2024.03 | 31.14 | 45 | 51.29 | |
2024.03 | 30.47 | 41.38 | 48.04 | |
2024.03 | 24.06 | 39.38 | 47.03 | |
2024.03 | 21.83 | 34.78 | 42.5 | |
2024.03 | 20.51 | 31.14 | 37.9 | |
2024.03 | 18.46 | 30.43 | 38.04 | |
2024.03 | 18.34 | 26.12 | 31.36 | |
2024.03 | 17.94 | 27.38 | 34.12 | |
2024.03 | 14.36 | 22.58 | 28.02 | |
2024.03 | 12.78 | 19.09 | 22.62 | |
2024.03 | 8.76 | 14.51 | 19.32 | |
2024.03 | 8.35 | 13.43 | 16.43 |