Single line code infilling on MultiPL-E
74.5Python SPM Exact Match
CODE LLAMA
Updated 1mo ago
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
2023.08 | 74.5 | 68.3 | 77.6 | 80 | 80.7 | 85 | |
2023.08 | 72.7 | 67.6 | 74.3 | 77.6 | 80.2 | 82.6 | |
2023.08 | 62 | - | - | 73 | - | 74 | |
2023.08 | 44 | - | - | 62 | - | 60 | |
2023.08 | 31 | - | - | 49 | - | 51 |