Fill-in-the-Middle Code Completion on FIM-Tasks Single-Line Infilling (test)
68.3Python Score
CodeLlama-Base
Updated 1mo ago
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
2024.01 | 68.3 | 77.6 | 80.7 | 75.5 | |
2024.01 | 67.6 | 74.3 | 80.2 | 74 | |
2024.01 | 66.6 | 88.1 | 79.7 | 78.1 | |
2024.01 | 65.4 | 86.6 | 82.5 | 78.2 | |
2024.01 | 62 | 73 | 74 | 69.7 | |
2024.01 | 57.4 | 82.2 | 71.7 | 70.4 | |
2024.01 | 44 | 62 | 74 | 60 |