CoNaLa
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| NL-to-code generation | CoNaLa (test) | BLEU35.32 | 23 | |
| Conditional Code Generation | Conala | Conditional Perplexity16.4 | 15 | |
| Code Search | CoNaLa (test) | MRR35.1 | 10 | |
| Multilingual code summarization | mCoNaLa translated English | BLEU-4131 | 7 | |
| Code generation | CoNaLa | CodeBS68.1 | 4 |
Showing 5 of 5 rows