mCoNaLa
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Multilingual code summarization | mCoNaLa Japanese translated English | BLEU-41.46 | 7 | |
| Text-to-code generation | mCoNaLa Average | BLEU-45.71 | 7 | |
| Text-to-code generation | mCoNaLa Russian | BLEU-46.55 | 7 | |
| Text-to-code generation | mCoNaLa Japanese | BLEU-48.08 | 7 | |
| Text-to-code generation | mCoNaLa Spanish | BLEU-42.51 | 7 | |
| Multilingual code summarization | mCoNaLa Russian (test) | BLEU-41.98 | 7 | |
| Multilingual code summarization | mCoNaLa Spanish (test) | BLEU-42.51 | 7 | |
| Japanese-to-Python Code Generation | MCoNaLa (test) | ChrF++37.3 | 4 | |
| Multilingual code summarization | mCoNaLa Average (test) | BLEU-4- | 0 | |
| Multilingual code summarization | mCoNaLa Japanese (test) | BLEU-4- | 0 |
Showing 10 of 10 rows