newstest
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Machine Translation | newstest 2010-2016 (test) | BLEU27.57 | 32 | |
| Machine Translation | newstest 18 (head150) | ChrF0.579 | 20 | |
| Machine Translation | newstest Average 2010-2016 | BLEU27.57 | 14 | |
| Machine Translation | newstest 2010 | BLEU24.92 | 14 | |
| Machine Translation | newstest head150 2018 (test) | ChrF87.1 | 12 | |
| Machine Translation | newstest FI-EN 2019 (test) | BLEU33 | 11 | |
| Machine Translation | newstest FI-EN 2018 (val) | BLEU Score26.7 | 11 | |
| Machine Translation | newstest En-De 2015 (test) | BLEU25.44 | 11 | |
| Machine Translation | newstest En-De 2013 (dev) | BLEU23.49 | 10 | |
| Machine Translation | newstest English-German 2015 (test) | BLEU28.7 | 8 | |
| Machine Translation | German-English newstest 2013 (dev) | Perplexity44.1 | 8 | |
| Machine Translation | newstest En-Fi 2015 (test) | BLEU13.48 | 7 | |
| Machine Translation | newstest En-Ru 2015 (test) | BLEU24.3 | 7 | |
| Machine Translation | newstest En-Ru 2014 (test) | BLEU29.37 | 7 | |
| Machine Translation | newstest En-Cs 2015 (test2) | BLEU18.93 | 7 | |
| Machine Translation | newstest En-Cs 2014 (test) | BLEU22.15 | 7 | |
| Simultaneous Machine Translation | NEWSTEST En -> Zh 2021 | BLEURT64.62 | 6 | |
| Machine Translation | newstest En-Ru 2013 (dev) | BLEU21.17 | 6 | |
| Machine Translation | newstest En-Cs 2013 (dev) | BLEU0.1983 | 6 | |
| Machine Translation | newstest English-Russian 2015 (test) | BLEU (single)24.3 | 6 | |
| Machine Translation | newstest French-to-English 2014 (test) | BLEU37.59 | 5 | |
| Machine Translation | newstest French-to-English 2013 (test) | BLEU34.26 | 5 | |
| Machine Translation | newstest English-to-French 2013 (test) | BLEU34.67 | 5 | |
| Machine Translation | newstest German-to-English 2014 (test) | BLEU32.18 | 5 | |
| Machine Translation | newstest German-to-English 2013 (test) | BLEU31.46 | 5 |
Showing 25 of 30 rows