SIGMORPHON
Benchmarks
| Task Name | Dataset Name | SOTA Result | Trend | |
|---|---|---|---|---|
| Inflection | SIGMORPHON 2020 (test) | Accuracy90.9 | 10 | |
| Grapheme-to-Phoneme | SIGMORPHON 2020 (test) | WER13.8 | 10 | |
| Machine Translation | SIGMORPHON 2023 (test) | BLEU (Git)0.187 | 8 | |
| Morphological Segmentation | SIGMORPHON nyb 2023 (test) | Morpheme Error Rate2 | 3 | |
| Morphological Segmentation | SIGMORPHON ntu 2023 (test) | Morpheme Error Rate9 | 3 | |
| Morphological Segmentation | SIGMORPHON lez 2023 (test) | Morpheme Error Rate11 | 3 | |
| Morphological Segmentation | SIGMORPHON git 2023 (test) | Morpheme Error Rate0.57 | 3 | |
| Morphological Segmentation | SIGMORPHON ddo 2023 (test) | Morpheme Error Rate2 | 3 | |
| Morphological Segmentation | SIGMORPHON usp 2023 (test) | Morpheme Error Rate15 | 3 | |
| Morphological Segmentation | SIGMORPHON arp 2023 (test) | Morpheme Error Rate7 | 3 | |
| Segmentation | SIGMORPHON Standard 2023 (test) | F1 (arp)94.3 | 3 | |
| Glossing | SIGMORPHON Standard 2023 | ARP Glossing Score11.9 | 2 | |
| Glossing | SIGMORPHON 2023 (Polygloss) | ARP Error0.152 | 1 |
Showing 13 of 13 rows