Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Cheetah: Natural Language Generation for 517 African Languages

About

Low-resource African languages pose unique challenges for natural language processing (NLP) tasks, including natural language generation (NLG). In this paper, we develop Cheetah, a massively multilingual NLG language model for African languages. Cheetah supports 517 African languages and language varieties, allowing us to address the scarcity of NLG resources and provide a solution to foster linguistic diversity. We demonstrate the effectiveness of Cheetah through comprehensive evaluations across six generation downstream tasks. In five of the six tasks, Cheetah significantly outperforms other models, showcasing its remarkable performance for generating coherent and contextually appropriate text in a wide range of African languages. We additionally conduct a detailed human evaluation to delve deeper into the linguistic capabilities of Cheetah. The introduction of Cheetah has far-reaching benefits for linguistic diversity. By leveraging pretrained models and adapting them to specific languages, our approach facilitates the development of practical NLG applications for African communities. The findings of this study contribute to advancing NLP research in low-resource settings, enabling greater accessibility and inclusion for African languages in a rapidly expanding digital landscape. We publicly release our models for research.

Ife Adebara, AbdelRahim Elmadany, Muhammad Abdul-Mageed• 2024

Related benchmarks

TaskDatasetResultRank
Machine TranslationEnglish-Luganda MT Data
CHRF49.38
10
Machine TranslationEnglish-Nigerian-Pidgin MT Data
CHRF62.95
10
Multilingual Language CoverageAfrican Languages
Language Families Count14
8
Cloze-taskAfroNLG (test)
Mask-one Score13.98
5
Machine TranslationMT Data English-Afrikaans
CHRF39.88
5
Machine TranslationMT Data English-Swahili
CHRF37.24
5
Machine TranslationEnglish-Zulu MT Data
CHRF43.75
5
Machine TranslationEnglish-Hausa
CHRF34.9
5
Machine TranslationEnglish-Igbo MT Data
CHRF44.37
5
Machine TranslationEnglish-Setswana MT Data
CHRF35.87
5
Showing 10 of 42 rows

Other info

Code

Follow for update