Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Headline Generation on AfriHG isiXhosa
Loading...
15.2
chrF
Aya
-0.608
3.496
7.6
11.704
Mar 21, 2026
chrF
BLEU
ROUGE-L
Updated 26d ago
Evaluation Results
Method
Method
Links
chrF
BLEU
ROUGE-L
Aya
Size=13B
2026.03
15.2
-
-
AfriTeVa2 base
Size=0.313B
2026.03
14.9
-
-
mT5-base
Size=0.58B
2026.03
12.7
-
-
MzansiLM (multi-afrihg-ft)
Size=0.125B, Adaptatio...
2026.03
5.67
0.95
16.98
MzansiLM (mono-afrihg-ft)
Size=0.125B, Adaptatio...
2026.03
4.47
0.63
14.28
MzansiLM (general-ft)
Size=0.125B, Adaptatio...
2026.03
4.1
0.36
12.42
MzansiLM (Base 0-shot)
Size=0.125B, Adaptatio...
2026.03
0.03
0
3.29
MzansiLM (Base 1-shot)
Size=0.125B, Adaptatio...
2026.03
0.03
0
4.08
MzansiLM (Base 3-shot)
Size=0.125B, Adaptatio...
2026.03
0
0
0.74
Feedback
Search any
task
Search any
task