Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Glot500

Benchmarks

Task NameDataset NameSOTA ResultTrend
Roundtrip AlignmentGlot500 Alignment (all)
Alignment Score4.7
3
Roundtrip AlignmentGlot500 Alignment (head)
Score5.5
3
Roundtrip AlignmentGlot500 Alignment (tail)
Score4.5
3
POSGlot500 POS (all)
Accuracy71.8
3
POSGlot500 POS (head)
Accuracy78.4
3
POSGlot500 POS (tail)
Score62.3
3
NERGlot500 NER (all)
Score62.4
3
NERGlot500 NER (head)
Score66
3
NERGlot500 NER (tail)
Overall Score60.7
3
Text ClassificationGlot500 (all)
Score48.7
3
Text ClassificationGlot500 (head)
Score60.5
3
Text ClassificationGlot500 (tail)
Classification Score46.6
3
PseudoperplexityGlot500 (all)
Pseudoperplexity11.6
3
PseudoperplexityGlot500 (head)
Pseudoperplexity8.4
3
PseudoperplexityGlot500 tail
Pseudoperplexity12.2
3
Showing 15 of 15 rows