Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Konkani

Benchmarks

Task NameDataset NameSOTA ResultTrend
TokenizationKonkani gom
NSL Score1.72
10
Machine TranslationKonkani (Gom)
BLEU7.77
8
Creative writingKonkani Kannada script
LLM Judge Score3.6
6
Creative writingKonkani Devanagari script
LLM Judge Score3.7
6
Creative writingKonkani Romi script
LLM Judge Score4.2
6
Simple chatKonkani Kannada script
LLM-as-a-judge Score4.5
6
Simple chatKonkani Devanagari script
LLM-as-a-Judge Score (1-5)4.6
6
Simple chatKonkani Romi script
LLM-as-a-judge Score4.6
6
Tokenization EfficiencyKonkani gom
Bytes per Token4.55
6
Showing 9 of 9 rows