Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

Indic-English

Benchmarks

Task NameDataset NameSOTA ResultTrend
Tokenization EfficiencyIndic-English as (evaluation)
NSL Score100
25
Tokenization EfficiencyIndic-English urd (evaluation)
NSL Score4.25
5
Tokenization EfficiencyIndic-English evaluation corpus te
NSL Score71
5
Tokenization EfficiencyIndic-English snd (evaluation)
NSL Score3.63
5
Tokenization EfficiencyIndic-English evaluation corpus mni
NSL Score2.19
5
Tokenization EfficiencyIndic-English evaluation corpus eng
NSL Score1.27
5
Showing 6 of 6 rows