Share your thoughts, 1 month free Claude Pro on usSee more

Tokenization Efficiency on Dogri doi

5.7Bytes per Token

LLaMA-4

Updated 25d ago

Evaluation Results

Method	Links
LLaMA-4 2025.11		5.7
GPT-oss 2025.11		6.04
Sarvam-2B 2025.11		6.16
Sutra 2025.11		6.39
Gemma-3 2025.11		6.75
MUTANT-Indic 2025.11		7.86