Share your thoughts, 1 month free Claude Pro on usSee more

Tokenization Efficiency on Hindi hi

7.37Bytes per Token

LLaMA-4

Updated 25d ago

Evaluation Results

Method	Links
LLaMA-4 2025.11		7.37
GPT-oss 2025.11		7.83
Sutra 2025.11		8.33
Sarvam-2B 2025.11		8.92
Gemma-3 2025.11		9.16
MUTANT-Indic 2025.11		11.01