Share your thoughts, 1 month free Claude Pro on usSee more

Tokenization Efficiency on Sanskrit san

5.45Bytes per Token

LLaMA-4

Updated 25d ago

Evaluation Results

Method	Links
LLaMA-4 2025.11		5.45
GPT-oss 2025.11		5.79
Sarvam-2B 2025.11		6.03
Sutra 2025.11		6.04
Gemma-3 2025.11		6.66
MUTANT-Indic 2025.11		8.7