Share your thoughts, 1 month free Claude Pro on usSee more

Tokenization Efficiency on Punjabi (pa)

4.05Bytes per Token

LLaMA-4

Updated 25d ago

Evaluation Results

Method	Links
LLaMA-4 2025.11		4.05
Gemma-3 2025.11		4.62
GPT-oss 2025.11		4.83
Sarvam-2B 2025.11		7.95
Sutra 2025.11		8.76
MUTANT-Indic 2025.11		9.4