Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Tokenization Efficiency on Dogri doi
Loading...
5.7
Bytes per Token
LLaMA-4
5.6136
6.1968
6.78
7.3632
Nov 5, 2025
Bytes per Token
Updated 25d ago
Evaluation Results
Method
Method
Links
Bytes per Token
LLaMA-4
2025.11
5.7
GPT-oss
2025.11
6.04
Sarvam-2B
2025.11
6.16
Sutra
2025.11
6.39
Gemma-3
2025.11
6.75
MUTANT-Indic
2025.11
7.86
Feedback
Search any
task
Search any
task