Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Tokenizer Compression on C4 fr
Loading...
3.34
Bits per Token (B/T)
Qwen 3
3.3144
3.4872
3.66
3.8328
Feb 19, 2026
Bits per Token (B/T)
Updated 4d ago
Evaluation Results
Method
Method
Links
Bits per Token (B/T)
Qwen 3
Vocabulary Size=152k
2026.02
3.34
Llama 3
Vocabulary Size=128k
2026.02
3.49
DeepSeek R1
Vocabulary Size=128k
2026.02
3.53
GPT-OSS
Vocabulary Size=200k
2026.02
3.97
Trinity
Vocabulary Size=200k
2026.02
3.98
Feedback
Search any
task
Search any
task