Tokenizer Compression on C4 fr
3.34Bits per Token (B/T)
Qwen 3
Updated 1mo ago
Evaluation Results
| Method | Links | |
|---|---|---|
2026.02 | 3.34 | |
2026.02 | 3.49 | |
2026.02 | 3.53 | |
2026.02 | 3.97 | |
2026.02 | 3.98 |
Qwen 3
| Method | Links | |
|---|---|---|
2026.02 | 3.34 | |
2026.02 | 3.49 | |
2026.02 | 3.53 | |
2026.02 | 3.97 | |
2026.02 | 3.98 |