Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on WikiText-103 (PPL, Bits, and Delta)
Loading...
5.29
Perplexity (PPL)
fp16
-12.9144
109.9653
232.845
355.7247
May 26, 2026
Perplexity (PPL)
Bits per Character
Performance Delta (∆)
Updated 1mo ago
Evaluation Results
Method
Method
Links
Perplexity (PPL)
Bits per Character
Performance Delta (∆)
fp16
Model=Mistral-7B, Arch...
2026.05
5.29
-
-
Best HQMQ
Model=Mistral-7B, Arch...
2026.05
5.32
5.07
0.5
fp16
Model=Llama-3-8B, Arch...
2026.05
6.28
-
-
Best HQMQ
Model=Llama-3-8B, Arch...
2026.05
6.32
5
0.6
fp16
Model=Qwen2.5-7B, Arch...
2026.05
7.59
-
-
Best HQMQ
Model=Qwen2.5-7B, Arch...
2026.05
8.83
5.15
16
fp16
Model=Qwen3-8B, Arch=o...
2026.05
9.6
-
-
Best HQMQ
Model=Qwen3-8B, Arch=o...
2026.05
9.62
4.99
0.2
fp16
Model=gpt-oss-20b†, Ar...
2026.05
446.8
-
-
Best HQMQ
Model=gpt-oss-20b†, Ar...
2026.05
460.4
5.25
3
Feedback
Search any
task
Search any
task
