Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on WikiText-103 (PPL, Bits, and Efficiency Delta)
Loading...
446.8
Perplexity (PPL)
fp16
323.552
1,155.476
1,987.4
2,819.324
May 26, 2026
Perplexity (PPL)
Bit Rate
PPL Delta vs FP16
Updated 1mo ago
Evaluation Results
Method
Method
Links
Perplexity (PPL)
Bit Rate
PPL Delta vs FP16
fp16
Precision=fp16
2026.05
446.8
16
0
HQMQ
Quantization Setting=s...
2026.05
460.4
5.25
13.6
HQMQ
Quantization Setting=s...
2026.05
469.5
4.04
22.7
HQMQ
Quantization Setting=s...
2026.05
542.2
4.78
95.4
HQMQ
Quantization Setting=s...
2026.05
553.8
3.79
107
HQMQ
Quantization Setting=s...
2026.05
688.1
3.54
241.3
HQMQ
Quantization Setting=s...
2026.05
1,039
3.04
593
Naive
Precision=int4
2026.05
1,666
4
1,219
Naive
Precision=int3
2026.05
3,528
3
3,081
Feedback
Search any
task
Search any
task
