Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on WikiText-103 20w x 2048
Loading...
9.603
Perplexity (PPL)
fp16
-51.18888
359.15631
769.5015
1,179.84669
May 26, 2026
Perplexity (PPL)
PPL Difference vs fp16
Updated 1mo ago
Evaluation Results
Method
Method
Links
Perplexity (PPL)
PPL Difference vs fp16
fp16
bits=16.00
2026.05
9.603
0
HQMQ
bits=4.99, config=s96...
2026.05
9.621
0.019
HQMQ
bits=4.51, config=s24...
2026.05
9.701
0.098
HQMQ
bits=3.79, config=s96 r4
2026.05
10.698
1.095
HQMQ
bits=3.54, config=s48 r4
2026.05
11.427
1.824
HQMQ
bits=3.04, config=s24 r3
2026.05
44.564
34.96
naive int4 + Med3×
bits=4.62
2026.05
118.977
109.4
naive int4
bits=4.00
2026.05
121.715
112.1
naive int3
bits=3.00
2026.05
588.222
578.6
naive int2
bits=2.00
2026.05
1,529.4
1,520
Feedback
Search any
task
Search any
task