Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Language Modeling on WikiText-103 50w x 2048 (test)
Loading...
7.59
Perplexity
fp16
-1,008.5464
5,850.3743
12,709.295
19,568.2157
May 26, 2026
Perplexity
Updated 1mo ago
Evaluation Results
Method
Method
Links
Perplexity
fp16
bits=16.00
2026.05
7.59
HQMQ s192 r6 + Med3x
bits=5.15
2026.05
8.83
HQMQ s96 r6 + Med3x
bits=4.91
2026.05
9.03
HQMQ s24 r6 + Med3x
bits=4.42
2026.05
9.69
HQMQ s96 r6
bits=4.29
2026.05
98.4
HQMQ s192 r6
bits=4.54
2026.05
109
HQMQ s24 r6
bits=3.79
2026.05
197
naive int4 + Med3x
bits=4.59
2026.05
10,668
naive int4 + Med5x
bits=4.37
2026.05
12,738
naive int3 + Med3x
bits=3.62
2026.05
13,350
naive int4
bits=4.00
2026.05
17,661
naive int3
bits=3.00
2026.05
25,411
Feedback
Search any
task
Search any
task