Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Zero-shot Reasoning on HellaSwag (200 items subset)
Loading...
68
Accuracy
HQMQ s192 r6 + Med3x
20.68
32.965
45.25
57.535
May 12, 2026
May 14, 2026
May 16, 2026
May 19, 2026
May 21, 2026
May 23, 2026
May 26, 2026
Accuracy
Updated 6d ago
Evaluation Results
Method
Method
Links
Accuracy
HQMQ s192 r6 + Med3x
bits=5.15
2026.05
68
HQMQ s96 r6 + Med3x
bits=4.91
2026.05
65
HQMQ s24 r6 + Med3x
bits=4.42
2026.05
64
fp16
bits=16.00
2026.05
63
fp16 baseline
Compression=1×, Base M...
2026.05
49.5
FIBQUANT
b (bits/coord)=3.50, C...
2026.05
48
INT
b (bits/coord)=4.00, C...
2026.05
47.5
FIBQUANT
b (bits/coord)=4.00, C...
2026.05
47.5
FIBQUANT
b (bits/coord)=3.00, C...
2026.05
47.5
TURBOQUANT
b (bits/coord)=3.00, C...
2026.05
46.5
TURBOQUANT
b (bits/coord)=4.00, C...
2026.05
45.5
FIBQUANT
b (bits/coord)=2.50, C...
2026.05
44
FIBQUANT
b (bits/coord)=2.00, C...
2026.05
41.5
INT
b (bits/coord)=3.00, C...
2026.05
37
TURBOQUANT
b (bits/coord)=2.00, C...
2026.05
33.5
naive int4
bits=4.00
2026.05
30
INT
b (bits/coord)=2.00, C...
2026.05
22.5
Feedback
Search any
task
Search any
task