Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Zero-shot Question Answering on Reasoning Suite (ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, WinoGrande)
Loading...
60.15
ARC-C Accuracy
FP16
51.2788
53.5819
55.885
58.1881
Jun 9, 2026
ARC-C Accuracy
ARC-E Accuracy
BoolQ Accuracy
HellaSwag Accuracy
PIQA Accuracy
WinoGrande Accuracy
Average Accuracy (Overall)
Performance Ratio
Updated 1mo ago
Evaluation Results
Method
Method
Links
ARC-C Accuracy
ARC-E Accuracy
BoolQ Accuracy
HellaSwag Accuracy
PIQA Accuracy
WinoGrande Accuracy
Average Accuracy (Overall)
Performance Ratio
FP16
Model Scale=14B, Calib...
2026.06
60.15
82.83
89.3
78.84
79.87
72.85
77.31
1
LC-QAT
Model Scale=14B, Calib...
2026.06
54.69
79.25
85.9
73.66
78.51
73.88
74.32
0.96
LC-PTQ
Model Scale=14B, Calib...
2026.06
51.62
77.69
87.16
69.82
77.42
71.59
72.55
0.94
Feedback
Search any
task
Search any
task
