Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Zero-shot Question Answering and Commonsense Reasoning on (ARC-C, HellaSwag, PIQA, WinoGrande)
Loading...
55.8
ARC-C Accuracy
FP16
52.368
53.259
54.15
55.041
Apr 22, 2026
ARC-C Accuracy
HellaSwag Accuracy
PIQA Accuracy
WinoGrande Accuracy
Average Accuracy (Zero-shot QA/Reasoning)
Updated 23d ago
Evaluation Results
Method
Method
Links
ARC-C Accuracy
HellaSwag Accuracy
PIQA Accuracy
WinoGrande Accuracy
Average Accuracy (Zero-shot QA/Reasoning)
FP16
Model=Qwen3-8B, System...
2026.04
55.8
57.1
76.9
67.6
64.4
RATEQUANT
Bit-rate=4.0 bits, Mod...
2026.04
54.1
56.6
76.4
69.5
64.2
Uniform
Bit-rate=4.0 bits, Mod...
2026.04
52.5
55.2
74.4
66.9
62.2
Feedback
Search any
task
Search any
task
