Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Multiple-choice Question Answering and Reasoning on ARC-C, ARC-E, HellaSwag, PIQA, WinoGrande (test val)
Loading...
22.7
ARC-Challenge Accuracy
Q-MQA
18.5296
19.6123
20.695
21.7777
Jun 1, 2026
ARC-Challenge Accuracy
ARC-Easy Accuracy
HellaSwag Accuracy
PIQA Accuracy
WinoGrande Accuracy
Average Accuracy
Updated 1mo ago
Evaluation Results
Method
Method
Links
ARC-Challenge Accuracy
ARC-Easy Accuracy
HellaSwag Accuracy
PIQA Accuracy
WinoGrande Accuracy
Average Accuracy
Q-MQA
Model scale=1.2B, Eval...
2026.06
22.7
25.08
25.04
49.51
49.57
34.38
Q-GQA-8
Model scale=1.2B, Eval...
2026.06
19.97
29.97
26.13
56.47
51.07
36.72
MQA
Model scale=1.2B, Eval...
2026.06
19.62
30.09
26.23
55.77
50.12
36.37
QKV
Model scale=1.2B, Eval...
2026.06
19.03
30.01
26.15
56.64
50.2
36.4
Q-K=V
Model scale=1.2B, Eval...
2026.06
18.94
28.62
26.14
56.37
49.88
35.99
GQA-8
Model scale=1.2B, Eval...
2026.06
18.69
29.42
26.44
56.91
47.83
35.86
Feedback
Search any
task
Search any
task
