Our new X account is live! Follow @wizwand_team for updates
Home
/
Benchmarks
Question Answering on ARC-Challenge 0-shot (test)
Loading...
55.03
Accuracy
FP16
23.3516
31.5758
39.8
48.0242
Dec 19, 2025
Accuracy
Updated 4d ago
Evaluation Results
Method
Method
Links
Accuracy
FP16
q (mean bit precision)...
2025.12
55.03
AQLM-1x16 + PV-Tuning
q (mean bit precision)...
2025.12
48.89
CodeGEMM-m2v8g128 + PV-Tuning
q (mean bit precision)...
2025.12
47.7
CodeGEMM-m1v4g128 + PV-Tuning
q (mean bit precision)...
2025.12
46.33
AQLM-1x16
q (mean bit precision)...
2025.12
46.16
AQLM-2x8 + PV-Tuning
q (mean bit precision)...
2025.12
45.73
CodeGEMM-m1v4g128
q (mean bit precision)...
2025.12
38.48
CodeGEMM-m2v8g128
q (mean bit precision)...
2025.12
37.03
AQLM-2x8
q (mean bit precision)...
2025.12
30.89
FlexRound-q2g128
q (mean bit precision)...
2025.12
24.57
Feedback
Search any
task
Search any
task