Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on ARC (Easy and Challenge Sets)
Loading...
42.83
Accuracy (ARC-C)
FP16
28.634
32.3195
36.005
39.6905
Nov 26, 2025
Accuracy (ARC-C)
Accuracy (ARC-E)
Updated 2d ago
Evaluation Results
Method
Method
Links
Accuracy (ARC-C)
Accuracy (ARC-E)
FP16
Model=Qwen3-1.7B
2025.11
42.83
69.61
Quant-Only
Model=Qwen3-1.7B
2025.11
37.28
61.32
IntAttention
Model=Qwen3-1.7B
2025.11
37.03
61.87
IntAttention
Model=Llama-3.2-1B
2025.11
36.43
60.48
FP16
Model=Llama-3.2-1B
2025.11
36.18
60.48
Quant-Only
Model=Llama-3.2-1B
2025.11
35.84
60.56
Quant-Only
Model=OPT-1.3B
2025.11
29.69
50.97
FP16
Model=OPT-1.3B
2025.11
29.61
50.97
IntAttention
Model=OPT-1.3B
2025.11
29.18
50.8
Feedback
Search any
task
Search any
task