Share your thoughts, 1 month free Claude Pro on us
See more
Home
/
Benchmarks
Question Answering on AI2 Reasoning Challenge Easy (ARC-e)
Loading...
83.59
ARC-e Accuracy
Base-FP16
62.0516
67.6433
73.235
78.8267
Sep 18, 2025
ARC-e Accuracy
Updated 18d ago
Evaluation Results
Method
Method
Links
ARC-e Accuracy
Base-FP16
Model=Qwen-3-8B, Evalu...
2025.09
83.59
GPTQ-INT4
Model=Qwen-3-8B, Evalu...
2025.09
81.94
Base-FP16
Model=LLaMA-3.1-8B-Ins...
2025.09
81.36
FairGPTQ-INT4
Model=Qwen-3-8B, Evalu...
2025.09
81.27
FairGPTQ-INT4
Model=LLaMA-3.1-8B-Ins...
2025.09
81.1
Base-FP16
Model=Mistral-v0.3-7B,...
2025.09
80.05
GPTQ-INT4
Model=LLaMA-3.1-8B-Ins...
2025.09
79.5
Base-FP16
Model=Mistral-v0.3-7B-...
2025.09
79.38
GPTQ-INT4
Model=Mistral-v0.3-7B,...
2025.09
79.08
GPTQ-INT4
Model=Mistral-v0.3-7B-...
2025.09
78.49
FairGPTQ-INT4
Model=Mistral-v0.3-7B,...
2025.09
76.18
FairGPTQ-INT4
Model=Mistral-v0.3-7B-...
2025.09
75.13
FairGPTQ-INT4
Model=Qwen-2.5-7B-Inst...
2025.09
69.57
GPTQ-INT4
Model=Qwen-2.5-7B-Inst...
2025.09
69.19
Base-FP16
Model=Qwen-2.5-7B-Inst...
2025.09
68.52
Base-FP16
Model=OPT-6.7B, Evalua...
2025.09
66.12
GPTQ-INT4
Model=OPT-6.7B, Evalua...
2025.09
64.94
FairGPTQ-INT4
Model=OPT-6.7B, Evalua...
2025.09
62.88
Feedback
Search any
task
Search any
task