Our new X account is live! Follow @wizwand_team for updates

Science Question Answering on ARC-E

97.53Accuracy

Qwen3-4B

Updated 3d ago

Evaluation Results

Method	Links
Qwen3-4B 2025.12		97.53
Qwen2.5-3B 2025.12		92.59
Qwen3-1.7B 2025.12		91.89
Qwen2.5-1.5B 2025.12		90.48
Qwen-14B 2024.07		89.24
SmolLM3-3B 2025.12		88.54
Qwen-1.5 14B (Teacher) 2024.07		87.58
In-Squeeze 2026.02		86
Cont-Squeeze 2026.02		85.89
FP16 2024.03		85.86
Cont-Squeeze 2026.02		85.5
Direct Fine-tuning 2026.02		85.39
In-Squeeze 2026.02		85.35
Direct Fine-tuning 2026.02		85.2
Direct Fine-tuning 2026.02		85.07
Qwen3-0.6B 2025.12		84.48
GenKnowSub 2025.05		84.38
GenKnowSub 2025.05		84.03
llama-3.2-3B 2025.12		83.95
Qwen2-1.5B 2025.12		83.6
Arrow 2025.05		83.38
PCMind-2.1-Kaiyuan-2B 2025.12		82.89
SmolLM2-1.7B 2025.12		82.72
gemma2-2B 2025.12		82.54
YuLan-Mini-2.4B 2025.12		82.54
Phi-2 2025.05		82.11
Mistral 7B 2023.10		80
GLaM 2021.12		78.9
Coherence Boosting (GPT-3 175B) 2021.10		78.32
FP16 2024.03		77.82
GradOT 2025.07		77.8
Llama3 8B 2026.02		77.7
G-Lion 2024.03		77.11
G-AdamW 2024.03		77.06
Distributed Lion-MaVo 2024.03		76.86
OLMo-2-0425-1B 2025.12		76.72
LLaMA 7B (Baseline) 2024.03		76.64
+ DDK 2024.07		76.64
GLaM 2021.12		76.6
OT† 2025.07		76.5
Llama-2 2024.10		76.4
Distributed Lion-Avg 2024.03		76.35
GPT-3 175B 2021.10		76.22
Nemotron-4 15B + MaskLLM 2024.09		75.93
LLaMA 2 13B 2023.10		75.2
+ MiniLLM 2024.07		75.02
Qwen-1.5 1.8B + DDK 2024.07		75.01
+ TED 2024.07		74.94
Qwen-1.5 1.8B + TED 2024.07		74.74
Qwen-1.5 1.8B + MiniLLM 2024.07		74.52
Full Model 2025.07		74.5
+ KD 2024.07		73.87
QuaRot 2024.03		73.44
Qwen-1.5 1.8B + KD 2024.07		73.41
VERSATILEFFN 2025.12		73.16
LLaMA-2 13B + MaskLLM 2024.09		73.15
+ CPT 2024.07		73.1
4-LOOP 2025.12		72.86
Qwen-1.5 1.8B + CPT & DoReMi 2024.07		72.59
Student (1.8B) 2024.07		72.16
Qwen-1.5 1.8B + CPT 2024.07		72
2-LOOP 2025.12		71.93
GLaM 2021.12		71.6
6-LOOP 2025.12		71.58
COMPOT 2026.02		71.3
GPT-3 2021.12		71.2
VERSATILEFFN 2025.12		71.05
llama-3.2-1B 2025.12		70.55
MOE 2025.12		70.35
Qwen-1.5 1.8B (Student) 2024.07		70.23
GPT-3 2021.12		70.1
LLaMA-2 7B + MaskLLM 2024.09		69.57
6-LOOP 2025.12		69.47
COMPOT 2026.02		69.4
GPT-3 175B 2021.10		69.19
BASE 2025.12		69.12
GPT-3 2021.12		68.8
LLAMA 2 7B 2023.10		68.7
2-LOOP 2025.12		68.42
4-LOOP 2025.12		68.25
QuaRot 2024.03		68.01
MOE 2025.12		67.72
Pythia 2024.10		67.3
Sheared-Llama 2024.10		67
Emulator 2025.07		66.7
Read-ME 2024.10		66.6
Open-Llama-v2 2024.10		66.5
ReplaceMe 2026.02		65.9
BASE 2025.12		65.61
2-LOOP 2025.12		64.56
4-LOOP 2025.12		64.56
VERSATILEFFN 2025.12		64.56
Pythia 2024.10		64.4
OpenMoE 2024.10		64.1
6-LOOP 2025.12		64.04
MOE 2025.12		63.16
Open-Llama-v2 2024.10		63
LLM-Pruner 2026.02		62.1
Coherence Boosting (GPT-2 XL) 2021.10		60.31
Z-LaVI (OPT-30B) 2022.10		59.5

Showing 100 of 138 rows