Share your thoughts, 1 month free Claude Pro on usSee more

Science Question Answering on ARC-E

97.53Accuracy

Qwen3-4B

Updated 9d ago

Evaluation Results

Method	Links
Qwen3-4B 2025.12		97.53
Qwen2.5-3B 2025.12		92.59
Qwen3-1.7B 2025.12		91.89
Qwen2.5-1.5B 2025.12		90.48
Qwen-14B 2024.07		89.24
SmolLM3-3B 2025.12		88.54
Qwen-1.5 14B (Teacher) 2024.07		87.58
In-Squeeze 2026.02		86
Cont-Squeeze 2026.02		85.89
FP16 2024.03		85.86
Cont-Squeeze 2026.02		85.5
Direct Fine-tuning 2026.02		85.39
In-Squeeze 2026.02		85.35
Direct Fine-tuning 2026.02		85.2
Direct Fine-tuning 2026.02		85.07
Qwen3-0.6B 2025.12		84.48
GenKnowSub 2025.05		84.38
GenKnowSub 2025.05		84.03
Full-precision 2026.04		84.01
llama-3.2-3B 2025.12		83.95
Qwen2-1.5B 2025.12		83.6
Full-precision 2026.04		83.5
Arrow 2025.05		83.38
PCMind-2.1-Kaiyuan-2B 2025.12		82.89
SmolLM2-1.7B 2025.12		82.72
gemma2-2B 2025.12		82.54
YuLan-Mini-2.4B 2025.12		82.54
Phi-2 2025.05		82.11
Router norm + Max var 2026.04		80.47
Uniform 2026.04		80.05
Mistral 7B 2023.10		80
GLaM 2021.12		78.9
PMQ 2026.04		78.87
Router norm + Max var 2026.04		78.62
Router norm + Max var 2026.04		78.41
PMQ 2026.04		78.41
Coherence Boosting (GPT-3 175B) 2021.10		78.32
FP16 2024.03		77.82
GradOT 2025.07		77.8
Llama3 8B 2026.02		77.7
G-Lion 2024.03		77.11
G-AdamW 2024.03		77.06
PMQ 2026.04		76.94
Distributed Lion-MaVo 2024.03		76.86
OLMo-2-0425-1B 2025.12		76.72
Uniform 2026.04		76.68
LLaMA 7B (Baseline) 2024.03		76.64
+ DDK 2024.07		76.64
GLaM 2021.12		76.6
OT† 2025.07		76.5
Llama-2 2024.10		76.4
Hessian 2026.04		76.38
Distributed Lion-Avg 2024.03		76.35
GPT-3 175B 2021.10		76.22
Nemotron-4 15B + MaskLLM 2024.09		75.93
PMQ 2026.04		75.51
Router norm + Max var 2026.04		75.38
LLaMA 2 13B 2023.10		75.2
+ MiniLLM 2024.07		75.02
Qwen-1.5 1.8B + DDK 2024.07		75.01
+ TED 2024.07		74.94
Qwen-1.5 1.8B + TED 2024.07		74.74
Qwen-1.5 1.8B + MiniLLM 2024.07		74.52
Full Model 2025.07		74.5
Router norm + Max var 2026.04		74.45
+ KD 2024.07		73.87
QuaRot 2024.03		73.44
Qwen-1.5 1.8B + KD 2024.07		73.41
PMQ 2026.04		73.32
VERSATILEFFN 2025.12		73.16
LLaMA-2 13B + MaskLLM 2024.09		73.15
+ CPT 2024.07		73.1
Router norm + Max var 2026.04		72.9
4-LOOP 2025.12		72.86
Qwen-1.5 1.8B + CPT & DoReMi 2024.07		72.59
Hessian 2026.04		72.41
Student (1.8B) 2024.07		72.16
PMQ 2026.04		72.14
Qwen-1.5 1.8B + CPT 2024.07		72
2-LOOP 2025.12		71.93
PMQ 2026.04		71.93
GLaM 2021.12		71.6
6-LOOP 2025.12		71.58
COMPOT 2026.02		71.3
Router norm + Max var 2026.04		71.25
GPT-3 2021.12		71.2
Router norm + Max var 2026.04		71.17
VERSATILEFFN 2025.12		71.05
PMQ 2026.04		70.62
llama-3.2-1B 2025.12		70.55
MOE 2025.12		70.35
Qwen-1.5 1.8B (Student) 2024.07		70.23
GPT-3 2021.12		70.1
Router norm + Max var 2026.04		69.61
LLaMA-2 7B + MaskLLM 2024.09		69.57
Router norm + Max var 2026.04		69.53
6-LOOP 2025.12		69.47
COMPOT 2026.02		69.4
GPT-3 175B 2021.10		69.19
PMQ 2026.04		69.19

Showing 100 of 184 rows