Share your thoughts, 1 month free Claude Pro on usSee more

Science Question Answering on ARC-E

97.53Accuracy

Qwen3-4B

Updated 5d ago

Evaluation Results

Method	Links
Qwen3-4B 2025.12		97.53
Qwen2.5-3B 2025.12		92.59
Qwen3-1.7B 2025.12		91.89
Qwen2.5-1.5B 2025.12		90.48
Qwen-14B 2024.07		89.24
SmolLM3-3B 2025.12		88.54
Qwen-1.5 14B (Teacher) 2024.07		87.58
LLAMA-4-SCOUT 2025.11		87.3
LLAMA-4-SCOUT 2025.11		87
In-Squeeze 2026.02		86
Cont-Squeeze 2026.02		85.89
FP16 2024.03		85.86
Cont-Squeeze 2026.02		85.5
Direct Fine-tuning 2026.02		85.39
In-Squeeze 2026.02		85.35
Direct Fine-tuning 2026.02		85.2
Direct Fine-tuning 2026.02		85.07
QWEN-3-30B MOE 2025.11		84.8
Qwen3-0.6B 2025.12		84.48
GenKnowSub 2025.05		84.38
GenKnowSub 2025.05		84.03
Full-precision 2026.04		84.01
llama-3.2-3B 2025.12		83.95
BF16 2026.05		83.71
Qwen2-1.5B 2025.12		83.6
Full-precision 2026.04		83.5
Arrow 2025.05		83.38
QWEN-3-30B MOE 2025.11		83.3
PCMind-2.1-Kaiyuan-2B 2025.12		82.89
SmolLM2-1.7B 2025.12		82.72
gemma2-2B 2025.12		82.54
YuLan-Mini-2.4B 2025.12		82.54
Phi-2 2025.05		82.11
Dense 2025.11		81.4
SARQC-GBS(Saliency) 2026.05		80.6
Router norm + Max var 2026.04		80.47
Dense 2025.11		80.3
LLAMA-4-SCOUT 2025.11		80.3
DEEPSEEK-V2-LITE 2025.11		80.2
AutoPrune 2025.11		80.06
Uniform 2026.04		80.05
BF16 2026.05		80.05
Mistral 7B 2023.10		80
AutoPrune 2025.11		79.89
Wanda 2025.11		79.75
SparseGPT 2025.11		79.35
Wanda 2025.11		79.29
Jet-Nemotron-4B 2026.05		79.25
SARQC-GBS(Saliency) 2026.05		79.21
SARQC-GBS(Identity) 2026.05		79
FP16 2026.05		78.96
SparseGPT 2025.11		78.96
GLaM 2021.12		78.9
DEEPSEEK-V2-LITE 2025.11		78.9
PMQ 2026.04		78.87
Router norm + Max var 2026.04		78.62
Router norm + Max var 2026.04		78.41
PMQ 2026.04		78.41
Coherence Boosting (GPT-3 175B) 2021.10		78.32
SARQC-GBS(Identity) 2026.05		78.32
GPTQ 2026.05		77.99
FP16 2024.03		77.82
GradOT 2025.07		77.8
Llama3 8B 2026.02		77.7
Dense 2025.11		77.4
G-Lion 2024.03		77.11
G-AdamW 2024.03		77.06
DASH-3 2026.05		76.98
PMQ 2026.04		76.94
Distributed Lion-MaVo 2024.03		76.86
DASH-3 2026.05		76.85
OLMo-2-0425-1B 2025.12		76.72
Uniform 2026.04		76.68
DASH-3 2026.05		76.68
LLaMA 7B (Baseline) 2024.03		76.64
+ DDK 2024.07		76.64
GLaM 2021.12		76.6
OT† 2025.07		76.5
Llama-2 2024.10		76.4
Magnitude 2025.11		76.4
Hessian 2026.04		76.38
Distributed Lion-Avg 2024.03		76.35
GPT-3 175B 2021.10		76.22
Nemotron-4 15B + MaskLLM 2024.09		75.93
PMQ 2026.04		75.51
FP16 2026.05		75.46
Router norm + Max var 2026.04		75.38
Dense 2025.11		75.34
LLaMA 2 13B 2023.10		75.2
+ MiniLLM 2024.07		75.02
Qwen-1.5 1.8B + DDK 2024.07		75.01
+ TED 2024.07		74.94
BF16 2026.05		74.87
Jet-Nemotron-2B 2026.05		74.79
Qwen-1.5 1.8B + TED 2024.07		74.74
Qwen-1.5 1.8B + MiniLLM 2024.07		74.52
Full Model 2025.07		74.5
Router norm + Max var 2026.04		74.45
DEEPSEEK-V2-LITE 2025.11		74.3
GPTQ 2026.05		74.28

Showing 100 of 240 rows