SOTA Science Question Answering on ARC and PapersWithCode

98.8ARC Accuracy

Llama-4-Maverick

Updated 26d ago

Evaluation Results

Method	Links
Llama-4-Maverick 2026.03		98.8
Claude-Haiku-4.5 2026.03		98.8
DeepSeek-R1 2026.03		98.8
GraphRouter 2026.03		98.8
FineRouter 2026.03		98.8
IPR 2026.03		97.7
Claude-Sonnet-4.5 2026.03		97.6
GPT-OSS-120B 2026.03		97.6
kNN 2026.03		97.6
RouteLLM 2026.03		97.6
Qwen3-32B 2026.03		96.4
Mistral-Large 2026.03		92.9
DeepSeek-v3 2026.03		91.7
Qwen3-235B-A22B 2026.03		91.7
RouterDC 2026.03		91.7
Llama-3.3-70B 2026.03		90.5
AutoAdapt 2026.03		83.79
HF Defaults 2026.03		78.24
MLCopilot 2026.03		77.56
DS-Agent 2026.03		77.47
AutoMLAgent 2026.03		77.39
MLP 2026.03		70.2
Mistral-Small 2026.03		69.1
Full 2025.12		62.54
Full 2025.12		62.54
Full 2025.12		56.48
L3-8B (Base) 2025.07		55.5
KV-Latent Train (L3-8B) 2025.07		53.8
MoE Pathfinder 2025.12		53.18
MoE Pathfinder 2025.12		53.18
MoE Pathfinder 2025.12		49.66
LLaMA-3.2-3B-Instruct 2025.12		43.6
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO 2025.12		41.81
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v3 2025.12		41.13
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v5 2025.12		40.78
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v4 2025.12		40.7
StatLLaMA (DTFT-v2) 2025.12		40.61
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v1 2025.12		40.27
KV-Latent Distill (L3-8B) 2025.07		39.1
KV-Latent Train (L3-8B, d=16) 2025.07		38.5
L2-7B (Base) 2025.07		30.7
Random 2025.12		29.61
Random 2025.12		29.61
KV-Latent Train (L2-7B) 2025.07		27.5
KV-Latent Distill (L2-7B) 2025.07		27
Random 2025.12		23.03