Share your thoughts, 1 month free Claude Pro on usSee more

Science Question Answering on ARC

98.8ARC Accuracy

Llama-4-Maverick

Updated 2d ago

Evaluation Results

Method	Links
Llama-4-Maverick 2026.03		98.8
Claude-Haiku-4.5 2026.03		98.8
DeepSeek-R1 2026.03		98.8
GraphRouter 2026.03		98.8
FineRouter 2026.03		98.8
IPR 2026.03		97.7
Claude-Sonnet-4.5 2026.03		97.6
GPT-OSS-120B 2026.03		97.6
kNN 2026.03		97.6
RouteLLM 2026.03		97.6
Qwen3-32B 2026.03		96.4
Mistral-Large 2026.03		92.9
DeepSeek-v3 2026.03		91.7
Qwen3-235B-A22B 2026.03		91.7
RouterDC 2026.03		91.7
Llama-3.3-70B 2026.03		90.5
AutoAdapt 2026.03		83.79
HF Defaults 2026.03		78.24
MLCopilot 2026.03		77.56
DS-Agent 2026.03		77.47
AutoMLAgent 2026.03		77.39
MLP 2026.03		70.2
Mistral-Small 2026.03		69.1
Full 2025.12		62.54
Full 2025.12		62.54
Full 2025.12		56.48
L3-8B (Base) 2025.07		55.5
Mistral-7B-INST 2024.08		55.29
RLHF 2024.08		55.2
UNA 2024.08		55.2
KV-Latent Train (L3-8B) 2025.07		53.8
MoE Pathfinder 2025.12		53.18
MoE Pathfinder 2025.12		53.18
NAMEx-Full 2025.10		50.64
NAMEx-Full 2025.10		50.63
EP-CAMEx 2025.10		50.45
Deepseek-MoE 2025.10		50.28
NAMEx-Full 2025.10		50.19
NAMEx-Full 2025.10		50.15
EP-CAMEx 2025.10		50
NAMEx-Full 2025.10		49.92
NAMEx-Full 2025.10		49.92
Deepseek-MoE 2025.10		49.9
NAMEx-Full 2025.10		49.85
NAMEx-Full 2025.10		49.84
EP-CAMEx 2025.10		49.73
MoE Pathfinder 2025.12		49.66
EP-CAMEx 2025.10		49.62
NAMEx-Full 2025.10		49.6
Deepseek-MoE 2025.10		49.6
NAMEx-Full 2025.10		49.58
NAMEx-Full 2025.10		49.52
NAMEx-Full 2025.10		49.51
Deepseek-MoE 2025.10		49.5
EP-CAMEx 2025.10		49.4
Deepseek-MoE 2025.10		49.3
EP-CAMEx 2025.10		49.26
Deepseek-MoE 2025.10		49.15
UNA 2024.08		44.28
Qwen2-1.5B-INST 2024.08		43.94
LLaMA-3.2-3B-Instruct 2025.12		43.6
RLHF 2024.08		42.83
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO 2025.12		41.81
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v3 2025.12		41.13
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v5 2025.12		40.78
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v4 2025.12		40.7
StatLLaMA (DTFT-v2) 2025.12		40.61
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v1 2025.12		40.27
KV-Latent Distill (L3-8B) 2025.07		39.1
KV-Latent Train (L3-8B, d=16) 2025.07		38.5
L2-7B (Base) 2025.07		30.7
Random 2025.12		29.61
Random 2025.12		29.61
KV-Latent Train (L2-7B) 2025.07		27.5
KV-Latent Distill (L2-7B) 2025.07		27
Random 2025.12		23.03