Science Question Answering on ARC

62.54ARC Accuracy

Full

Updated 4d ago

Evaluation Results

Method	Links
Full 2025.12		62.54
Full 2025.12		62.54
Full 2025.12		56.48
L3-8B (Base) 2025.07		55.5
KV-Latent Train (L3-8B) 2025.07		53.8
MoE Pathfinder 2025.12		53.18
MoE Pathfinder 2025.12		53.18
MoE Pathfinder 2025.12		49.66
LLaMA-3.2-3B-Instruct 2025.12		43.6
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO 2025.12		41.81
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v3 2025.12		41.13
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v5 2025.12		40.78
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v4 2025.12		40.7
StatLLaMA (DTFT-v2) 2025.12		40.61
LLaMA-3.2-3B-Instruct + SFT-v3.4 + DPO + DTFT-v1 2025.12		40.27
KV-Latent Distill (L3-8B) 2025.07		39.1
KV-Latent Train (L3-8B, d=16) 2025.07		38.5
L2-7B (Base) 2025.07		30.7
Random 2025.12		29.61
Random 2025.12		29.61
KV-Latent Train (L2-7B) 2025.07		27.5
KV-Latent Distill (L2-7B) 2025.07		27
Random 2025.12		23.03