Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on ARC Easy

96.63Accuracy

GPT-4

Updated 16d ago

Evaluation Results

Method
GPT-4 2023.11	96.63	-	-	-	-	-
EMoE 2025.09	95.94	-	-	-	-	-
Top-k 2025.09	95.24	-	-	-	-	-
Top-k 2025.09	94.89	-	-	-	-	-
EMoE 2025.09	94.71	-	-	-	-	-
Top-k 2025.09	94.18	-	-	-	-	-
EMoE 2025.09	94.18	-	-	-	-	-
ChatGPT 2023.11	93.73	-	-	-	-	-
KALE 2026.01	93.43	-	-	-	-	-
Orca-2-13B 2023.11	92.85	-	-	-	-	-
Fine-tuned SOTA 2020.05	92	-	-	-	-	-
OLMo 2 2026.01	92	-	-	-	-	-
OLMo 3 2026.01	91	-	-	-	-	-
Engram-40B 2026.01	90.1	-	-	-	-	-
Engram-27B 2026.01	89	-	-	-	-	-
Orca-2-7B 2023.11	87.79	-	-	-	-	-
SFT 2026.01	87.54	-	-	-	-	-
BayesLoRA 2025.06	86.96	-	-	-	12.36	0.94
BayesLoRA 2025.06	86.73	-	-	-	12.79	0.91
MoE-27B 2026.01	86.5	-	-	-	-	-
BayesLoRA 2025.06	86.32	-	-	-	7.99	0.55
Orca-1-13B 2023.11	86.24	-	-	-	-	-
MCD 2025.06	86.21	-	-	-	12.2	1
BayesLoRA 2025.06	86.14	-	-	-	7.7	0.55
BBB 2025.06	85.86	-	-	-	12.28	0.91
LoRA 2025.06	85.65	-	-	-	13.12	1.17
Orca-2-13B 2023.11	85.31	-	-	-	-	-
Orca-2-7B 2023.11	85.1	-	-	-	-	-
Unfiltered 2026.01	85	-	-	-	-	-
Misalignment Upsampled 2026.01	85	-	-	-	-	-
ASC 2026.02	85	-	-	-	-	-
Vanilla 2026.01	84.6	-	-	-	-	-
ENS 2025.06	84.4	-	-	-	12.57	0.82
Filtered + Alignment Upsampled 2026.01	84	-	-	-	-	-
Misalignment Upsampled 2026.01	84	-	-	-	-	-
EMoE 2025.09	83.95	-	-	-	-	-
Lizard 2026.07	83.5	-	-	-	-	-
Filtered 2026.01	83	-	-	-	-	-
Alignment Upsampled 2026.01	83	-	-	-	-	-
Alignment Upsampled 2026.01	83	-	-	-	-	-
STILL (concurrent) 2026.07	83	-	-	-	-	-
EMoE 2025.09	82.54	-	-	-	-	-
Llamba 2026.07	82.5	-	-	-	-	-
LoLa 2026.07	82.5	-	-	-	-	-
LolCaT 2026.07	82.37	-	-	-	-	-
GenKnowSub 2025.05	82.28	-	-	-	-	-
LLAMA-2-Chat-70B 2023.11	82.2	-	-	-	-	-
LLaMA 3.1 8B 2026.07	82.15	-	-	-	-	-
OURS (GDN) 2026.07	82.15	-	-	-	-	-
GenKnowSub 2025.05	82.11	-	-	-	-	-
OURS (GDN) 2026.07	81.97	-	-	-	-	-
Liger-GLA 2026.07	81.8	-	-	-	-	-
GenKnowSub 2025.05	81.75	-	-	-	-	-
GenKnowSub 2025.05	81.75	-	-	-	-	-
ARMADA 2026.03	81.1	-	-	-	-	-
ClusComp 2025.03	80.9	-	79.6	-	-	-
LLaMA-7B 2026.03	80.9	-	-	-	-	-
ARMADA 2026.03	80.8	-	-	-	-	-
ARMADA 2026.03	80.8	-	-	-	-	-
WizardLM-70B 2023.11	80.68	-	-	-	-	-
Arrow 2025.05	80.53	-	-	-	-	-
Llama-3-8B 2025.03	80.1	-	-	-	-	-
LLaMA 2023.02	80	-	-	-	-	-
Misalignment Upsampled 2026.01	80	-	-	-	-	-
SliM-LLM 2025.03	79.9	-	-	-	-	-
EMoE 2025.09	79.72	-	-	-	-	-
AWQ 2025.03	79.7	-	-	-	-	-
EMoE 2025.09	79.37	-	-	-	-	-
Filtered + Alignment Upsampled 2026.01	79	-	-	-	-	-
Filtered + Alignment Upsampled 2026.01	79	-	-	-	-	-
LLaMA 2023.02	78.9	-	-	-	-	-
GPTQ 2025.03	78.8	-	-	-	-	-
Shared 2025.05	78.77	-	-	-	-	-
EMoE 2025.09	78.66	-	-	-	-	-
EMoE 2025.09	78.66	-	-	-	-	-
LLAMA-3-8B 2026.04	77.48	-	-	-	-	-
Llama 2 2026.01	77	-	-	-	-	-
Dense-4B 2026.01	76.8	-	-	-	-	-
Top-k 2025.09	76.65	-	-	-	-	-
PaLM 2023.02	76.6	-	-	-	-	-
EMoE 2025.09	76.37	-	-	-	-	-
Llama2-7B 2023.09	76.3	-	-	-	-	-
LLAMA-2-Chat-13B 2023.11	76.26	-	-	-	-	-
FP16 2026.01	76.14	-	-	-	-	-
phi-1.5-web (1.3B) 2023.09	76.1	-	-	-	-	-
ClusComp 2025.03	76	-	74.5	-	-	-
LAW 2026.02	76	-	-	-	-	-
Top-k 2025.09	75.98	-	-	-	-	-
QMC 2026.01	75.96	-	-	-	-	-
FP16 2026.01	75.8	-	-	-	-	-
phi-1.5 (1.3B) 2023.09	75.6	-	-	-	-	-
Top-k 2025.09	75.6	-	-	-	-	-
Top-k 2025.09	75.49	-	-	-	-	-
QMC 2026.01	75.42	-	-	-	-	-
Vicuna-13B (v1.1) 2023.09	75.4	-	-	-	-	-
PaLM 2023.02	75.2	-	-	-	-	-
EMoE 2025.09	75.13	-	-	-	-	-
Original 2026.02	75	-	-	-	-	-
MPT-7B 2023.09	74.9	-	-	-	-	-
LLaMA 2023.02	74.8	-	-	-	-	-

Showing 100 of 314 rows