Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on ARC-c

90.36Accuracy

Qwen3-8B

Updated 11d ago

Evaluation Results

Method
Qwen3-8B 2025.12	90.36	-	-	-	-	-
REFUSION 2025.12	89.76	-	-	-	-	-
SpecEM (All) 2024.12	89.08	-	-	-	-	-
SpecEM (GLM4+Gemma2) 2024.12	88.74	-	-	-	-	-
UniTE 2024.12	88.54	-	-	-	-	-
SpecEM (Qwen2+Gemma2) 2024.12	88.4	-	-	-	-	-
Majority-Voting 2024.12	88.38	-	-	-	-	-
Dream-7B-Instruct 2025.12	88.31	-	-	-	-	-
MOA 2024.12	88.28	-	-	-	-	-
Gemma-2-9B-instruct 2024.12	88.14	-	-	-	-	-
SpecEM (Qwen2+GLM4) 2024.12	87.54	-	-	-	-	-
Dream w/ Fast-dLLM 2025.12	86.86	-	-	-	-	-
Dream w/ D2F 2025.12	85.92	-	-	-	-	-
LLaDA-8B-Instruct 2025.12	85.58	-	-	-	-	-
GLM-4-9B-instruct 2024.12	85.15	-	-	-	-	-
Qwen2-7B-instruct 2024.12	84.73	-	-	-	-	-
LLaDA w/ D2F 2025.12	84.13	-	-	-	-	-
LLaDA w/ Fast-dLLM 2025.12	82.85	-	-	-	-	-
Llama-3-8B-Instruct 2025.12	82.76	-	-	-	-	-
FP16 2026.03	67.24	-	-	-	-	-
ARMADA 2026.03	65.7	-	-	-	-	-
LLaMA-7B 2026.03	65.5	-	-	-	-	-
ARMADA 2026.03	64.7	-	-	-	-	-
ARMADA 2026.03	64.3	-	-	-	-	-
FP16 2026.03	63.82	-	-	-	-	-
FP16 2026.03	59.47	-	-	-	-	-
NSDS 2026.03	58.27	-	-	-	-	-
FP16 2026.03	57.76	-	-	-	-	-
ZD 2026.03	57.38	-	-	-	-	-
NSDS 2026.03	57.08	-	-	-	-	-
Kurtosis 2026.03	56.76	-	-	-	-	-
MSE 2026.03	55.94	-	-	-	-	-
ZD 2026.03	55.82	-	-	-	-	-
EWQ 2026.03	55.03	-	-	-	-	-
KurtBoost 2026.03	54.25	-	-	-	-	-
MSE 2026.03	53.68	-	-	-	-	-
EWQ 2026.03	51.85	-	-	-	-	-
Llama-3-8B 2025.03	50.4	-	-	-	-	-
NSDS 2026.03	49.74	-	-	-	-	-
ClusComp 2025.03	49.7	54.1	-	-	-	-
SliM-LLM 2025.03	49.4	-	-	-	-	-
AWQ 2025.03	49.3	-	-	-	-	-
KurtBoost 2026.03	48.54	-	-	-	-	-
EWQ 2026.03	48.14	-	-	-	-	-
ZD 2026.03	47.89	-	-	-	-	-
GPTQ 2025.03	47.7	-	-	-	-	-
MSE 2026.03	46.71	-	-	-	-	-
RTN 2025.03	45	-	-	-	-	-
ClusComp 2025.03	43.9	47.6	-	-	-	-
AWQ 2025.03	43.2	-	-	-	-	-
NSDS 2026.03	43.16	-	-	-	-	-
SliM-LLM 2025.03	42.9	-	-	-	-	-
KurtBoost 2026.03	41.87	-	-	-	-	-
QuIP 2025.03	41	-	-	-	-	-
EWQ 2026.03	40.17	-	-	-	-	-
ZD 2026.03	39.45	-	-	-	-	-
MSE 2026.03	38.73	-	-	-	-	-
GPTQ 2025.03	37.7	-	-	-	-	-
Self-Improving Pretraining 2026.01	35.7	-	-	-	-	-
AWQ 2025.03	35.1	-	-	-	-	-
Self-Improving Pretraining 2026.01	35.1	-	-	-	-	-
Self-Improving Pretraining 2026.01	34.8	-	-	-	-	-
Llama Pretrain Baseline 2026.01	32.8	-	-	-	-	-
Llama Base 2026.01	32.3	-	-	-	-	-
ClusComp 2025.03	31.9	34.2	-	-	-	-
ClusComp 2025.03	31.4	35.5	-	-	-	-
Llama Pretrain Baseline 2026.01	31.3	-	-	-	-	-
ClusComp 2025.03	26.4	28.8	-	-	-	-
SliM-LLM 2025.03	26.1	-	-	-	-	-
RTN 2025.03	22.5	-	-	-	-	-
GPTQ 2025.03	22.3	-	-	-	-	-
RTN 2025.03	22.1	-	-	-	-	-
RTN 2025.03	21.9	-	-	-	-	-
AWQ 2025.03	21.5	-	-	-	-	-
AWQ 2025.03	21.3	-	-	-	-	-
QuIP 2025.03	21.3	-	-	-	-	-
GPTQ 2025.03	20.5	-	-	-	-	-
RTN 2025.03	20	-	-	-	-	-
GPTQ 2025.03	19.9	-	-	-	-	-
PB-LLM 2025.03	17.2	-	-	-	-	-
Qwen3-4B 2026.01	-	-	83.3	-	-	-
Qwen3-8B 2026.01	-	-	88.3	-	-	-
OLMo3-7B-Instruct 2026.01	-	-	72.2	-	-	-
Molmo2-4B 2026.01	-	-	89.3	-	-	-
Molmo2-8B 2026.01	-	-	89.6	-	-	-
Molmo2-O-7B 2026.01	-	-	79.9	-	-	-
Qwen3 – 1.7B 2026.02	-	-	84	-	-	-
Qwen3 – 4B 2026.02	-	-	90.5	-	-	-
DeepSeekR1 – 1.5B 2026.02	-	-	55.5	-	-	-
DeepSeekR1 – 7B 2026.02	-	-	82.5	-	-	-
Ouro2.6B-Thinking 2026.02	-	-	93.6	-	-	-
Ouro2.6B-Thinking + SFT 2026.02	-	-	93.5	-	-	-
Ouro2.6B-Thinking + GRPO 2026.02	-	-	93.7	-	-	-
Ouro2.6B-Thinking + RLTT 2026.02	-	-	94.4	-	-	-
SFT 2025.11	-	-	57.68	-	-	-
TuluDPO 2025.11	-	-	59.59	-	-	-
ORPO 2025.11	-	-	58.83	-	-	-
UltraFB 2025.11	-	-	58.17	-	-	-
HelpSteer 2025.11	-	-	56.97	-	-	-
CodePref 2025.11	-	-	52.73	-	-	-

Showing 100 of 168 rows