Share your thoughts, 1 month free Claude Pro on usSee more

Abstract Reasoning on ConceptARC

97.29Accuracy

Qwen3 + DIARC

Updated 29d ago

Evaluation Results

Method	Links
Qwen3 + DIARC 2026.06		97.29
Qwen3 + SFT only 2026.06		96.46
Human (pass@1) 2026.06		73
o4-mini 2026.06		70.8
Gemini 2.5 Pro 2026.06		66
Minitron + DIARC 2026.06		62.71
Minitron + SFT only 2026.06		60.42
Claude Sonnet 4 2026.06		60.2
Llama-3.2 + DIARC 2026.06		59.17
Llama-3.2 + SFT only 2026.06		58.13
Qwen-2.5 2026.06		26
GPT-4 2026.06		24
o4-mini (visual) 2026.06		8.1
Minitron 2026.06		5.83
Qwen3 2026.06		1.25
Llama-3.2 2026.06		1.04