Logic reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
Tracking Shuffled Objects BBH	Role-Play Prompting	Accuracy71.33	59	14d ago
Zebralogic	Qwen 3 VL 32B Think	Score96.1	42	3mo ago
Causal Judgement	Self-discover	Accuracy36	30	3mo ago
K&K Logic Puzzles OOD		Score Threshold 2 (OOD)99	25	2mo ago
K&K Logic Puzzles In-domain		Accuracy (Level 3)98	25	2mo ago
LogicVista	Qwen-8B-DeltaThinker	LogicVista Accuracy61.97	16	2d ago
Autologic en	DARL	Score0.439	16	3mo ago
Autologic cn	DARL	Score40.3	16	3mo ago
ZebraLogic		Accuracy96	15	3mo ago
ZebraLogic	NPR	Avg Accuracy @10.817	11	3mo ago
ARC (eval)	NSA (ours)	Tasks Solved75	10	1d ago
ARC (train)	Ainooson Brute Force [2]	Tasks Solved26	9	1d ago
Sudoku 8B Instruct (test)		Accuracy71.7	9	1mo ago
MMStar	BAGEL+Ours	MMStar Score67.9	8	16d ago
Zebra riddles (test)	Glauber-UL2 (N=3)	Accuracy98.7	7	27d ago
Riddle 1.0 (test)	INMS	F1 Score69	7	2mo ago
Pun 1.0 (test)		F1 Score41	7	2mo ago
Puzzle 1.0 (test)		F1 Score19	7	2mo ago
Logic Reasoning Suite LogicVista, VisuLogic	Uni-OPD	Accuracy on LogicVista54	6	28d ago
Zebralogic	SUPERNOVA-4B	Pass@877	6	1mo ago
Visu Logic	Uni-OPD	Visu Logic Score28	4	28d ago
ARC-Challenge & LogiQA OpenCompass (test)	CRITIQ	ARC-C Accuracy38.31	4	3mo ago
Large-scale model pool Logic Reasoning 15 LLMs	RouteMoA	Accuracy95.6	3	3mo ago
CommonsenseQA	MIG	Pass@169.8	3	3mo ago
KiVA	BAGEL+Ours	KiVA Score35.2	2	16d ago

Showing 25 of 26 rows