Our new X account is live! Follow @wizwand_team for updates

Common Sense Reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
Hellaswag	Flexora	Accuracy93.87	164	3d ago
Winogrande		Accuracy91.3	156	3d ago
COPA	AUSteer	Accuracy99.2	138	2d ago
BoolQ		Accuracy92.4	131	2d ago
Common Sense Reasoning Tasks (ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, WinoGrande) zero-shot		Average Accuracy (Zero-Shot)74.19	72	3d ago
7 common sense reasoning datasets		Average Performance71.72	61	3d ago
ARC easy	Palimpsa-M (Fine-tuned 2BT)	ARC (easy) Accuracy67.97	52	2d ago
HSWAG	In-Squeeze	Accuracy0.9751	52	3d ago
HellaSwag (test)	Llama-3.3-70B-Base	Accuracy83.9	45	3d ago
NoRa Irrelevant Rationales	SC	Accuracy60	40	3d ago
Common Sense Reasoning Suite (PIQA, ARC-Easy, ARC-Challenge, BoolQ, HellaSwag, Winogrande) zero-shot (test dev)	Kirin	PIQA79.35	30	3d ago
BBH	ReMiT	Accuracy58.27	27	3d ago
5 common-sense reasoning tasks Llama-3-8B		Average Accuracy87.07	27	3d ago
WSC273	OK-Transformer	Accuracy91.58	26	3d ago
SWAG	LD-MoLE	Accuracy92.29	24	3d ago
HellaSwag 0-shot		Accuracy84.4	22	3d ago
Common Sense Reasoning Suite (PIQA, HellaSwag, WinoGrande, ARC-e, ARC-c, OBQA) zero-shot	Qwen2.5-14B	PIQA81.12	20	3d ago
ARC-Challenge 0-shot		Accuracy57.2	19	3d ago
Common-sense Reasoning Suite (PIQA, HellaSwag, ARC-C, ARC-E, OBQA) (test)	LLaMA + LoRA	PIQA Accuracy84.1	18	3d ago
Common-sense reasoning tasks (ARC-C, ARC-E, HellaSwag, Lambada, PIQA, WinoGrande) (test)	RAT+	ARC-C Accuracy44.88	16	3d ago
5 common-sense reasoning tasks Llama-2-70B		Average Accuracy72.41	15	3d ago
5 common-sense reasoning tasks Llama-2-13B		Accuracy67.81	15	3d ago
ARC Challenge	MFS (Ours)	Pass@186.73	14	3d ago
ARC-Easy (ARC-E) 0-shot		Accuracy79.5	12	3d ago
HellaSwag (dev)	DeBERTa-ASA	Accuracy95.4	12	3d ago

Showing 25 of 39 rows