Common Sense Reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
Hellaswag	Flexora	Accuracy93.87	213	11d ago
BoolQ		Accuracy92.4	212	19d ago
COPA	AUSteer	Accuracy99.2	197	3d ago
Winogrande		Accuracy91.3	189	19d ago
Common Sense Reasoning Tasks (ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, WinoGrande) zero-shot		Average Accuracy (Zero-Shot)77.67	92	22d ago
ARC easy	Mamba2	ARC (easy) Accuracy69.87	72	10d ago
PIQA	Qwen2.5-7B-Instruct	Accuracy83	71	8d ago
7 common sense reasoning datasets		Average Performance71.72	61	1mo ago
HSWAG	In-Squeeze	Accuracy0.9751	52	1mo ago
HellaSwag (test)	Llama-3.3-70B-Base	Accuracy83.9	45	1mo ago
NoRa Irrelevant Rationales	SC	Accuracy60	40	1mo ago
WG		Accuracy94.1	38	1mo ago
HellaSwag 0-shot		Accuracy84.4	34	9d ago
ARC-Challenge 0-shot		Accuracy57.2	31	9d ago
Common Sense Reasoning Suite (PIQA, ARC-Easy, ARC-Challenge, BoolQ, HellaSwag, Winogrande) zero-shot (test dev)	Kirin	PIQA79.35	30	1mo ago
BBH	ReMiT	Accuracy58.27	27	1mo ago
5 common-sense reasoning tasks Llama-3-8B		Average Accuracy87.07	27	1mo ago
WSC273	OK-Transformer	Accuracy91.58	26	1mo ago
ARC-Easy (ARC-E) 0-shot		Accuracy79.5	24	9d ago
SWAG	LD-MoLE	Accuracy92.29	24	1mo ago
Common Sense Reasoning Suite (PIQA, HellaSwag, WinoGrande, ARC-e, ARC-c, OBQA) zero-shot	Qwen2.5-14B	PIQA81.12	20	1mo ago
HellaSwag (dev)	DeBERTa-ASA	Accuracy95.4	20	17d ago
PIQA (dev)		Accuracy83.2	19	17d ago
Common-Sense Reasoning Tasks	Mamba2-H	Wiki PPL16	18	2d ago
Common-sense Reasoning Suite (PIQA, HellaSwag, ARC-C, ARC-E, OBQA) (test)	LLaMA + LoRA	PIQA Accuracy84.1	18	1mo ago

Showing 25 of 61 rows