Common Sense Reasoning

Benchmarks

Dataset Name	SOTA Method	Metric
COPA	AUSteer	Accuracy99.2	288	26d ago
BoolQ		Accuracy92.4	280	18d ago
Hellaswag	Flexora	Accuracy93.87	213	3mo ago
Winogrande		Accuracy91.3	189	3mo ago
ARC easy		ARC (easy) Accuracy93.27	149	18d ago
PIQA	Llama-3.3-70B-Instruct	Accuracy91.89	100	2mo ago
ARC-e, ARC-c, BoolQ, HellaSwag, OpenBookQA, PIQA, SIQA, WinoGrande		0-shot Accuracy73.41	92	1mo ago
Common Sense Reasoning Tasks (ARC-C, ARC-E, BoolQ, HellaSwag, PIQA, WinoGrande) zero-shot		Average Accuracy (Zero-Shot)77.67	92	4mo ago
HellaSwag (test)	Llama-3.3-70B-Base	Accuracy83.9	86	1mo ago
HellaSwag		Accuracy91.84	85	16d ago
Six common sense reasoning tasks		Accuracy69.46	74	18d ago
Winogrande	ST-D	Accuracy85.64	67	18d ago
ARC Challenge	DASD	Accuracy89.6	63	18d ago
7 common sense reasoning datasets		Average Performance71.72	61	4mo ago
WG		Accuracy94.1	61	29d ago
HSWAG	In-Squeeze	Accuracy0.9751	52	4mo ago
HellaSwag 0-shot		Accuracy84.4	49	29d ago
HellaSwag	Always Tell Me The Odds	Accuracy (acc_n)95.7	47	1mo ago
Common-sense Reasoning Average	FRAME	Average Accuracy90.4	47	23d ago
ARC-Easy (ARC-E) 0-shot		Accuracy79.5	43	29d ago
NoRa Irrelevant Rationales	SC	Accuracy60	40	4mo ago
5 common-sense reasoning tasks Llama-3-8B		Average Accuracy87.07	35	23d ago
CSR (ARC-Easy, ARC-Challenge, BoolQ, PIQA, SIQA, HellaSwag, OpenBookQA, WinoGrande) zero-shot lm-evaluation-harness v0.4.2		Accuracy68.95	32	1mo ago
ARC-Challenge 0-shot		Accuracy57.2	31	3mo ago
Common Sense Reasoning Suite (PIQA, ARC-Easy, ARC-Challenge, BoolQ, HellaSwag, Winogrande) zero-shot (test dev)	Kirin	PIQA79.35	30	4mo ago

Showing 25 of 89 rows