Share your thoughts, 1 month free Claude Pro on usSee more

Zero-shot Commonsense Reasoning Suite (PIQA, HellaSwag, WinoGrande, ARC-Easy, ARC-Challenge)

78PIQA Accuracy

Baseline

Updated 16d ago

Evaluation Results

Method	Links
Baseline 2026.05		78	57	69	76	43	65
IO-SVD 2026.05		74	47	67	73	38	60
ZS-SVD 2026.05		73	48	68	70	36	59
IO-SVD 2026.05		73	48	65	71	37	59
Bonsai 2026.05		72	45	58	59	30	53
Dobi-SVD 2026.05		72	45	64	67	31	56
ZS-SVD 2026.05		72	46	67	66	33	57
LLM-Pruner 2026.05		70	41	53	53	27	48
Wanda-sp 2026.05		70	42	53	57	29	50
Dobi-SVD 2026.05		67	38	57	55	26	49
SliceGPT 2026.05		65	57	60	43	32	51
ZS-SVD 2026.05		63	34	60	46	25	45
IO-SVD 2026.05		61	33	59	51	23	45
SVD-LLM 2026.05		56	30	57	39	21	41
SVD-LLM 2026.05		54	27	48	26	20	35
ZS-SVD 2026.05		54	27	52	29	19	36
IO-SVD 2026.05		54	28	52	30	19	37