Our new X account is live! Follow @wizwand_team for updates

Zero-shot Classification on HellaSwag, PIQA, COPA, ARC-C, ARC-E, WinoGrande

80.79PIQA Acc

Baseline

Updated 4d ago

Evaluation Results

Method	Links
Baseline 2025.12		80.79	79.16	89	53.41	77.78	72.85	75.5
SMQ Dynamic 2025.12		80.58	79.25	91	48.81	77.02	71.27	74.65
Baseline 2025.12		80.52	79.37	91	49.06	77.4	72.3	74.94
QuaRot 2025.12		80.36	79.38	91	49.15	77.31	71.98	74.86
SMQ Dynamic 2025.12		80.09	78.95	89	52.39	77.1	72.45	75
Baseline 2025.12		80.03	78.71	91	51.11	77.78	71.82	75.74
LLM-QAT 2025.12		80	77.4	-	-	75.3	71.6	-
SASQ 2025.12		79.87	77.57	88	51.88	78.07	71.51	74.48
SMQ Dynamic 2025.12		79.65	78.49	88	48.89	75.38	71.27	73.61
SpinQuant 2025.12		79.6	78.1	-	-	76.5	72.4	-
LLM-QAT 2025.12		79.4	75.6	-	-	72.3	69.7	-
Baseline 2025.12		79.16	76.2	84	44.71	72.93	69.93	71.16
Baseline 2025.12		79.11	75.99	87	46.25	74.58	69.14	72.18
AWQ 2025.12		79	-	-	47.7	79.04	73.24	-
LLM-QAT 2025.12		79	76	-	-	77.6	72.4	-
QuaRot 2025.12		78.94	75.8	86	45.39	74.79	68.67	71.6
SpinQuant 2025.12		78.9	74.8	-	-	74	68.9	-
SASQ 2025.12		78.89	77.35	88	49.66	76.01	70.32	73.37
SMQ Dynamic 2025.12		78.84	75.81	87	44.54	75.21	70.24	71.94
LLM-QAT 2025.12		78.2	74	-	-	73.6	67.7	-
SASQ 2025.12		78.18	75.71	87	49.74	76.47	71.19	73.05
SASQ 2025.12		78.13	74.81	86	44.03	72.22	68.75	70.66
AWQ 2025.12		77.97	-	-	41.21	-	68.75	-
SASQ 2025.12		77.86	73.46	88	44.45	72.22	67.72	70.62
SMQ Dynamic 2025.12		77.8	76.1	88	46.15	74.1	68.58	71.79
AWQ 2025.12		77.31	-	-	43.86	76.14	68.98	-
Baseline 2025.12		75.68	67.62	82	44.62	71.51	62.59	67
SMQ Dynamic 2025.12		75.46	67.44	83	43.09	69.57	64.33	67.15
SASQ 2025.12		74.65	65.36	77	44.03	71.55	65.04	66.27
SMQ Static 2025.12		60.07	33.55	85	27.56	52.15	64.48	53.8