Our new X account is live! Follow @wizwand_team for updates

Zero-shot Reasoning on (PIQA, HellaSwag, ARC-e, ARC-c, OBQA, Race, WSC273, LAMBADA, MMLU)

78.07PIQA

LLaMA-2-7B-hf

Updated 4d ago

Evaluation Results

Method
LLaMA-2-7B-hf 2026.02	78.07	76.02	76.3	46.25	44.2	39.62	80.59	73.88	41.77	61.86
Surrogate-Assisted Layer Contribution Estimation 2026.02	77.09	71.85	71.55	40.96	39.4	36.94	79.12	66.82	36.63	57.82
SLEB 2026.02	76.44	71.8	71.38	39.85	40.8	35.5	78.39	62.16	30.84	56.35
ShortGPT 2026.02	75.73	71.62	71.04	42.92	40.4	38.47	76.92	61.67	35.1	57.09
Shortened-LLaMA 2026.02	74.97	72.98	72.01	43.6	40.4	37.99	82.78	63.01	35.72	58.16
Surrogate-Assisted Layer Contribution Estimation 2026.02	73.72	67.19	64.73	37.29	38.6	36.46	75.46	47.39	29.55	52.27
SLEB 2026.02	73.01	66.56	67	39.51	38.8	35.02	73.99	44.77	23.78	51.38
Shortened-LLaMA 2026.02	70.95	65.28	59.34	37.97	37.4	33.3	76.92	47.47	25.89	50.5
ShortGPT 2026.02	70.95	65.28	59.34	37.97	37.4	33.3	76.92	47.47	25.89	50.5
Surrogate-Assisted Layer Contribution Estimation 2026.02	70.46	58.4	58.21	34.04	36	33.01	70.33	34.27	27.25	46.89
SLEB 2026.02	69.1	56.4	59.47	32.51	35.2	32.63	68.5	31.34	23.72	45.43
SliceGPT 2026.02	66.76	52.99	46.63	30.2	31.4	33.97	80.22	31.52	25	44.3
Surrogate-Assisted Layer Contribution Estimation 2026.02	66.59	46.18	49.37	28.76	32.6	29.89	61.17	17.31	23.7	39.51
Shortened-LLaMA 2026.02	64.85	56.17	48.02	32.76	32.8	32.25	71.43	29.15	38.11	45.06
ShortGPT 2026.02	64.85	56.17	48.02	32.76	32.8	32.25	71.43	29.15	38.11	45.06
SLEB 2026.02	61.86	46.65	44.91	30.2	31	30.24	57.88	15.27	25.07	38.12
SliceGPT 2026.02	60.77	42.7	35.9	27.56	27	30.81	74.73	23.95	24.41	38.65
Shortened-LLaMA 2026.02	60.23	44.3	36.11	30.63	27.6	29.09	60.81	5.05	33.73	36.4
ShortGPT 2026.02	59.52	43.71	41.58	30.03	35	29	68.86	11	33.32	39.11
SliceGPT 2026.02	58.87	38.56	32.45	26.19	27	29.47	72.53	18.46	24.52	36.45
SliceGPT 2026.02	57.18	34.75	30.77	25	25.6	27.75	69.23	14.5	24.93	34.41