Share your thoughts, 1 month free Claude Pro on usSee more

Reasoning on Reasoning Benchmarks (Zero-shot)

80.79PIQA Accuracy

Meta-Llama-3-8B Dense

Updated 1mo ago

Evaluation Results

Method	Links
Meta-Llama-3-8B Dense 2026.03		80.79	79.17	77.69	53.33	72.85	69.68	45	81.44	69.99
3BASiL-TM 2026.03		78.24	72.59	73.11	47.35	71.98	63.18	42.4	80.49	66.17
3BASiL-TM 2026.03		77.48	69.58	67.21	40.53	71.27	61.37	39.8	79.51	63.34
Hassle-free-SparseGPT 2026.03		77.09	69.95	69.32	41.81	71.27	56.32	40.6	79.39	63.22
3BASiL 2026.03		76.88	72.05	70.16	44.8	72.14	61.01	41.4	80.89	64.92
Hassle-free-ALPS 2026.03		76.82	71.19	71.04	44.45	72.77	56.68	40.2	78.13	63.91
3BASiL 2026.03		76.5	67.61	67.21	40.1	70.24	64.26	38.2	78.29	62.8
OATS 2026.03		75.84	67.6	67.09	41.21	70.88	60.29	38.2	73.61	61.84
Hassle-free-ALPS 2026.03		75.19	67.1	64.44	38.91	69.53	59.93	39.4	78.38	61.61
Hassle-free-SparseGPT 2026.03		74.81	65.04	66.16	38.57	70.09	54.87	38.4	77.71	60.71
3BASiL-TM 2026.03		74.05	61.85	60.73	34.73	65.98	54.51	34.8	76.91	57.94
OATS 2026.03		72.74	60.7	60.86	34.81	65.51	57.76	35.2	68.32	56.99
3BASiL 2026.03		71.06	56.96	57.7	32.59	66.69	54.51	33	66.7	54.9
Hassle-free-ALPS 2026.03		70.62	56.54	54.42	30.12	64.72	55.23	32.8	71.96	54.55
Hassle-free-SparseGPT 2026.03		68.66	51.99	50.97	30.38	63.85	53.07	32	71.31	52.78
OATS 2026.03		63.71	39.48	42.68	24.32	53.91	52.71	28.4	63.98	46.15