Our new X account is live! Follow @wizwand_team for updates

Zero-shot Classification on PIQA, HellaSwag, LAMBADA, ARC-e, ARC-c, SciQ, Race, MMLU

77.7PIQA

Qwen3 8B

Updated 4d ago

Evaluation Results

Method
Qwen3 8B 2026.02	77.7	74.9	64.1	80.7	56.7	95.7	40.9	73	70.5
ROCKET 2026.02	77.6	72.9	66	75.8	53.9	94.5	41.4	67.2	68.7
CoSpaDi 2026.02	76.5	68	65.6	72.2	48.9	93.2	40.7	60.8	65.7
ROCKET 2026.02	75.1	67.2	68	72.1	47.7	92.9	41.4	62.3	65.8
Llama3.2 1B 2025.09	74.5	63.7	63	60.5	36.2	88.3	37.8	37	57.6
Llama3.2-1B 2026.02	74.5	63.7	63	60.5	36.2	88.3	37.8	37	57.6
SVD-LLM 2026.02	73.8	63.9	62.2	68.7	45.7	90.1	40.5	54.7	62.5
CoSpaDi 2026.02	72.4	60.5	62.6	63.9	41.2	88.4	39.5	51.3	60
ROCKET 2026.02	71	58.7	63.7	65.7	40.4	86.1	41.9	52.3	60
COMPOT 2026.02	70.6	54.6	47.6	52.5	31.1	81.6	35.7	26.7	50.1
SVD-LLM 2026.02	70.4	55.2	53.8	59.3	37.1	87.2	38.4	44.8	55.8
COMPOT† 2026.02	69.7	52.1	42.1	49.9	30.2	81.8	33.9	28.5	48.5
CoSpaDi 2026.02	68.9	49	49.9	49.4	29.9	82	36.8	36.6	50.3
ROCKET 2026.02	68.8	48.4	47.5	54.8	33	81.6	38.5	37.9	51.3
COMPOT 2026.02	67	46.8	37.9	47.1	27.1	77.3	33.1	23.8	45
SVD-LLM 2026.02	66.3	44.6	37.9	45	28.1	77.3	35.3	29.1	45.4
CoSpaDi 2025.09	66.1	42.9	38.4	39.9	26	71.6	31.7	24.8	42.7
CoSpaDi 2026.02	66.1	42.9	38.4	39.9	26	71.6	31.7	24.8	42.7
COMPOT† 2026.02	64.2	41	27.5	39.8	26	73.2	31.4	23.5	40.8
CoSpaDi 2026.02	63.8	39.7	32.4	41.2	26.8	70.4	33.2	28.1	42
COMPOT 2026.02	62.9	37.5	21.3	38	25.3	62.4	30.6	23	37.6
SVD-LLM 2025.09	62.1	36.4	24.4	36	25.1	64.9	29	23	37.6
SVD-LLM 2026.02	62.1	36.4	24.4	36	25.1	64.9	29	23	37.6
SVD-LLM 2026.02	61.5	34.9	25.1	37.4	25.3	65.1	31.6	24	38.1
COMPOT† 2026.02	57	31.1	7.9	31.7	22.1	53	27	23.1	31.6
CoSpaDi 2025.09	56.9	32.4	18.2	31.9	22.1	56.7	28	23.1	33.7
CoSpaDi 2026.02	56.9	32.4	18.2	31.9	22.1	56.7	28	23.1	33.7
SVD-LLM 2025.09	55.7	30.1	9.1	30.5	21.5	45.9	25.8	23.2	30.2
SVD-LLM 2026.02	55.7	30.1	9.1	30.5	21.5	45.9	25.8	23.2	30.2
CoSpaDi 2025.09	53.5	28.2	3.8	27.8	23	36.9	24	23.1	27.5
CoSpaDi 2026.02	53.5	28.2	3.8	27.8	23	36.9	24	23.1	27.5
SVD 2025.09	52.8	25.9	0	23.9	21.3	19.9	22.2	26.9	24.1
SVD 2025.09	52.3	25.6	0	24.2	23.5	19.5	21.9	27	24.3
SVD 2025.09	52	25.7	0	24.7	22.1	20	21.4	25.4	23.9
SVD-LLM 2025.09	51.8	27.3	1.3	26.9	22.9	32.3	24.4	23	26.2
SVD-LLM 2026.02	51.8	27.3	1.3	26.9	22.9	32.3	24.4	23	26.2
CoSpaDi† 2025.09	51.7	26.4	0	25.4	25.3	21	21.8	24.1	24.5
CoSpaDi† 2025.09	51	26.3	0	25.5	26.9	21.3	21.2	25.5	24.7
CoSpaDi† 2025.09	50.5	26.3	0	24.5	26.1	21.8	21.5	25.5	24.5