Share your thoughts, 1 month free Claude Pro on usSee more

Common-sense Reasoning on 5 common-sense reasoning tasks Llama-3-8B

87.07Average Accuracy

FULL-SFT

Updated 23d ago

Evaluation Results

Method
FULL-SFT 2025.12	87.07	82.94	92.68	74.98	96.71	89.4	90.26	83.21	86.11
AFA-DORA 2025.12	86.34	80.97	91.62	75.56	95.9	88.4	89.11	82.59	86.58
AFA-LoRA 2025.12	86.16	81.14	91.33	75.44	95.71	88.4	88.68	81.53	87.06
AFA-DORA 2025.12	86.14	81.48	91.58	76.17	95.66	86.8	89	81.42	86.97
AFA-DORA 2025.12	86.13	81.65	91.07	76.6	95.7	87	88.57	81.26	87.21
AFA-DORA 2025.12	86.08	80.2	91.07	75.99	96.05	87.6	89.33	81.16	87.21
AFA-LoRA 2025.12	86.03	81.66	91.46	74.8	95.66	87.2	89.06	81.99	86.42
AFA-LoRA 2025.12	85.89	80.72	91.41	75.08	95.87	86.4	89.17	81.06	87.37
AFA-LoRA 2025.12	85.75	79.78	91.25	75.6	96.03	86.8	88.52	81.37	86.66
AFA-LoRA 2025.12	85.74	81.23	91.41	75.57	95.72	86	88.08	81.93	85.95
AFA-LoRA 2025.12	85.72	80.38	90.91	74.95	96.11	87.4	88.52	80.04	87.45
AFA-LoRA 2025.12	85.69	80.29	90.82	75.96	95.74	87.2	89.06	80.6	85.87
AFA-DORA 2025.12	85.63	79.69	91.25	75.93	95.8	86.4	88.74	80.45	86.74
AFA-DORA 2025.12	85.61	80.37	91.07	75.19	95.23	85.6	89.11	81.11	87.21
AFA-DORA 2025.12	85.61	79.52	90.74	75.35	95.75	85.4	89.88	81.21	87.05
LoRA Baseline 2025.12	85.57	80.03	90.99	74.56	96.03	87	88.63	81.17	86.11
DORA Baseline 2025.12	85.45	80.46	90.45	75.66	95.77	85	87.92	81.06	87.29
ZO-Act 2026.07	70.8	68.7	85.9	64.7	76.4	65.6	79.6	67.3	58.4
FP16 2024.07	68.58	-	-	-	-	-	-	-	-
AGZO 2026.07	68.2	65	83.3	64.5	70.7	60.8	79.9	63.5	57.7
EfficientQAT 2024.07	67.35	-	-	-	-	-	-	-	-
ZO-Act 2026.07	65.7	60.5	80.3	62.2	69.9	60.2	77	61.8	53.5
AWQ 2024.07	64.82	-	-	-	-	-	-	-	-
HiZOO 2026.07	64.1	60.3	79.6	63.6	65.6	58.2	73.1	58.6	53.5
OmniQ 2024.07	64.09	-	-	-	-	-	-	-	-
SubZero 2026.07	63.9	60.2	78.3	62.5	68	53.6	76.7	59.2	52.6
ZO-Muon 2026.07	63.1	61.4	78	63	63.6	50.8	76.7	57.3	53.6
EfficientQAT 2024.07	60.76	-	-	-	-	-	-	-	-
GPTQ 2024.07	60.58	-	-	-	-	-	-	-	-
EfficientQAT 2024.07	59.37	-	-	-	-	-	-	-	-
RTN 2024.07	58.72	-	-	-	-	-	-	-	-
LOZO 2026.07	57.6	51.9	69.6	62.6	48.3	53	70.2	54.5	50.6
OmniQ 2024.07	52.66	-	-	-	-	-	-	-	-
DB-LLM 2024.07	51.74	-	-	-	-	-	-	-	-
Zero-shot 2026.07	21.2	10	12.5	61.9	12.3	23.4	47.4	2.2	0