Share your thoughts, 1 month free Claude Pro on usSee more

Question Answering on QA Suite Zero-shot (PIQA, ARC-E, ARC-C, BoolQ, HellaSwag, WinoGrande)

82.48PIQA Accuracy

SDLLM

Updated 1mo ago

Evaluation Results

Method	Links
SDLLM 2026.04		82.48	79.04	57.76	84.83	82.85	75.22	77.03	8.73	7.85
Qwen2.5-14B 2026.04		82.1	79.12	58.87	85.26	82.91	75.3	77.26	13.53	62.23
SDLLM 2026.04		81.28	80.43	55.29	82.64	81.41	74.82	76.15	2.88	2.59
FP16 2026.04		80.85	77.78	53.41	81.28	79.16	72.84	74.22	-	-
FP16 2026.04		80.85	77.78	53.41	81.28	79.16	72.84	74.22	-	-
LLaMA3-8B 2026.04		80.85	77.78	53.41	81.28	79.16	72.84	74.22	-	-
FP16 2024.06		80.79	58.71	46.24	82.29	80.72	77.5	71.04	-	-
LLaMA2-13B 2026.04		80.63	77.48	49.23	80.73	79.37	71.74	73.2	13.42	61.74
RTN 2026.04		80.41	81.4	56.57	84.19	81.52	71.27	75.89	3.81	17.5
RUQuant 2026.04		80.25	77.44	52.73	80.4	78.99	73.24	73.84	-	-
DuQuant 2026.04		80.2	77.27	52.05	80.12	79.14	72.77	73.59	-	-
DuQuant 2026.04		80.2	77.27	52.05	80.12	79.14	72.77	73.59	-	-
SDLLM 2026.04		80.2	77.23	52.22	82.05	79.01	73.56	74.04	-	-
FP16 2024.06		80.08	58.92	45.47	68.44	79.21	72.53	67.44	-	-
DuQuant+LWC 2024.06		79.98	58.29	44.8	77.89	79.22	72.21	68.73	-	-
DuQuant 2024.06		79.71	57.95	45.05	79.82	78.66	72.29	68.91	-	-
GPTQ 2026.04		79.71	76.85	52.82	80.24	80.11	70.17	73.32	3.81	17.5
SmoothQuant 2026.04		79.33	78.96	55.03	80.89	79.12	68.67	73.66	3.81	17.5
RUQuant 2026.04		79.16	57.74	44.45	67.83	76.45	69.77	65.9	-	-
FP16 2024.06		79.1	59.89	44.45	68.01	76.21	70.31	66.33	-	-
FP16 2025.04		79.05	59.89	44.71	68.47	76.23	70.24	66.43	-	-
FP16 2026.04		79.05	57.91	44.2	69.02	76.6	69.69	66.08	-	-
FP16 2026.04		79.05	57.91	44.2	69.02	76.6	69.69	66.08	-	-
LLAMA2-13B 2026.04		79.05	57.91	44.2	69.02	76.6	69.69	66.08	-	-
SDLLM 2026.04		79.05	57.66	44.2	67.83	76.42	69.93	65.85	-	-
LLaMA2-13B 2026.04		79.05	57.91	44.2	69.02	76.6	69.69	66.08	13.42	61.74
FP16 2025.04		79	57.95	44.28	69.02	76.58	69.69	66.09	-	-
SDLLM 2026.04		79	77.82	52.13	80	78.28	67.8	72.51	1.43	1.29
SmoothQuant 2026.04		78.94	75.88	49.49	77.58	77.39	70.8	71.68	-	-
SmoothQuant 2026.04		78.94	75.88	49.49	77.58	77.39	70.8	71.68	-	-
OmniQuant 2026.04		78.9	73.95	47.35	74.95	76.77	70.56	70.41	-	-
OmniQuant 2026.04		78.9	73.95	47.35	74.95	76.77	70.56	70.41	-	-
LLaMA2-7B 2026.04		78.84	74.54	46.33	77.74	75.97	69.22	70.44	6.91	31.77
QLLM 2026.04		78.78	58.29	43.77	-	75.1	68.43	64.87	-	-
QLLM 2026.04		78.78	58.29	43.77	-	75.1	68.43	64.87	-	-
DuQuant+LWC 2024.06		78.73	56.52	43.17	68.84	77.53	70.96	65.96	-	-
AffineQuant 2026.04		78.73	73.32	46.08	74.59	77.08	70.88	70.11	-	-
DuQuant 2026.04		78.62	56.94	43.43	68.35	76.19	69.22	65.46	-	-
DuQuant 2026.04		78.62	56.94	43.43	68.35	76.19	69.22	65.46	-	-
DuQuant 2024.06		78.56	56.99	42.32	66.73	76.7	69.61	65.15	-	-
RUQuant 2026.04		78.51	56.14	41.98	68.41	73.78	65.98	64.13	-	-
SDLLM 2026.04		78.51	74.12	46.16	78.26	76.36	69.85	70.54	1.4	1.26
AffineQuant 2026.04		78.35	57.58	43.34	66.73	74.71	68.59	64.88	-	-
SmoothQuant 2026.04		78.29	57.41	43.86	69.5	75.02	66.93	65.17	-	-
SmoothQuant 2026.04		78.29	57.41	43.86	69.5	75.02	66.93	65.17	-	-
OS+ 2026.04		78.29	59.13	43.34	-	75.37	67.56	64.74	-	-
OmniQuant 2026.04		78.24	57.58	43.86	71.1	75.52	68.35	65.78	-	-
RUQuant 2026.04		78.24	55.47	41.3	68.2	74.07	67.64	64.15	-	-
OmniQuant 2026.04		78.24	57.58	43.86	71.1	75.52	68.35	65.78	-	-
Atom 2025.04		77.64	58.38	41.81	68.5	73.75	65.98	64.64	-	-
DuQuant+LWC 2024.06		77.64	57.32	41.21	66.79	74.12	65.98	63.84	-	-
QLLM 2026.04		77.48	52.99	39.33	-	71.38	65.98	61.43	-	-
QLLM 2026.04		77.48	52.99	39.33	-	71.38	65.98	61.43	-	-
FP16 2024.06		77.47	52.48	41.46	73.08	73	67.07	64.09	-	-
Atom 2025.04		77.37	56.73	42.32	67.62	74.07	68.27	65.46	-	-
DuQuant 2026.04		77.31	55.6	41.55	66.61	73.68	66.06	63.47	-	-
DuQuant 2026.04		77.31	55.6	41.55	66.61	73.68	66.06	63.47	1.68	7.72
DuQuant 2024.06		77.26	58.04	41.55	67.55	73.62	66.69	64.12	-	-
SDLLM 2026.04		77.26	57.41	41.55	66.67	73.33	66.69	63.82	1.4	1.26
RUQuant 2026.04		77.04	52.97	40.61	70.4	72.71	67.88	63.6	-	-
DuQuant 2026.04		76.99	52.99	40.87	70.4	72.49	67.32	63.51	-	-
DuQuant 2026.04		76.99	52.99	40.87	70.4	72.49	67.32	63.51	-	-
SDLLM 2026.04		76.99	53.75	41.04	70.64	72.84	67.25	63.75	-	-
QuaRot 2025.04		76.93	52.1	40.7	68.1	72.7	62.51	62.99	-	-
RUQuant 2026.04		76.93	70.45	44.97	75.2	73.36	66.14	67.84	-	-
FP16 2026.04		76.88	53.54	40.53	71.13	72.96	67.25	63.72	-	-
FP16 2026.04		76.88	53.54	40.53	71.13	72.96	67.25	63.72	-	-
LLAMA-2-7B 2026.04		76.88	53.54	40.53	71.13	72.96	67.25	63.72	-	-
LLaMA2-7B 2026.04		76.88	53.54	40.53	71.13	72.96	67.25	63.72	6.91	31.77
QuaRot 2025.04		76.61	55.3	41.64	67.09	73.02	65.59	64.24	-	-
OmniQuant 2026.04		76.55	53.83	40.96	68.75	55.89	65.59	60.26	-	-
OmniQuant 2026.04		76.55	53.83	40.96	68.75	55.89	65.59	60.26	-	-
DuQuant 2024.06		76.44	50.04	38.99	70.98	69.39	64.72	61.76	-	-
DuQuant+LWC 2024.06		76.22	50.04	38.31	70.09	69.82	62.59	61.18	-	-
OS+ 2026.04		76.22	52.74	40.7	-	71.89	65.19	61.35	-	-
RUQuant 2026.04		76.12	69.53	42.92	71.93	74.13	67.01	66.94	-	-
RUQuant 2026.04		75.84	52.82	39.51	69.57	70.06	63.61	61.9	-	-
SDLLM 2026.04		75.84	69.65	41.21	74.01	71.75	66.14	66.43	0.75	0.67
SpikeLLM 2026.04		75.79	69.53	41.21	74.31	71.51	65.51	66.31	2.01	9.26
DuQuant 2026.04		75.68	68.48	41.81	71.99	73.07	66.22	66.21	-	-
SmoothQuant 2026.04		75.57	53.62	39.93	69.54	71.76	66.14	62.76	-	-
SmoothQuant 2026.04		75.57	53.62	39.93	69.54	71.76	66.14	62.76	-	-
DuQuant 2026.04		75.24	51.89	36.77	67.86	69.54	62.12	60.57	-	-
DuQuant 2026.04		75.24	51.89	36.77	67.86	69.54	62.12	60.57	0.86	3.97
QuaRot 2026.04		74.86	69.19	41.98	72.54	70.35	64.72	65.61	1.68	7.72
RUQuant 2026.04		74.65	51.18	38.65	68.59	69.65	61.72	60.74	-	-
SDLLM 2026.04		74.54	51.89	38.74	68.81	69	63.54	61.09	0.75	0.67
Atom 2024.06		74.48	51.6	40.61	73.76	73.78	62.12	62.73	-	-
QLLM 2024.06		73.83	50.67	38.4	-	67.91	58.56	57.87	-	-
QLLM 2024.06		73.56	52.06	39.68	-	70.94	62.9	59.83	-	-
SpikeLLM 2026.04		72.47	62.29	36.01	69.48	64.74	59.43	60.74	1.04	4.77
Ours 2025.04		72.09	48.57	34.13	62.54	62.63	64.88	57.47	-	-
Ours 2025.04		71.98	49.92	36.26	65.9	60.52	61.8	57.73	-	-
Atom 2024.06		71.98	49.07	40.02	66.85	70.45	58.64	59.5	-	-
QuaRot 2026.04		71.82	59.89	36.18	67.37	63.88	59.12	59.71	0.86	3.97
OmniQuant 2024.06		71.81	48.02	35.92	73.27	66.81	59.51	59.22	-	-
Atom 2024.06		71.44	47.74	35.49	67.71	63.89	55.01	56.88	-	-
QLLM 2024.06		71.38	47.6	34.3	-	63.7	59.43	55.28	-	-
Atom 2024.06		71.38	49.07	36.69	64.53	68	58.56	58.04	-	-
OmniQuant 2024.06		71.21	49.45	34.47	65.33	64.65	59.19	56.63	-	-

Showing 100 of 141 rows