Share your thoughts, 1 month free Claude Pro on usSee more

Science Question Answering on SciQ

97.7Normalized Accuracy

HPTQ

Updated 1mo ago

Evaluation Results

Method	Links
HPTQ 2025.07		97.7
BF16 Baseline 2025.07		97.3
GPTQ 2025.07		97.2
SSQR-2% 2025.07		97.2
SSQR-5% 2025.07		97.2
Llama 3-8B E8T2 2024.12		97
SSQR-5% 2025.07		97
HPTQ 2025.07		96.9
SSQR-1% 2025.07		96.9
SSQR-3% 2025.07		96.9
SSQR-4% 2025.07		96.9
SSQR-3% 2025.07		96.6
SSQR-4% 2025.07		96.5
SSQR-2% 2025.07		96.4
SSQR-1% 2025.07		96.3
BF16 Baseline 2025.07		95.7
SSQR-1% 2025.07		95.7
HPTQ 2025.07		95.6
SSQR-3% 2025.07		95.6
SSQR-1% 2025.07		95.6
GPTQ 2025.07		95.5
SSQR-1% 2025.07		95.5
SSQR-2% 2025.07		95.5
SSQR-5% 2025.07		95.5
HPTQ 2025.07		95.5
GPTQ 2025.07		95.5
SSQR-4% 2025.07		95.5
HPTQ 2025.07		95.4
BF16 Baseline 2025.07		95.4
SSQR-3% 2025.07		95.4
GPTQ 2025.07		95.3
SSQR-4% 2025.07		95.3
SSQR-5% 2025.07		95.3
SSQR-5% 2025.07		95.3
Qwen2.5-7B 2026.02		95.2
Qwen2.5-3B 2026.02		95.2
SSQR-1% 2025.07		95.2
SSQR-5% 2025.07		95.2
SSQR-2% 2025.07		95.2
SSQR-2% 2025.07		95.1
SSQR-4% 2025.07		95.1
HPTQ 2025.07		95
SSQR-3% 2025.07		95
OLMoE-1B-7B 2026.02		94.9
SSQR-4% 2025.07		94.9
RTN 2025.07		94.5
SSQR-2% 2025.07		94.4
SSQR-3% 2025.07		94.3
HRTN 2025.07		94.2
GPTQ 2025.07		94
Llama 3-8B 2024.12		93.9
TSD-KD 2026.02		93.8
HRTN 2025.07		93.7
Qwen2.5-1.5B 2026.02		93.4
TSD-KD 2026.02		93
Llama-3.2-3B 2026.02		92.7
ExpertWeaver-E64-A14-S2(OLMo-7B) 2026.02		91.8
SSQR-5% 2025.07		91.5
HPTQ 2025.07		90.8
SSQR-5% 2025.07		90.8
SSQR-3% 2025.07		90.5
SSQR-4% 2025.07		90.1
HPTQ 2025.07		89.9
SSQR-4% 2025.07		89.5
LLaMA-MoE-v2-3.5B 2026.02		88.8
SSQR-5% 2025.07		88.7
OLMo-7B 2026.02		88.6
OLMoE-1B-7B* 2026.02		88.5
Open-LLaMA-3B-v2 2026.02		88
PDPC 2025.01		87.9
Sequence-Level KD 2026.02		87.9
Sequence-Level KD 2026.02		87.9
Preference CL 2025.01		87.8
Preference CL 2025.01		87.8
ExpertWeaver-E64-A14-S2(Qwen2.5-7B) 2026.02		87.7
LLaMA-MoE-v1-3.5B 2026.02		87.6
Sheared-LLaMA-2.7B 2026.02		87.5
Sequential 2025.01		87.1
RTN 2025.07		87.1
HPTQ 2025.07		86.8
Speculative KD 2026.02		86.7
Speculative KD 2026.02		86.7
Supervised-KD 2026.02		86.6
GKD 2026.02		86.6
Supervised-KD 2026.02		86.6
GKD 2026.02		86.6
SSQR-3% 2025.07		86.4
Qwen2.5-14B (Teacher) 2026.02		86.4
Qwen2.5-14B 2026.02		86.4
Sequential 2025.01		86.2
Preference CL 2025.01		86.2
Preference CL 2025.01		86.2
Random 2025.01		85.8
DistiLLM 2026.02		85.7
DistiLLM 2026.02		85.7
INCITE-Base-3B 2026.02		85.6
Preference CL 2025.01		85.5
Qwen2.5-1.5B (Student) 2026.02		85.5
Qwen2.5-1.5B 2026.02		85.5
Sequential 2025.01		85.4

Showing 100 of 137 rows