Share your thoughts, 1 month free Claude Pro on usSee more

Zero-shot Reasoning on PIQA

80.9PIQA Zero-shot Accuracy

OPTQ

Updated 9d ago

Evaluation Results

Method	Links
OPTQ 2023.07		80.9
QuIP 2023.07		80.9
OPTQ 2023.07		80.52
QuIP 2023.07		80.47
QuIP 2023.07		80.25
Baseline 2026.04		79
Llama2-7B 2026.02		78.6
OPTQ 2023.07		78.56
Dense 2024.06		78.02
COMPOT 2026.02		76.4
PG pruning 2024.06		75.41
QuIP 2023.07		75.08
Bonsai 2024.06		73.94
Nirvana (Ours) 2025.10		73.67
Nirvana-noTrigger 2025.10		73.12
Swift-SVD 2026.04		73
Swift-SVD* 2026.04		73
Gated DeltaNet-H1 2025.10		72.57
SliceGPT 2024.06		72.31
Gated DeltaNet 2025.10		72.25
Gated DeltaNet-H2 2025.10		72.19
Dobi-SVD(w) 2026.04		72
Mamba2 2025.10		71.87
LLM-Pruner 2024.06		71.81
Wanda-sp 2024.06		71.6
Mamba 2025.10		71.32
PG pruning 2024.06		71.11
SVD-LLM(W) 2026.04		71
Samba 2025.10		70.94
DeltaNet 2025.10		70.72
HGRN2 2025.10		70.45
RetNet 2025.10		70.07
Transformer++ 2025.10		70.02
Bonsai 2024.06		68.44
ASVD 2026.04		68
LLM-Pruner 2024.06		67.52
COMPOT 2026.02		67
Swift-SVD* 2026.04		67
Swift-SVD 2026.04		66
SliceGPT 2024.06		65.4
Dobi-SVD 2026.02		65.2
Wanda-sp 2024.06		64.63
Dobi-SVD(w) 2026.04		64
SVD-LLM(W) 2026.04		63
PG pruning 2024.06		61.8
LLM-Pruner 2024.06		59.52
Bonsai 2024.06		59.52
SliceGPT 2024.06		59.47
Dobi-SVD 2026.02		57.3
Swift-SVD* 2026.04		57
Swift-SVD 2026.04		56
COMPOT 2026.02		54.9
Wanda-sp 2024.06		54.3
Dobi-SVD 2026.02		51.9
Dobi-SVD(w) 2026.04		51
OPTQ 2023.07		50.54
SVD-LLM(W) 2026.04		21
ASVD 2026.04		13
FWSVD 2026.04		10
ASVD 2026.04		8
FWSVD 2026.04		5
FWSVD 2026.04		2