Share your thoughts, 1 month free Claude Pro on usSee more

Zero-shot Accuracy on ARC Easy

78.2Zero-shot Acc (ARC Easy)

QTIP

Updated 7d ago

Evaluation Results

Method	Links
QTIP 2024.06		78.2
AQLM 2024.06		78
QTIP 2024.06		77.8
FP16 2024.06		77.7
QUIP# 2024.06		77.7
AQLM 2024.06		77.7
QUIP# 2024.06		77.6
AQLM 2024.06		77.3
QUIP# 2024.06		77.1
QTIP 2024.06		76.3
Dense 2024.06		76.3
Dense 2025.10		76.26
QTIP 2024.06		73.6
FP16 2024.06		73.3
AQLM 2024.06		73.3
AQLM 2024.06		72.9
QTIP 2024.06		72.8
QUIP# 2024.06		72.5
QUIP# 2024.06		71.3
QTIP 2024.06		70.8
AQLM 2024.06		70.2
AQLM 2024.06		69.3
FP16 2024.06		69.3
QUIP# 2024.06		69
QTIP 2024.06		68.9
ALPS 2025.10		68.86
QUIP# 2024.06		68.6
SparseGPT 2025.10		68.56
QUIP# 2024.06		68.4
SparseLLM 2025.10		68.35
L-ADMM 2025.10		68.18
QTIP 2024.06		68.1
Wanda 2025.10		67.05
SAFE 2025.10		66.84
AQLM 2024.06		66.8
L-ADMM 2025.10		66.04
PG pruning 2024.06		66.03
QTIP 2024.06		65.6
QUIP# 2024.06		65.3
ALPS 2025.10		65.19
Magnitude 2025.10		64.81
ELSA 2025.10		64.69
SparseGPT 2025.10		64.06
AQLM 2024.06		63.7
SAFE 2025.10		63.43
LLM-Pruner 2024.06		63.42
Wanda-sp 2024.06		63.01
SparseLLM 2025.10		61.91
Magnitude 2025.10		61.87
Wanda 2025.10		61.83
ELSA 2025.10		61.24
Bonsai 2024.06		59.93
PG pruning 2024.06		56.94
SliceGPT 2024.06		53.1
LLM-Pruner 2024.06		48.31
Bonsai 2024.06		48.11
Wanda-sp 2024.06		48.11
TMMFormer 2026.05		43.43
AdamFormer 2026.05		43.39
SliceGPT 2024.06		42.13
AdamWFormer 2026.05		41.88
VanillaTransformer 2026.05		41.67
PG pruning 2024.06		40.11
LLM-Pruner 2024.06		36.48
SliceGPT 2024.06		33.63
Bonsai 2024.06		33.54
Wanda-sp 2024.06		29.12