Share your thoughts, 1 month free Claude Pro on usSee more

Language Understanding on MMLU (Overall Score)

69MMLU Score

Unpruned

Updated 4d ago

Evaluation Results

Method	Links
Unpruned 2026.04		69
Llama 3.1 8B Instruct 2026.05		68.34
FlexRound+LFQ 2026.05		66.97
FlexRound+RILQ 2026.05		66.86
FlexRound 2026.05		66.19
OmniQuant+RILQ 2026.05		66.07
OmniQuant+LFQ 2026.05		65.48
OmniQuant 2026.05		64.87
Block-AP+RILQ 2026.05		64.62
Block-AP+LFQ 2026.05		63.77
Block-AP 2026.05		63.24
AR 2026.04		52.8
Base model 2026.04		41.3
TIDE-Shared 2026.04		39.92
TIDE-Cross 2026.04		39.59
KL 2026.04		39.57
TIDE-Shared 2026.04		39.54
CALM 2026.04		39.42
SIFT 2026.04		39.2
BD3LM 2026.04		39.15
TIDE-Cross 2026.04		39.09
POME 2026.04		38.7
BLUR 2026.04		37.4
AdamW 2026.04		36.6
Muon 2026.04		36.1
Magnitude (channel) 2026.04		30
SCAR-Prot 2026.04		30
SCAR-LP 2026.04		29
SCAR-Conn 2026.04		29
FLAP (channel) 2026.04		28
Act. L2 2026.04		28
RQ 2026.04		28
Gaussian MI (analytic) 2026.04		28
RIA (channel) 2026.04		27
LLM-Pruner (channel) 2026.04		23
SparseGPT (channel) 2026.04		22
SlimLLM (channel) 2026.04		22
Wanda (channel) 2026.04		21
OWL (channel) 2026.04		21
Random 2026.04		16