Our new X account is live! Follow @wizwand_team for updates

Language Understanding on MMLU (5-shot, test)

74.2Accuracy

FP16

Updated 4d ago

Evaluation Results

Method
FP16 2025.12	74.2	-	-	-	-	-	-
TRT-AWQ 2025.12	72.5	-	-	-	-	-	-
TAO-HQQ 2025.12	72.5	-	-	-	-	-	-
Uniform Regularized Looping 2026.02	72.42	-	-	-	-	-	-
Moving Average Regularized Looping 2026.02	72.23	-	-	-	-	-	-
Noise Ablation 2026.02	72.2	-	-	-	-	-	-
Auto-Align Regularized Looping 2026.02	72.18	-	-	-	-	-	-
Baseline 2026.02	72.17	-	-	-	-	-	-
Gradient 2024.12	70.96	-	-	-	-	-	-
Magnitude 2024.12	70.76	-	-	-	-	-	-
SynFlow 2024.12	70.66	-	-	-	-	-	-
Gradient 2024.12	70.55	-	-	-	-	-	-
FORCE 2024.12	70.53	-	-	-	-	-	-
SNIP 2024.12	70.52	-	-	-	-	-	-
GPTQ 2025.12	70.5	-	-	-	-	-	-
LoRA 2024.12	70.42	-	-	-	-	-	-
UniQL 2025.12	70.3	-	-	-	-	-	-
Magnitude 2024.12	70.12	-	-	-	-	-	-
GRASP 2024.12	69.91	-	-	-	-	-	-
SynFlow 2024.12	69.8	-	-	-	-	-	-
LoRA 2024.12	69.77	-	-	-	-	-	-
Taylor-FO 2024.12	69.1	-	-	-	-	-	-
Fisher-Info 2024.12	69.1	-	-	-	-	-	-
FORCE 2024.12	69.01	-	-	-	-	-	-
SNIP 2024.12	68.75	-	-	-	-	-	-
Taylor-FO 2024.12	68.75	-	-	-	-	-	-
FP16 2025.12	68.39	-	-	-	-	-	-
FP16 2025.12	67.6	-	-	-	-	-	-
UniQL 2025.12	67.5	-	-	-	-	-	-
GRASP 2024.12	66.69	-	-	-	-	-	-
Fisher-Info 2024.12	66.45	-	-	-	-	-	-
FP16 2025.12	65.6	-	-	-	-	-	-
GPTQ 2025.12	64	-	-	-	-	-	-
UniQL 2025.12	63.2	-	-	-	-	-	-
TRT-AWQ 2025.12	63	-	-	-	-	-	-
TAO-HQQ 2025.12	62.9	-	-	-	-	-	-
GPTQ 2025.12	61.5	-	-	-	-	-	-
SVD-LLM 2025.12	61.1	-	-	-	-	-	-
AQLM-1x16 + PV-Tuning 2025.12	60.72	-	-	-	-	-	-
UniQL 2025.12	60.2	-	-	-	-	-	-
UniQL 2025.12	59.9	-	-	-	-	-	-
MoDeGPT 2025.12	59.5	-	-	-	-	-	-
UniQL 2025.12	59.2	-	-	-	-	-	-
AQLM-1x16 2025.12	58.74	-	-	-	-	-	-
CodeGEMM-m1v4g128 + PV-Tuning 2025.12	57.42	-	-	-	-	-	-
UniQL 2025.12	56.9	-	-	-	-	-	-
SVD-LLM 2025.12	56.3	-	-	-	-	-	-
UniQL 2025.12	56.1	-	-	-	-	-	-
UniQL 2025.12	55.9	-	-	-	-	-	-
CodeGEMM-m2v8g128 + PV-Tuning 2025.12	55.42	-	-	-	-	-	-
AQLM-2x8 + PV-Tuning 2025.12	55.13	-	-	-	-	-	-
Uniform Regularized Looping 2026.02	54.49	-	-	-	-	-	-
Moving Average Regularized Looping 2026.02	54.35	-	-	-	-	-	-
Auto-Align Regularized Looping 2026.02	54.13	-	-	-	-	-	-
Noise Ablation 2026.02	53.97	-	-	-	-	-	-
Baseline 2026.02	53.93	-	-	-	-	-	-
Gradient 2024.12	53.11	-	-	-	-	-	-
Gradient 2024.12	53.11	-	-	-	-	-	-
LoRA 2024.12	53.07	-	-	-	-	-	-
SynFlow 2024.12	53.07	-	-	-	-	-	-
Magnitude 2024.12	53.03	-	-	-	-	-	-
Magnitude 2024.12	52.97	-	-	-	-	-	-
Taylor-FO 2024.12	52.96	-	-	-	-	-	-
SNIP 2024.12	52.89	-	-	-	-	-	-
FORCE 2024.12	52.88	-	-	-	-	-	-
SynFlow 2024.12	52.84	-	-	-	-	-	-
SNIP 2024.12	52.81	-	-	-	-	-	-
Taylor-FO 2024.12	52.81	-	-	-	-	-	-
FORCE 2024.12	52.79	-	-	-	-	-	-
Fisher-Info 2024.12	52.7	-	-	-	-	-	-
UniQL 2025.12	52.7	-	-	-	-	-	-
Fisher-Info 2024.12	52.65	-	-	-	-	-	-
GRASP 2024.12	52.6	-	-	-	-	-	-
UniQL 2025.12	52.6	-	-	-	-	-	-
LoRA 2024.12	52.59	-	-	-	-	-	-
GRASP 2024.12	52.38	-	-	-	-	-	-
SVD-LLM 2025.12	49.9	-	-	-	-	-	-
EfficientQAT 2024.07	49.5	-	-	-	-	-	-
IR-QLoRA 2024.07	49.3	-	-	-	-	-	-
QA-LoRA 2024.07	49.2	-	-	-	-	-	-
QLoRA 2024.07	48.4	-	-	-	-	-	-
EfficientQAT 2024.07	48.2	-	-	-	-	-	-
EfficientQAT 2024.07	48.2	-	-	-	-	-	-
VeLoRA 2024.05	48	8.48	-	-	-	-	-
QLoRA w/ GPTQ 2024.07	48	-	-	-	-	-	-
QLoRA 2024.05	47.5	9.91	-	-	-	-	-
PEQA 2024.07	47.4	-	-	-	-	-	-
LoRA w/ Float4 2024.05	47.3	9.91	-	-	-	-	-
QA-LoRA 2024.07	47.3	-	-	-	-	-	-
LoRA w/ BFloat16 2024.05	47.2	15.82	-	-	-	-	-
LLaMA 2023.05	46.9	-	-	-	-	-	-
FP16 2024.07	46.3	-	-	-	-	-	-
PEQA 2024.07	46.3	-	-	-	-	-	-
QLoRA w/ GPTQ 2024.07	46.1	-	-	-	-	-	-
LLaMA2-7b 2024.12	45.6	-	43.3	51.6	36.3	52.1	-
CodeGEMM-m1v4g128 2025.12	45.16	-	-	-	-	-	-
PEQA 2024.07	45	-	-	-	-	-	-
VeLoRA 2024.05	43.8	-	-	-	-	-	-
QLoRA 2024.05	43.3	-	-	-	-	-	-
CodeGEMM-m2v8g128 2025.12	42.83	-	-	-	-	-	-

Showing 100 of 153 rows