Share your thoughts, 1 month free Claude Pro on usSee more

Multiple Choice Classification on MMLU

100Accuracy

Llama-Guard-3-8B

Updated 1d ago

Evaluation Results

Method	Links
Llama-Guard-3-8B 2026.05		100
EvoSafety (Guard)-3B 2026.05		99.47
EvoSafety+ (Guard)-3B 2026.05		99.47
WildGuard-7B 2026.05		99.12
Qwen3Guard-8B 2026.05		99.12
Task Calibration 2026.05		89.72
Task Calibration 2026.05		88.34
Task Calibration 2026.05		83.07
Beam 2026.05		80.27
Contrastive 2026.05		80.27
Ancestral 2026.05		80.11
Greedy 2026.05		80.11
MBR 2026.05		80.11
Beam 2026.05		80
Contrastive 2026.05		79.44
MBR 2026.05		78.48
Beam 2026.05		77.92
MBR 2026.05		77.92
Ancestral 2026.05		77.91
Ancestral 2026.05		77.47
Greedy 2026.05		77.24
Greedy 2026.05		77.02
Contrastive 2026.05		76.68
Task Calibration 2026.05		67.11
UAD 2026.05		65.43
DeLask 2026.05		65.43
Regular 2026.05		65.25
MBR 2026.05		64.56
ITI 2026.05		64.28
Beam 2026.05		62.61
Greedy 2026.05		62.61
Ancestral 2026.05		61.87
Contrastive 2026.05		61.64
DOLA 2026.05		61.36
AD 2026.05		60.69
QFoRA 2026.05		52.1
QDoRA 2026.05		46.8
AD 2026.05		45.9
ITI 2026.05		45.85
Regular 2026.05		45.54
DeLask 2026.05		45.47
UAD 2026.05		45.24
DOLA 2026.05		43.57
QLoRA 2026.05		41
QDoRA 2026.05		39.9
QFoRA 2026.05		38.9
QLoRA 2026.05		38.7