Share your thoughts, 1 month free Claude Pro on usSee more

Multitask Language Understanding on MMLU CoT

72.8MMLU (CoT)

FP16

Updated 1mo ago

Evaluation Results

Method	Links
FP16 2025.09		72.8
RTN 2025.09		72.5
GPTQ 2025.09		72.4
RTN 2025.09		72.4
GPTQ 2025.09		71.8
MR-GPTQ 2025.09		69.71
GPTQ+Had 2025.09		69.4
GPTQ+Had128 2025.09		68.9
QAT+Had 2025.09		68.9
RTN 2025.09		68.7
GPTQ 2025.09		68.69
GPTQ 2025.09		68.6
RTN + HT 2025.09		68.59
RTN 2025.09		68.56
QAT 2025.09		68.2
QAT+Had 2025.09		67.6
GPTQ+Had 2025.09		67.2
RTN+Had 2025.09		67
GPTQ+Had128 2025.09		66.8
RTN+Had128 2025.09		66.6
MR-GPTQ 2025.09		65.48
QAT 2025.09		65
RTN+Had128 2025.09		64.5
GPTQ 2025.09		63.74
RTN+Had 2025.09		62.6
RTN 2025.09		62.2
GPTQ 2025.09		61.22
RTN + HT 2025.09		58.44
RTN 2025.09		55.06