Share your thoughts, 1 month free Claude Pro on usSee more

Zero-shot Evaluation on ARC (C/E), HellaSwag, LAMBADA (OpenAI/Standard), PIQA, and WinoGrande

76.71Accuracy (0-shot)

FP16

Updated 1mo ago

Evaluation Results

Method	Links
FP16 2026.06		76.71
TWLA 2026.06		73.6
TWLA 2026.06		73.45
FP16 2026.06		72.51
FP16 2026.06		72.47
FP16 2026.06		72.42
FP16 2026.06		72.19
TWLA 2026.06		71.1
TWLA 2026.06		69.54
FP16 2026.06		69.49
FP16 2026.06		69.09
QuaRot 2026.06		68.79
TWLA 2026.06		68.48
TWLA 2026.06		68.13
QuaRot 2026.06		67.97
TWLA 2026.06		67.7
TWLA 2026.06		67.29
TWLA 2026.06		66.88
TWLA 2026.06		65.25
SliM-LLM 2026.06		64.79
TWLA 2026.06		64.3
PB-LLM 2026.06		63.92
TWLA 2026.06		62.98
TWLA 2026.06		62.91
PT2-LLM 2026.06		62.47
TWLA 2026.06		62.05
TWLA 2026.06		62
TWLA 2026.06		61.98
TWLA 2026.06		61.44
TWLA 2026.06		59.03
TWLA 2026.06		58
ResQ 2026.06		57.81
PT2-LLM 2026.06		56.54
ResQ 2026.06		56.49
ResQ 2026.06		56.43
TWLA 2026.06		55.23
QuaRot 2026.06		53.64
SliM-LLM 2026.06		52.43
SliM-LLM 2026.06		52
ResQ 2026.06		51.84
PB-LLM 2026.06		51.45
ResQ 2026.06		51.18
PB-LLM 2026.06		50.88
PT2-LLM 2026.06		50.82
TWLA 2026.06		50.42
QuaRot 2026.06		49.3
SliM-LLM 2026.06		48.96
PT2-LLM 2026.06		48.96
SliM-LLM 2026.06		48.1
QuaRot 2026.06		47.95
ResQ 2026.06		47.57
PT2-LLM 2026.06		46.35
GPTQ 2026.06		45.59
ResQ 2026.06		45.23
PB-LLM 2026.06		44.8
SliM-LLM 2026.06		43.32
PT2-LLM 2026.06		42.82
PB-LLM 2026.06		40.89
QuaRot 2026.06		39.42
SliM-LLM 2026.06		39.13
ResQ 2026.06		39.12
PT2-LLM 2026.06		39.04
PT2-LLM 2026.06		38.61
PB-LLM 2026.06		38.43
GPTQ 2026.06		38.18
SliM-LLM 2026.06		37.46
PB-LLM 2026.06		37.28
SliM-LLM 2026.06		37.06
QuaRot 2026.06		36.3
PT2-LLM 2026.06		36
GPTQ 2026.06		35.89
QuaRot 2026.06		35.66
QuaRot 2026.06		35.51
QuaRot 2026.06		35.22
PB-LLM 2026.06		31.67
SliM-LLM 2026.06		31.41
GPTQ 2026.06		31.15
QuaRot 2026.06		30.83
PT2-LLM 2026.06		30.81
PB-LLM 2026.06		30.6
PB-LLM 2026.06		30.28
PB-LLM 2026.06		29.32
GPTQ 2026.06		29.25
PB-LLM 2026.06		29.23
GPTQ 2026.06		29.09
PT2-LLM 2026.06		29.07
PB-LLM 2026.06		29.01
GPTQ 2026.06		28.61
GPTQ 2026.06		27.94
QuaRot 2026.06		27.69
SliM-LLM 2026.06		27.49
PT2-LLM 2026.06		27.31
GPTQ 2026.06		27.21
SliM-LLM 2026.06		27.15
GPTQ 2026.06		26.76
GPTQ 2026.06		26.65
PB-LLM 2026.06		26.61
PB-LLM 2026.06		26.46
SliM-LLM 2026.06		26.44
GPTQ 2026.06		26.38

Showing 100 of 123 rows