Share your thoughts, 1 month free Claude Pro on usSee more

Science Question Answering on ARC Easy (Accuracy)

81.65Accuracy

GEMMA-7B

Updated 5d ago

Evaluation Results

Method	Links
GEMMA-7B 2025.06		81.65
Teacher (GPT-OSS-20B) 2026.05		80.9
LLAMA-2-7B 2025.06		76.35
DEEPSEEK-7B 2025.06		75.25
VICUNA-1.3-7B 2025.06		74.28
MASKLLM 2025.06		69.57
MASKLLM 2025.06		68.1
MaskPro 2025.06		66.74
SPARSEGPT 2025.06		66.37
MaskPro 2025.06		66.12
GBLM 2025.06		65.82
MASKLLM 2025.06		65.57
WANDA 2025.06		65.49
PRUNER-ZERO 2025.06		64.94
SPARSEGPT 2025.06		64.52
MaskPro 2025.06		64.23
GBLM 2025.06		63.17
SPARSEGPT 2025.06		62.92
GBLM 2025.06		62.84
WANDA 2025.06		62.79
PRUNER-ZERO 2025.06		62.33
MAGNITUDE 2025.06		61.87
WANDA 2025.06		61.7
PRUNER-ZERO 2025.06		61.32
X-GRAM-100% 2026.04		61.1
X-GRAM-50% 2026.04		60.9
X-GRAM-50% 2026.04		60.5
X-GRAM-100% 2026.04		59.5
X-GRAM-100% 2026.04		59.1
X-GRAM-100% 2026.04		58.4
X-GRAM-50% 2026.04		58.1
X-GRAM-100% 2026.04		57.7
X-GRAM-50% 2026.04		56.7
X-GRAM-50% 2026.04		56.3
MoRT 2026.04		55.6
MoRT 2026.04		55.1
MAGNITUDE 2025.06		54.92
MAGNITUDE 2025.06		54.59
X-GRAM-100% 2026.04		54
Engram 2026.04		53.5
Engram 2026.04		53.5
Baseline 2026.04		53.2
X-GRAM-50% 2026.04		53
Retoken 2026.04		52.3
Engram 2026.04		51.6
Retoken 2026.04		51.2
Retoken 2026.04		50.7
MoRT 2026.04		49.6
MoRT 2026.04		49.3
Engram 2026.04		49.1
Retoken 2026.04		48.8
Engram 2026.04		48.6
MoRT 2026.04		47.9
MoRT 2026.04		47.9
Retoken 2026.04		47.9
Retoken 2026.04		46.1
Engram 2026.04		43.5
Baseline 2026.04		41.4
DO-ACP 2026.05		36.7
CP 2026.05		36.4
ACP 2026.05		35.6
SF 2026.05		34
ACP 2026.05		33.6
DO-ACP 2026.05		33.5
SF 2026.05		33.3
MaskPro 2025.06		32.92
WANDA 2025.06		32.66
GBLM 2025.06		32.38
CP 2026.05		32.2
SPARSEGPT 2025.06		30.64
Random FFN + teacher attn 2026.05		28.5
MAGNITUDE 2025.06		26.43
Random initialization 2026.05		25.8
MASKLLM 2025.06		25.21
PRUNER-ZERO 2025.06		24.58