Our new X account is live! Follow @wizwand_team for updates

Model Editing on WikiBigEdit

69.5MMLU

LLaMA-3-8B-Instruct

Updated 4d ago

Evaluation Results

Method
LLaMA-3-8B-Instruct 2026.02	69.5	93	91	69.3	50.7	58	73.5	-	-	-	-
LLaMA-3-8B-Instruct 2026.02	69.5	164	161	69.3	50.7	58	73.5	-	-	-	-
FT 2026.02	69.5	233	232	49.4	49.2	42.5	59	-	-	-	-
FT 2026.02	69.5	42	43	49.4	49.2	42.5	59	-	-	-	-
UltraEdit 2026.02	69.3	592	548	67.7	52.4	53.5	74.5	-	-	-	-
UltraEdit 2026.02	69.3	554	520	67.7	52.4	53.5	74.5	-	-	-	-
CrispEdit 2026.02	69.3	770	702	70.5	51.8	55	74	-	-	-	-
CrispEdit 2026.02	69.3	284	305	70.5	51.8	55	74	-	-	-	-
Adam-NSCL 2026.02	69.2	136	136	45.3	50.2	42.5	39	-	-	-	-
Adam-NSCL 2026.02	69.2	34	34	45.3	50.2	42.5	39	-	-	-	-
LocBF-FT 2026.02	69.2	504	467	73.2	52	55.5	73.5	-	-	-	-
LocBF-FT 2026.02	69.2	167	157	73.2	52	55.5	73.5	-	-	-	-
CrispEdit-Seq 2026.02	69.2	667	598	68.8	50.4	53	73	-	-	-	-
CrispEdit-Seq 2026.02	69.2	408	386	68.8	50.4	53	73	-	-	-	-
FT Sequential 2026.02	68.1	134	126	34.5	51.8	43	29.5	-	-	-	-
FT Sequential 2026.02	68.1	18	15	34.5	51.8	43	29.5	-	-	-	-
LoRA 2026.02	67.8	300	258	70.7	55.4	48	75	-	-	-	-
LoRA 2026.02	67.8	270	157	70.7	55.4	48	75	-	-	-	-
LoRA Sequential 2026.02	67.8	209	187	73.8	54.4	48	71	-	-	-	-
LoRA Sequential 2026.02	67.8	79	73	73.8	54.4	48	71	-	-	-	-
UltraEdit 2026.02	62.5	-	-	41.4	44.5	44.5	60	27.5	25.8	53.2	45.5
Adam-NSCL 2026.02	62.3	-	-	36.2	46.4	41.5	33	31.9	28.4	11.6	10.4
Qwen-2.5-1.5B-Instruct 2026.02	61.9	-	-	48.3	50.9	52	58	8.4	8.6	7	6.4
CrispEdit 2026.02	61.2	-	-	38.7	47	45.5	58.5	62.9	52	57.3	46.3
LocBF-FT 2026.02	60.4	-	-	34.8	46.1	43.5	58	76.8	61.9	66	55.2
CrispEdit 2026.02	59.9	-	-	34	47.9	44.5	55	53.4	43.3	83.4	60
AlphaEdit 2026.02	58.5	729	668	61.6	50.2	50.5	58	-	-	-	-
AlphaEdit 2026.02	58.5	739	683	61.6	50.2	50.5	58	-	-	-	-
FT 2026.02	54.3	-	-	30.7	46.2	39.5	52	59.5	50.4	42.2	37
MEMIT 2026.02	24.6	0	0	13.6	52.3	23.5	0	-	-	-	-
MEMIT 2026.02	24.6	0	0	13.6	52.3	23.5	0	-	-	-	-
AlphaEdit 2026.02	24.4	-	-	13.2	48.9	23.5	1	0.7	0.7	1.5	1.3
MEND 2026.02	22.9	0	0	18.2	0	26	0	-	-	-	-
MEND 2026.02	22.9	0	0	18.2	0	26	0	-	-	-	-