Share your thoughts, 1 month free Claude Pro on usSee more

Multi-hop Knowledge Editing on MQuAKE-3K

99.17Average Performance

Base

Updated 1mo ago

Evaluation Results

Method	Links
Base 2025.10		99.17	99.81	97.46	98.14	97.64	-	-	-	-	-	-	-	-	-	-
Base 2025.10		98.42	99.7	95.48	97.51	97.23	-	-	-	-	-	-	-	-	-	-
ACE (AlphaEdit) 2025.10		61.54	62.48	64.76	63.04	51.32	-	-	-	-	-	-	-	-	-	-
ACE (PMET) 2025.10		58.24	60.22	59.48	51.62	47.61	-	-	-	-	-	-	-	-	-	-
ACE (AlphaEdit) 2025.10		49.24	52.91	53.74	39.08	43.82	-	-	-	-	-	-	-	-	-	-
ACE (PMET) 2025.10		46.45	45.26	50.24	36.17	43.29	-	-	-	-	-	-	-	-	-	-
AlphaEdit 2025.10		45.59	54.58	48.62	27.54	27.31	-	-	-	-	-	-	-	-	-	-
AlphaEdit 2025.10		39.27	47.24	37.69	29.59	28.98	-	-	-	-	-	-	-	-	-	-
MEMIT 2025.10		38.58	64.3	16.87	17.25	8.16	-	-	-	-	-	-	-	-	-	-
PMET 2025.10		37.01	49.26	36.3	24.34	17.01	-	-	-	-	-	-	-	-	-	-
ROME 2025.10		35.04	44.51	38.93	17.52	5.06	-	-	-	-	-	-	-	-	-	-
ROME 2025.10		28.79	35.09	32.48	18.97	7.08	-	-	-	-	-	-	-	-	-	-
PMET 2025.10		20.78	28.64	14.08	12.56	11.2	-	-	-	-	-	-	-	-	-	-
MEMIT 2025.10		18.67	29.84	19.18	12.91	4.2	-	-	-	-	-	-	-	-	-	-
FT 2025.10		3.54	4.17	2.63	0	0	-	-	-	-	-	-	-	-	-	-
FT 2025.10		2.18	3.14	2.79	0	0	-	-	-	-	-	-	-	-	-	-
Base 2025.10		-	-	-	-	-	98.42	99.17	99.7	95.48	97.51	97.23	99.81	97.46	98.14	97.64
FT 2025.10		-	-	-	-	-	3.54	2.18	4.17	2.63	0	0	3.14	2.79	0	0
ROME 2025.10		-	-	-	-	-	35.04	28.79	44.51	38.93	17.52	5.06	35.09	32.48	18.97	7.08
MEMIT 2025.10		-	-	-	-	-	38.58	18.67	64.3	16.87	17.25	8.16	29.84	19.18	12.91	4.2
PMET 2025.10		-	-	-	-	-	37.01	20.78	49.26	36.3	24.34	17.01	28.64	14.08	12.56	11.2
ACE 2025.10		-	-	-	-	-	46.45	58.24	45.26	50.24	36.17	43.29	60.22	59.48	51.62	47.61