Share your thoughts, 1 month free Claude Pro on usSee more

Model Editing on CounterFact (Reliability, Generality, Locality)

92Reliability

DAFNet

Updated 1mo ago

Evaluation Results

Method	Links
DAFNet 2024.05		92	86.7	94.3	91
TP 2024.05		91.4	68.6	39	66.3
MEMIT 2024.05		82.3	36.4	30.7	49.8
MEND 2024.05		81.1	67.2	77.1	75.1
TP 2024.05		64.7	32.5	11.6	36.3
DAFNet 2024.05		53.1	38.1	82.3	57.8
MALMEN 2024.05		52.4	42.3	36.6	43.8
DAFNet 2024.05		50.4	35.8	76.9	54.4
TP 2024.05		47.3	17	1.4	21.9
MEMIT 2024.05		45.4	29.3	92.9	55.9
GRACE 2024.05		44.6	28.5	93.4	55.5
ROME 2024.05		41.1	21.8	91.8	51.6
FT 2024.05		34.1	25.4	49.8	36.4
MALMEN 2024.05		15.8	16.4	22.5	18.3
MALMEN 2024.05		15	12.4	25.1	17.5
FT 2024.05		12.9	5.1	1.1	6.4
KN 2024.05		12.3	9.2	67.9	29.8
KE 2024.05		8	2.9	90.3	33.7
FT 2024.05		1.5	0.1	1.7	1.1
GRACE 2024.05		0.3	0.4	0.1	0.3
ROME 2024.05		0.2	0.2	0	0.1
ROME 2024.05		0.2	0.1	0.1	0.1
KN 2024.05		0.1	0.4	1	0.5
MEMIT 2024.05		0.1	0.1	1	0.4
GRACE 2024.05		0.1	0.2	0.1	0.1
KE 2024.05		0	0	0.1	0
MEND 2024.05		0	0	0	0
KN 2024.05		0	0	0	0
KE 2024.05		0	0	0.3	0.1
MEND 2024.05		0	0	0	0