Share your thoughts, 1 month free Claude Pro on usSee more

Machine Unlearning on TOFU (10%)

1Forget Quality (FQ)

Retain LLM

Updated 4d ago

Evaluation Results

Method	Links
Retain LLM 2024.06		1	39.8	0.62	98.2	-
Retrained (Oracle) 2026.01		1	-	0.62	-	-
Retain 2026.04		1	-	-	-	-0.016
KIF 2026.01		0.99	-	0.62	-	-
ECO 2026.04		0.9674	-	-	-	-0.0014
RELOAD 2026.04		0.7	-	-	-	-0.3384
ECO 2026.04		0.5812	-	-	-	-0.0028
ULD 2024.06		0.48	42.6	0.62	85.9	-
SimNPO 2026.01		0.45	-	0.62	-	-
NPO+GD 2024.06		0.29	25.7	0.53	41.1	-
NPO 2026.01		0.29	-	0.55	-	-
KL Min 2026.04		0.181	-	-	-	-0.6257
NPO 2024.06		0.09	15.2	0.26	15.3	-
NPO-RT 2026.04		0.0783	-	-	-	-0.126
NPO+KL 2024.06		0.07	18.1	0.32	22.9	-
NPO-KL 2026.04		0.0158	-	-	-	-0.2634
NPO 2026.04		0.0126	-	-	-	-0.4556
GA+GD 2024.06		0.009	19.6	0.17	23.9	-
GA+KL 2024.06		0.0002	12.1	0.05	18.6	-
Offset-NPO+KL 2024.06		0	34.2	0.48	34.8	-
Offset-GA+KL 2024.06		0	3.1	0.04	2.9	-
DPO 2024.06		0	0.7	0	0.72	-
DPO+KL 2024.06		0	0.7	0.03	0.81	-
Offset-DPO+KL 2024.06		0	1.3	0.02	1.4	-
GA 2024.06		0	0	0	0	-
DPO+GD 2024.06		0	0.8	0	0.89	-
IDK (rejection) 2026.01		0	-	0.54	-	-
GradDiff 2026.01		0	-	0.54	-	-
Gradient Ascent 2026.01		0	-	0	-	-
Target LLM 2024.06		0	98.6	0.62	98.2	-
Original 2026.01		0	-	0.62	-	-
Original 2026.04		0	-	-	-	0
Grad Ascent 2026.04		0	-	-	-	-0.6257
Grad Diff 2026.04		0	-	-	-	-0.0434
Pref Opt 2026.04		0	-	-	-	-0.0862
Prompt 2026.04		0	-	-	-	-0.138
ECO 2026.04		0	-	-	-	-0.0022