Share your thoughts, 1 month free Claude Pro on usSee more

Machine Unlearning on TOFU (5%)

86.6Forget Quality

OPT-OUT

Updated 4d ago

Evaluation Results

Method
OPT-OUT 2024.06	86.6	-	-	40.6	-	-	-	-	-	-	-
OPT-OUT 2024.06	86.6	-	-	45.9	-	-	-	-	-	-	-
NPO+RT 2024.06	71.3	-	-	45.9	-	-	-	-	-	-	-
GA+RT 2024.06	46.6	-	-	45.2	-	-	-	-	-	-	-
IDK+RT 2024.06	22.1	-	-	39.3	-	-	-	-	-	-	-
NPO+RT 2024.06	11.2	-	-	46.1	-	-	-	-	-	-	-
DPO+RT 2024.06	1.6	-	-	44.7	-	-	-	-	-	-	-
Retain LLM 2024.06	1	39.3	62	98.1	-	-	-	-	-	-	-
Retain 2026.01	1	-	62.66	-	88.89	66.7	66.96	60.52	46.39	56.24	-
Retain 2026.01	1	-	63.23	-	88.57	61.67	62.16	52.56	52.79	61.27	-
Retain 2026.04	1	-	-	-	-	-	-	-	-	-	-2.29
ECO 2026.04	0.9647	-	-	-	-	-	-	-	-	-	0
ECO 2026.04	0.9647	-	-	-	-	-	-	-	-	-	-0.09
PALU 2026.01	0.9238	-	61.62	-	86.56	65.18	66.17	64.55	48.82	64.47	-
NPO 2026.04	0.7934	-	-	-	-	-	-	-	-	-	-45.12
NPO-KL 2026.04	0.7934	-	-	-	-	-	-	-	-	-	-22.03
ULD 2024.06	0.73	41.2	62	93.4	-	-	-	-	-	-	-
TPO 2026.01	0.7216	-	59.21	-	85.71	59.73	65.22	61.54	46.38	72.86	-
PALU 2026.01	0.7126	-	62.38	-	81.22	59.35	70.3	67.01	47.62	60.69	-
NPO 2024.06	0.68	15.9	19	24.6	-	-	-	-	-	-	-
NPO 2026.01	0.6284	-	59.2	-	81.15	65.74	66.23	61.55	46.13	56.63	-
TPO 2026.01	0.6284	-	58.62	-	79.29	66.21	66.18	59.07	45.15	59.67	-
NPO 2026.01	0.6284	-	60.06	-	85.27	68.03	64.24	62.26	46.08	58.01	-
SimNPO 2026.01	0.6284	-	57.67	-	86.26	64.59	65.14	70.07	47.26	58.86	-
NPO-RT 2026.04	0.6284	-	-	-	-	-	-	-	-	-	-8.38
DPO 2026.01	0.5453	-	55.03	-	69.84	61.55	68.22	51.38	44.16	50.51	-
RELOAD 2026.04	0.5453	-	-	-	-	-	-	-	-	-	-28.7
PDU 2026.01	0.5226	-	57.05	-	81.14	66.21	65.35	60.31	46.31	59.68	-
SimNPO 2026.01	0.4663	-	59.21	-	90.93	73.43	67.07	64.37	41.38	57.76	-
DPO 2026.01	0.4663	-	55.31	-	87.61	63.74	63.2	52.03	47.94	50.76	-
NPO+GD 2024.06	0.46	24.7	44	36.5	-	-	-	-	-	-	-
NPO+KL 2024.06	0.44	24.2	48	40.2	-	-	-	-	-	-	-
GD 2026.01	0.2705	-	55.36	-	80.12	71.53	62.45	53.33	46.01	60.69	-
GA+KL 2024.06	0.14	20.3	35	29.2	-	-	-	-	-	-	-
GA+GD 2024.06	0.11	19.5	33	28.9	-	-	-	-	-	-	-
GA 2024.06	0.05	24.4	37	31.3	-	-	-	-	-	-	-
GD 2026.01	0.0396	-	35.77	-	23.34	64.29	58.39	56.51	44.97	59.58	-
KL Min 2026.04	0.0163	-	-	-	-	-	-	-	-	-	-62.57
Grad Ascent 2026.04	0.0118	-	-	-	-	-	-	-	-	-	-62.57
PDU 2026.01	0.0021	-	51.11	-	48.34	64.98	76	62.17	34.9	63.48	-
DPO 2024.06	0.0001	1.1	2	0.89	-	-	-	-	-	-	-
Offset-GA+KL 2024.06	0.0001	1.2	0	0	-	-	-	-	-	-	-
DPO+KL 2024.06	0	1.1	3	0.93	-	-	-	-	-	-	-
GA 2026.01	0	-	58.38	-	81.82	82.81	55.32	52.79	47.66	61.96	-
DPO+GD 2024.06	0	1.2	2	0.84	-	-	-	-	-	-	-
Offset-DPO+KL 2024.06	0	0	0	0	-	-	-	-	-	-	-
Offset-NPO+KL 2024.06	0	37.3	59	40.9	-	-	-	-	-	-	-
GA 2026.01	0	-	55.8	-	74.23	92.15	53.04	59.19	46.08	54.26	-
Original 2026.01	0	-	62.76	-	85.22	99.78	47.88	49.63	52.98	62.18	-
Original 2026.01	0	-	62.76	-	85.57	99.88	51.13	61.2	45.96	55.21	-
Target LLM 2024.06	0	97.3	62	98.2	-	-	-	-	-	-	-
GA+RT 2024.06	0	-	-	16.6	-	-	-	-	-	-	-
DPO+RT 2024.06	0	-	-	47.7	-	-	-	-	-	-	-
IDK+RT 2024.06	0	-	-	41	-	-	-	-	-	-	-
Original 2026.04	0	-	-	-	-	-	-	-	-	-	0
Grad Diff 2026.04	0	-	-	-	-	-	-	-	-	-	-30.13
Pref Opt 2026.04	0	-	-	-	-	-	-	-	-	-	-14.72
Prompt 2026.04	0	-	-	-	-	-	-	-	-	-	-10.63
ECO 2026.04	0	-	-	-	-	-	-	-	-	-	0