Share your thoughts, 1 month free Claude Pro on usSee more

Language Model Unlearning on TOFU (Forget10)

100Forget Quality (FQ)

Retain90

Updated 1mo ago

Evaluation Results

Method
Retain90 2025.09	100	52	43	91	-
GD+Sine 2025.09	94.3	52	22	90	-
ME+GD (LoRA) 2025.09	78.6	52	14	93	-
GD+Tanh 2025.09	34.2	49	28	85	-
before unlearning 2026.05	0.9025	76.03	-	-	88.47
before unlearning 2026.05	0.8122	62.19	-	-	83.64
before unlearning 2026.05	0.5796	52.88	-	-	43.17
NPO 2026.05	0.2139	60.05	-	-	47.12
GA 2026.05	0.1739	57.3	-	-	45.42
RMU 2026.05	0.1715	51.74	-	-	29.65
NPO 2026.05	0.1684	55.97	-	-	49.3
NPO 2026.05	0.1636	47.92	-	-	24.2
GA 2026.05	0.1632	50.74	-	-	41.79
GA 2026.05	0.1425	32.64	-	-	19.63
RMU 2026.05	0.1404	49.27	-	-	23.75
S-GA 2026.05	0.1368	34.58	-	-	28.05
RMU 2026.05	0.1365	58.82	-	-	40.35
WGA 2026.05	0.1328	50.86	-	-	34.18
S-NPO 2026.05	0.1323	56.37	-	-	61.39
S-RMU 2026.05	0.1296	60.42	-	-	54.54
T-RMU 2026.05	0.1273	51.06	-	-	27.19
S-RMU 2026.05	0.1258	50.97	-	-	24.39
T-GA 2026.05	0.1255	35.29	-	-	28.47
WGA 2026.05	0.1255	64.39	-	-	64.18
S-WGA 2026.05	0.1243	52.37	-	-	35.12
S-GA 2026.05	0.1216	60.65	-	-	65.03
T-GA 2026.05	0.1209	63.42	-	-	66.23
S-WGA 2026.05	0.115	60.12	-	-	65.74
T-NPO 2026.05	0.1138	58.12	-	-	63.89
WGA 2026.05	0.1072	58.24	-	-	57.61
S-NPO 2026.05	0.1023	48.21	-	-	27.65
T-NPO 2026.05	0.1004	49.36	-	-	29.85
S-WGA 2026.05	0.0955	65.12	-	-	65.24
T-WGA 2026.05	0.0949	66.5	-	-	67.91
T-WGA 2026.05	0.0923	52.42	-	-	36.14
S-GA 2026.05	0.0917	53.21	-	-	57.22
S-RMU 2026.05	0.0835	59.14	-	-	41.96
T-NPO 2026.05	0.0817	60.89	-	-	65.83
T-RMU 2026.05	0.0814	59.36	-	-	58.39
T-WGA 2026.05	0.0723	60.53	-	-	68.57
T-GA 2026.05	0.0715	57.13	-	-	63
T-RMU 2026.05	0.0709	58.62	-	-	43.38
S-NPO 2026.05	0.0664	55.39	-	-	59.75
NPO 2025.09	0.0026	37	45	45	-
GD+FILA 2025.09	0.0002	0	12	11	-
GD 2025.09	0	36	37	41	-
LoKU 2025.09	0	51	26	75	-
GA 2025.09	0	0	1	1	-
KL 2025.09	0	0	1	1	-
GD+LoRA 2025.09	0	28	85	45	-
DPO 2025.09	0	48	41	67	-
GA+FILA 2025.09	0	0	0	0	-
IHL 2025.09	0	51	53	76	-
Original 2025.09	0	52	93	92	-