Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

NoT: Federated Unlearning via Weight Negation

About

Federated unlearning (FU) aims to remove a participant's data contributions from a trained federated learning (FL) model, ensuring privacy and regulatory compliance. Traditional FU methods often depend on auxiliary storage on either the client or server side or require direct access to the data targeted for removal-a dependency that may not be feasible if the data is no longer available. To overcome these limitations, we propose NoT, a novel and efficient FU algorithm based on weight negation (multiplying by -1), which circumvents the need for additional storage and access to the target data. We argue that effective and efficient unlearning can be achieved by perturbing model parameters away from the set of optimal parameters, yet being well-positioned for quick re-optimization. This technique, though seemingly contradictory, is theoretically grounded: we prove that the weight negation perturbation effectively disrupts inter-layer co-adaptation, inducing unlearning while preserving an approximate optimality property, thereby enabling rapid recovery. Experimental results across three datasets and three model architectures demonstrate that NoT significantly outperforms existing baselines in unlearning efficacy as well as in communication and computational efficiency.

Yasser H. Khalil, Leo Brunswic, Soufiane Lamghari, Xu Li, Mahdi Beitollahi, Xi Chen• 2025

Related benchmarks

TaskDatasetResultRank
Image ClassificationCIFAR-10 (test)
Accuracy92.18
3381
Image ClassificationFashionMNIST (test)--
363
Image ClassificationCaltech-101
Accuracy15.62
211
Image ClassificationCIFAR-10 (Forget)
Accuracy92.41
63
Machine UnlearningCIFAR-10 1.0 (test)
Test Acc94.67
35
Federated UnlearningCIFAR-10 (test)
Pretrain Accuracy80
26
Federated Multiple Client UnlearningCIFAR-100 Non-IID 10 Clients
Test Accuracy71.4
24
Machine UnlearningCIFAR-100 (10% random data removal)
Retain Accuracy (RA)99.98
21
Machine UnlearningCIFAR-100 50% random data removal
Retain Accuracy99.98
21
Federated UnlearningFashion MNIST (test)
Pre-training Accuracy99.2
20
Showing 10 of 65 rows

Other info

Follow for update