Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

REMISVFU: Vertical Federated Unlearning via Representation Misdirection for Intermediate Output Feature

About

Data-protection regulations such as the GDPR grant every participant in a federated system a right to be forgotten. Federated unlearning has therefore emerged as a research frontier, aiming to remove a specific party's contribution from the learned model while preserving the utility of the remaining parties. However, most unlearning techniques focus on Horizontal Federated Learning (HFL), where data are partitioned by samples. In contrast, Vertical Federated Learning (VFL) allows organizations that possess complementary feature spaces to train a joint model without sharing raw data. The resulting feature-partitioned architecture renders HFL-oriented unlearning methods ineffective. In this paper, we propose REMISVFU, a plug-and-play representation misdirection framework that enables fast, client-level unlearning in splitVFL systems. When a deletion request arrives, the forgetting party collapses its encoder output to a randomly sampled anchor on the unit sphere, severing the statistical link between its features and the global model. To maintain utility for the remaining parties, the server jointly optimizes a retention loss and a forgetting loss, aligning their gradients via orthogonal projection to eliminate destructive interference. Evaluations on public benchmarks show that REMISVFU suppresses back-door attack success to the natural class-prior level and sacrifices only about 2.5% points of clean accuracy, outperforming state-of-the-art baselines.

Wenhan Wu, Zhili He, Huanghuang Liang, Yili Gong, Jiawei Jiang, Chuang Hu, Dazhao Cheng• 2025

Related benchmarks

TaskDatasetResultRank
Membership Inference AttackCIFAR10
Balanced Accuracy52.5
19
Vertical Federated UnlearningMNIST
Clean Accuracy90.22
7
Vertical Federated UnlearningFashion MNIST
Clean Accuracy87.08
7
Vertical Federated UnlearningSVHN
Clean Accuracy67.56
7
Vertical Federated UnlearningCIFAR-100
Clean Accuracy25.72
7
Vertical Federated UnlearningCIFAR-10
Clean Accuracy58.45
7
Membership Inference AttackCIFAR-100--
6
Membership Inference AttackMNIST
AUC0.854
5
Membership Inference AttackFashion MNIST
AUC0.697
5
Membership Inference AttackSVHN
AUC0.684
5
Showing 10 of 10 rows

Other info

Follow for update