Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

SMOTE and Mirrors: Exposing Privacy Leakage from Synthetic Minority Oversampling

About

The Synthetic Minority Over-sampling Technique (SMOTE) is one of the most widely used methods for addressing class imbalance and generating synthetic data. Despite its popularity, little attention has been paid to its privacy implications; yet, it is used in the wild in many privacy-sensitive applications. In this work, we conduct the first systematic study of privacy leakage in SMOTE: we begin by showing that prevailing evaluation practices, i.e., naive distinguishing and distance-to-closest-record metrics, completely fail to detect any leakage and that membership inference attacks (MIAs) can be instantiated with high accuracy. Then, by exploiting SMOTE's geometric properties, we build two novel attacks with very limited assumptions: DistinSMOTE, which perfectly distinguishes real from synthetic records in augmented datasets, and ReconSMOTE, which reconstructs real minority records from synthetic datasets with perfect precision and recall approaching one under realistic imbalance ratios. We also provide theoretical guarantees for both attacks. Experiments on eight standard imbalanced datasets confirm the practicality and effectiveness of these attacks. Overall, our work reveals that SMOTE is inherently non-private and disproportionately exposes minority records, highlighting the need to reconsider its use in privacy-sensitive applications and as a baseline for assessing the privacy of modern generative models.

Georgi Ganev, Reza Nazari, Rees Davison, Amir Dizche, Xinmin Wu, Ralph Abbey, Jorge Silva, Emiliano De Cristofaro• 2025

Related benchmarks

TaskDatasetResultRank
Membership Inference AttackAbalone--
10
Privacy AttackEight standard imbalanced datasets (Augmented Data)
Precision100
2
Privacy Attack Evaluationecoli
Precision100
2
Privacy Attack Evaluationcar_eval 34
Precision100
2
Privacy Attack Evaluationsolar_flare m0
Precision100
2
Privacy Attack Evaluationcar_eval 4
Precision100
2
Privacy Attack Evaluationyeast me2
Precision100
2
Privacy Attack EvaluationMammography
Precision100
2
Privacy Attack Evaluationabalone 19
Precision99
2
Privacy AttackEight standard imbalanced datasets Synthetic Data--
1
Showing 10 of 14 rows

Other info

Follow for update