Measuring Privacy Risks and Tradeoffs in Financial Synthetic Data Generation
About
We explore the privacy-utility tradeoff of synthetic data generation schemes on tabular financial datasets, a domain characterized by high regulatory risk and severe class imbalance. We consider representative tabular data generators, including autoencoders, generative adversarial networks, diffusion, and copula synthesizers. To address the challenges of the financial domain, we provide novel privacy-preserving implementations of GAN and autoencoder synthesizers. We evaluate whether and how well the generators simultaneously achieve data quality, downstream utility, and privacy, with comparison across balanced and imbalanced input datasets. Our results offer insight into the distinct challenges of generating synthetic data from datasets that exhibit severe class imbalance and mixed-type attributes.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Minority class representation | AD | Minority Class Percentage26.3 | 13 | |
| Minority class representation | CR | Minority Class %40.2 | 13 | |
| Utility Evaluation | CC | Balanced Acc67.3 | 13 | |
| Minority class representation | CC | Minority Class Percentage27.6 | 13 | |
| Minority class representation | GM | Minority Class Percentage0.119 | 13 | |
| Utility Evaluation | AD | Balanced Accuracy78.4 | 13 | |
| Utility Evaluation | GM | Balanced Acc63.3 | 13 | |
| Minority class representation | BM | Minority Class Percentage14.3 | 13 | |
| Utility Evaluation | CR | Balanced Acc55.5 | 13 | |
| Minority class representation | BC | Minority Class Percentage20.7 | 13 |