Synthetic Information towards Maximum Posterior Ratio for deep learning on Imbalanced Data
About
This study examines the impact of class-imbalanced data on deep learning models and proposes a technique for data balancing by generating synthetic data for the minority class. Unlike random-based oversampling, our method prioritizes balancing the informative regions by identifying high entropy samples. Generating well-placed synthetic data can enhance machine learning algorithms accuracy and efficiency, whereas poorly-placed ones may lead to higher misclassification rates. We introduce an algorithm that maximizes the probability of generating a synthetic sample in the correct region of its class by optimizing the class posterior ratio. Additionally, to maintain data topology, synthetic data are generated within each minority sample's neighborhood. Our experimental results on forty-one datasets demonstrate the superior performance of our technique in enhancing deep-learning models.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Binary Classification | pima | F1-score77.7 | 27 | |
| Binary Classification | Yeast6 | F1-score74.5 | 7 | |
| Binary Classification | Abalone 9_vs_18 | F1-score77.7 | 6 | |
| Binary Classification | yeast 1_vs_7 | F1-score71 | 3 | |
| Binary Classification | glass 2 | F1 Score73.7 | 3 | |
| Binary Classification | yeast 1 | F1-score71.5 | 3 | |
| Binary Classification | Ecoli 1 | F1-score83.1 | 3 | |
| Binary Classification | Yeast 2_vs_8 | F1-score88.4 | 3 | |
| Binary Classification | Yeast4 | F1 Score79.3 | 3 |