Robust support vector model based on bounded asymmetric elastic net loss for binary classification
About
In this paper, we propose a novel bounded asymmetric elastic net ($L_{baen}$) loss function and combine it with the support vector machine (SVM), resulting in the BAEN-SVM. The $L_{baen}$ is bounded and asymmetric and can degrade to the asymmetric elastic net hinge loss, pinball loss, and asymmetric least squares loss. BAEN-SVM not only effectively handles noise-contaminated data but also addresses the geometric irrationalities in the traditional SVM. By proving the violation tolerance upper bound (VTUB) of BAEN-SVM, we show that the model is geometrically well-defined. Furthermore, we derive that the influence function of BAEN-SVM is bounded, providing a theoretical guarantee of its robustness to noise. The Fisher consistency of the model further ensures its generalization capability. Since the \( L_{\text{baen}} \) loss is non-convex, we designed a clipping dual coordinate descent-based half-quadratic algorithm to solve the non-convex optimization problem efficiently. Experimental results on artificial and benchmark datasets indicate that the proposed method outperforms classical and advanced SVMs, particularly in noisy environments.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Binary Classification | Haberman | Accuracy0.771 | 59 | |
| Binary Classification | fertility | F1-score94.6 | 35 | |
| Binary Classification | SONAR | F1-score92.2 | 28 | |
| Binary Classification | plrx | F1-score83.4 | 28 | |
| Binary Classification | pima | F1-score84.2 | 27 | |
| Binary Classification | blood | F1-score87.8 | 21 | |
| Binary Classification | darwin | F1-score85.2 | 21 | |
| Binary Classification | raisin | F1 Score87.7 | 21 | |
| Binary Classification | darwin | Accuracy77.5 | 21 | |
| Binary Classification | fertility | Accuracy91 | 21 |