Multi-Instance Partial-Label Learning with Margin Adjustment
About
Multi-instance partial-label learning (MIPL) is an emerging learning framework where each training sample is represented as a multi-instance bag associated with a candidate label set. Existing MIPL algorithms often overlook the margins for attention scores and predicted probabilities, leading to suboptimal generalization performance. A critical issue with these algorithms is that the highest prediction probability of the classifier may appear on a non-candidate label. In this paper, we propose an algorithm named MIPLMA, i.e., Multi-Instance Partial-Label learning with Margin Adjustment, which adjusts the margins for attention scores and predicted probabilities. We introduce a margin-aware attention mechanism to dynamically adjust the margins for attention scores and propose a margin distribution loss to constrain the margins between the predicted probabilities on candidate and non-candidate label sets. Experimental results demonstrate the superior performance of MIPLMA over existing MIPL algorithms, as well as other well-established multi-instance learning algorithms and partial-label learning algorithms.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Classification | FMNIST-MIPL r=1 (test) | Accuracy91.53 | 12 | |
| Classification | SIVAL-MIPL r=3 (test) | Accuracy62.73 | 12 | |
| Classification | FMNIST-MIPL r=2 (test) | Accuracy86.67 | 12 | |
| Classification | SIVAL-MIPL r=2 (test) | Accuracy66.82 | 12 | |
| Classification | C-Row | Accuracy44.37 | 12 | |
| Classification | C-SBN | Accuracy52.46 | 12 | |
| Classification | SIVAL-MIPL r=1 (test) | Accuracy70.33 | 12 | |
| Classification | Birdsong-MIPL r=2 (test) | Accuracy76.15 | 12 | |
| Classification | Birdsong-MIPL r=3 (test) | Accuracy74.56 | 12 | |
| Classification | C-KMeans | Accuracy55.78 | 12 |