Share your thoughts, 1 month free Claude Pro on usSee more
WorkDL logo mark

OA-CutMix: Correcting the Label Bias of CutMix

About

CutMix has become the de facto standard mixing augmentation, yet its label assignment rests on a flawed assumption: The area of the pasted patch faithfully reflects its semantic contribution to the mixed image. In practice, however, patches frequently land on background regions, assigning label credit to classes whose objects are not visible. The mean discrepancy of the CutMix label and the semantic object area is $21.5\%$. In $17\%$ of samples an image contributes zero visible object pixels yet receives nonzero label weight. We propose Object-Aware CutMix (OA-CutMix), which corrects this bias by replacing the area-based CutMix weight with one derived from precomputed segmentation masks, assigning labels in proportion to the visible object area each image contributes to the mix. The image mixing procedure is left entirely unchanged. We evaluate OA-CutMix against 10+ static and dynamic mixing methods across 4 architectures and 6 datasets. OA-CutMix consistently achieves the highest accuracy over all tasks, outperforming even dynamic mixing methods, but at a fraction of the training-time cost. Improvements are largest for small objects, where the label bias from CutMix is greatest. Thus, correcting the label is sufficient to match or exceed the performance of methods modifying the image mixing algorithm.

Tobias Christian Nauen, Stanislav Frolov, Federico Raue, Brian B. Moser, Andreas Dengel• 2026

Related benchmarks

TaskDatasetResultRank
Model CalibrationCIFAR-100
ECE1.74
150
Model CalibrationTiny-ImageNet
Expected Calibration Error2.31
92
Model CalibrationImageNet-200
ECE0.68
60
Image ClassificationTinyImageNet
Top-1 Acc64.94
52
Image ClassificationCIFAR-100
Top-1 Accuracy80.58
26
Image ClassificationCIFAR-100
Top-1 Accuracy81.41
26
Showing 6 of 6 rows

Other info

Follow for update