SCOPS: Self-Supervised Co-Part Segmentation
About
Parts provide a good intermediate representation of objects that is robust with respect to the camera, pose and appearance variations. Existing works on part segmentation is dominated by supervised approaches that rely on large amounts of manual annotations and can not generalize to unseen object categories. We propose a self-supervised deep learning approach for part segmentation, where we devise several loss functions that aids in predicting part segments that are geometrically concentrated, robust to object variations and are also semantically consistent across different object instances. Extensive experiments on different types of image collections demonstrate that our approach can produce part segments that adhere to object boundaries and also more semantically consistent across object instances compared to existing self-supervised techniques.
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Landmark Regression | wild CelebA (test) | Mean Normalized L2 Error15.01 | 17 | |
| Landmark Detection | CelebA Wild (K=8) (test) | Normalized L2 Distance (%)15.01 | 14 | |
| Landmark Detection | CUB Category 001 2011 (test) | Normalized L2 Distance18.3 | 12 | |
| Landmark Detection | CUB Category 002 2011 (test) | Normalized L2 Distance17.7 | 12 | |
| Cosegmentation | iCoseg | -- | 12 | |
| Landmark Detection | CelebA Wild (K=4) (test) | Normalized L2 Distance21.76 | 10 | |
| Landmark Regression | unaligned CelebA MAFL (test) | Error (%)15.01 | 9 | |
| Landmark Detection | CUB-003 | Normalized L2 Distance0.17 | 9 | |
| Unsupervised Part Discovery | CUB-200 2011 | Kpt Reg Error (CUB-001)18.3 | 9 | |
| Landmark Detection | Taichi (test) | L2 Distance411.4 | 8 |