Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

SCOPS: Self-Supervised Co-Part Segmentation

About

Parts provide a good intermediate representation of objects that is robust with respect to the camera, pose and appearance variations. Existing works on part segmentation is dominated by supervised approaches that rely on large amounts of manual annotations and can not generalize to unseen object categories. We propose a self-supervised deep learning approach for part segmentation, where we devise several loss functions that aids in predicting part segments that are geometrically concentrated, robust to object variations and are also semantically consistent across different object instances. Extensive experiments on different types of image collections demonstrate that our approach can produce part segments that adhere to object boundaries and also more semantically consistent across object instances compared to existing self-supervised techniques.

Wei-Chih Hung, Varun Jampani, Sifei Liu, Pavlo Molchanov, Ming-Hsuan Yang, Jan Kautz• 2019

Related benchmarks

TaskDatasetResultRank
Landmark Regressionwild CelebA (test)
Mean Normalized L2 Error15.01
17
Landmark DetectionCelebA Wild (K=8) (test)
Normalized L2 Distance (%)15.01
14
Landmark DetectionCUB Category 001 2011 (test)
Normalized L2 Distance18.3
12
Landmark DetectionCUB Category 002 2011 (test)
Normalized L2 Distance17.7
12
CosegmentationiCoseg--
12
Landmark DetectionCelebA Wild (K=4) (test)
Normalized L2 Distance21.76
10
Landmark Regressionunaligned CelebA MAFL (test)
Error (%)15.01
9
Landmark DetectionCUB-003
Normalized L2 Distance0.17
9
Unsupervised Part DiscoveryCUB-200 2011
Kpt Reg Error (CUB-001)18.3
9
Landmark DetectionTaichi (test)
L2 Distance411.4
8
Showing 10 of 27 rows

Other info

Code

Follow for update