Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

Delving into the Cyclic Mechanism in Semi-supervised Video Object Segmentation

About

In this paper, we address several inadequacies of current video object segmentation pipelines. Firstly, a cyclic mechanism is incorporated to the standard semi-supervised process to produce more robust representations. By relying on the accurate reference mask in the starting frame, we show that the error propagation problem can be mitigated. Next, we introduce a simple gradient correction module, which extends the offline pipeline to an online method while maintaining the efficiency of the former. Finally we develop cycle effective receptive field (cycle-ERF) based on gradient correction to provide a new perspective into analyzing object-specific regions of interests. We conduct comprehensive experiments on challenging benchmarks of DAVIS17 and Youtube-VOS, demonstrating that the cyclic mechanism is beneficial to segmentation quality.

Yuxi Li, Ning Xu, Jinlong Peng, John See, Weiyao Lin• 2020

Related benchmarks

TaskDatasetResultRank
Video Object SegmentationDAVIS 2017 (val)
J mean69.3
1130
Video Object SegmentationYouTube-VOS 2018 (val)
J Score (Seen)71.7
493
Video Object SegmentationYouTube-VOS (val)
J Score (Seen)72.2
81
Video Object SegmentationDAVIS 17 (test-dev)
Jaccard Index (J)55.3
13
Showing 4 of 4 rows

Other info

Follow for update