Our new X account is live! Follow @wizwand_team for updates
WorkDL logo mark

PseudoClick: Interactive Image Segmentation with Click Imitation

About

The goal of click-based interactive image segmentation is to obtain precise object segmentation masks with limited user interaction, i.e., by a minimal number of user clicks. Existing methods require users to provide all the clicks: by first inspecting the segmentation mask and then providing points on mislabeled regions, iteratively. We ask the question: can our model directly predict where to click, so as to further reduce the user interaction cost? To this end, we propose {\PseudoClick}, a generic framework that enables existing segmentation networks to propose candidate next clicks. These automatically generated clicks, termed pseudo clicks in this work, serve as an imitation of human clicks to refine the segmentation mask.

Qin Liu, Meng Zheng, Benjamin Planche, Srikrishna Karanam, Terrence Chen, Marc Niethammer, Ziyan Wu• 2022

Related benchmarks

TaskDatasetResultRank
Interactive SegmentationBerkeley
NoC@902.08
230
Interactive SegmentationGrabCut
NoC@901.5
225
Interactive SegmentationDAVIS
NoC@905.11
197
Interactive SegmentationSBD
NoC @ 90% Target5.4
171
Interactive SegmentationPascal VOC
NoC@851.94
43
Interactive Image SegmentationGrabCut
NoC@901.5
28
Interactive Image SegmentationDAVIS
NoC @ 90% IoU5.11
27
Interactive Image SegmentationSBD
NoC905.54
16
Interactive Image SegmentationSBD (val)
NoC @ 853.38
12
Interactive SegmentationSemantic Boundaries Dataset (SBD) (test)
NoC @ 85%3.46
12
Showing 10 of 12 rows

Other info

Follow for update