PseudoClick: Interactive Image Segmentation with Click Imitation
About
The goal of click-based interactive image segmentation is to obtain precise object segmentation masks with limited user interaction, i.e., by a minimal number of user clicks. Existing methods require users to provide all the clicks: by first inspecting the segmentation mask and then providing points on mislabeled regions, iteratively. We ask the question: can our model directly predict where to click, so as to further reduce the user interaction cost? To this end, we propose {\PseudoClick}, a generic framework that enables existing segmentation networks to propose candidate next clicks. These automatically generated clicks, termed pseudo clicks in this work, serve as an imitation of human clicks to refine the segmentation mask.
Qin Liu, Meng Zheng, Benjamin Planche, Srikrishna Karanam, Terrence Chen, Marc Niethammer, Ziyan Wu• 2022
Related benchmarks
| Task | Dataset | Result | Rank | |
|---|---|---|---|---|
| Interactive Segmentation | Berkeley | NoC@902.08 | 230 | |
| Interactive Segmentation | GrabCut | NoC@901.5 | 225 | |
| Interactive Segmentation | DAVIS | NoC@905.11 | 197 | |
| Interactive Segmentation | SBD | NoC @ 90% Target5.4 | 171 | |
| Interactive Segmentation | Pascal VOC | NoC@851.94 | 43 | |
| Interactive Image Segmentation | GrabCut | NoC@901.5 | 28 | |
| Interactive Image Segmentation | DAVIS | NoC @ 90% IoU5.11 | 27 | |
| Interactive Image Segmentation | SBD | NoC905.54 | 16 | |
| Interactive Image Segmentation | SBD (val) | NoC @ 853.38 | 12 | |
| Interactive Segmentation | Semantic Boundaries Dataset (SBD) (test) | NoC @ 85%3.46 | 12 |
Showing 10 of 12 rows