Scale-aware multi-level guidance for interactive instance segmentation

by   Soumajit Majumder, et al.

In interactive instance segmentation, users give feedback to iteratively refine segmentation masks. The user-provided clicks are transformed into guidance maps which provide the network with necessary cues on the whereabouts of the object of interest. Guidance maps used in current systems are purely distance-based and are either too localized or non-informative. We propose a novel transformation of user clicks to generate scale-aware guidance maps that leverage the hierarchical structural information present in an image. Using our guidance maps, even the most basic FCNs are able to outperform existing approaches that require state-of-the-art segmentation networks pre-trained on large scale segmentation datasets. We demonstrate the effectiveness of our proposed transformation strategy through comprehensive experimentation in which we significantly raise state-of-the-art on four standard interactive segmentation benchmarks.



page 2

page 3

page 4

page 11

page 12

page 13


Localized Interactive Instance Segmentation

In current interactive instance segmentation works, the user is granted ...

Multi-Stage Fusion for One-Click Segmentation

Segmenting objects of interest in an image is an essential building bloc...

Interactive Object Segmentation with Dynamic Click Transform

In the interactive segmentation, users initially click on the target obj...

Deep GrabCut for Object Selection

Most previous bounding-box-based segmentation methods assume the boundin...

FGN: Fully Guided Network for Few-Shot Instance Segmentation

Few-shot instance segmentation (FSIS) conjoins the few-shot learning par...

Intention-aware Feature Propagation Network for Interactive Segmentation

We aim to tackle the problem of point-based interactive segmentation, in...

Deep Interactive Object Selection

Interactive object selection is a very important research problem and ha...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.