Localized Interactive Instance Segmentation

by   Soumajit Majumder, et al.

In current interactive instance segmentation works, the user is granted a free hand when providing clicks to segment an object; clicks are allowed on background pixels and other object instances far from the target object. This form of interaction is highly inconsistent with the end goal of efficiently isolating objects of interest. In our work, we propose a clicking scheme wherein user interactions are restricted to the proximity of the object. In addition, we propose a novel transformation of the user-provided clicks to generate a weak localization prior on the object which is consistent with image structures such as edges, textures etc. We demonstrate the effectiveness of our proposed clicking scheme and localization strategy through detailed experimentation in which we raise state-of-the-art on several standard interactive segmentation benchmarks.


page 5

page 7


Scale-aware multi-level guidance for interactive instance segmentation

In interactive instance segmentation, users give feedback to iteratively...

DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformer

Most state-of-the-art instance segmentation methods rely on large amount...

Multi-Stage Fusion for One-Click Segmentation

Segmenting objects of interest in an image is an essential building bloc...

Perceive, Excavate and Purify: A Novel Object Mining Framework for Instance Segmentation

Recently, instance segmentation has made great progress with the rapid d...

Interactive Object Segmentation with Dynamic Click Transform

In the interactive segmentation, users initially click on the target obj...

Instance Segmentation based Semantic Matting for Compositing Applications

Image compositing is a key step in film making and image editing that ai...

CellSegmenter: unsupervised representation learning and instance segmentation of modular images

We introduce CellSegmenter, a structured deep generative model and an am...

Please sign up or login with your details

Forgot password? Click here to reset