SwipeCut: Interactive Segmentation with Diversified Seed Proposals

12/18/2018
by   Ding-Jie Chen, et al.
12

Interactive image segmentation algorithms rely on the user to provide annotations as the guidance. When the task of interactive segmentation is performed on a small touchscreen device, the requirement of providing precise annotations could be cumbersome to the user. We design an efficient seed proposal method that actively proposes annotation seeds for the user to label. The user only needs to check which ones of the query seeds are inside the region of interest (ROI). We enforce the sparsity and diversity criteria on the selection of the query seeds. At each round of interaction the user is only presented with a small number of informative query seeds that are far apart from each other. As a result, we are able to derive a user friendly interaction mechanism for annotation on small touchscreen devices. The user merely has to swipe through on the ROI-relevant query seeds, which should be easy since those gestures are commonly used on a touchscreen. The performance of our algorithm is evaluated on six publicly available datasets. The evaluation results show that our algorithm achieves high segmentation accuracy, with short response time and less user feedback.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 11

research
06/07/2014

Refinement-Cut: User-Guided Segmentation Algorithm for Translational Science

In this contribution, a semi-automatic segmentation algorithm for (medic...
research
03/21/2023

Focused and Collaborative Feedback Integration for Interactive Image Segmentation

Interactive image segmentation aims at obtaining a segmentation mask for...
research
10/27/2016

Icon: An Interactive Approach to Train Deep Neural Networks for Segmentation of Neuronal Structures

We present an interactive approach to train a deep neural network pixel ...
research
09/11/2017

UI-Net: Interactive Artificial Neural Networks for Iterative Image Segmentation Based on a User Model

For complex segmentation tasks, fully automatic systems are inherently l...
research
04/13/2023

DynaMITe: Dynamic Query Bootstrapping for Multi-object Interactive Segmentation Transformer

Most state-of-the-art instance segmentation methods rely on large amount...
research
06/11/2023

VPUFormer: Visual Prompt Unified Transformer for Interactive Image Segmentation

The integration of diverse visual prompts like clicks, scribbles, and bo...
research
11/09/2019

Interactive Classification by Asking Informative Questions

Natural language systems often rely on a single, potentially ambiguous i...

Please sign up or login with your details

Forgot password? Click here to reset