Deep Interactive Object Selection

03/13/2016
by   Ning Xu, et al.
0

Interactive object selection is a very important research problem and has many applications. Previous algorithms require substantial user interactions to estimate the foreground and background distributions. In this paper, we present a novel deep learning based algorithm which has a much better understanding of objectness and thus can reduce user interactions to just a few clicks. Our algorithm transforms user provided positive and negative clicks into two Euclidean distance maps which are then concatenated with the RGB channels of images to compose (image, user interactions) pairs. We generate many of such pairs by combining several random sampling strategies to model user click patterns and use them to fine tune deep Fully Convolutional Networks (FCNs). Finally the output probability maps of our FCN 8s model is integrated with graph cut optimization to refine the boundary segments. Our model is trained on the PASCAL segmentation dataset and evaluated on other datasets with different object classes. Experimental results on both seen and unseen objects clearly demonstrate that our algorithm has a good generalization ability and is superior to all existing interactive object selection approaches.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 4

page 6

page 7

page 8

page 9

07/06/2018

A Fully Convolutional Two-Stream Fusion Network for Interactive Image Segmentation

In this paper, we propose a novel fully convolutional two-stream fusion ...
06/19/2021

Interactive Object Segmentation with Dynamic Click Transform

In the interactive segmentation, users initially click on the target obj...
04/17/2018

Deep Object Co-Segmentation

This work presents a deep object co-segmentation (DOCS) approach for seg...
09/11/2017

UI-Net: Interactive Artificial Neural Networks for Iterative Image Segmentation Based on a User Model

For complex segmentation tasks, fully automatic systems are inherently l...
12/07/2018

Scale-aware multi-level guidance for interactive instance segmentation

In interactive instance segmentation, users give feedback to iteratively...
03/17/2020

Getting to 99

Interactive object cutout tools are the cornerstone of the image editing...
05/01/2015

Quality Control in Crowdsourced Object Segmentation

This paper explores processing techniques to deal with noisy data in cro...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.