Revisiting Click-based Interactive Video Object Segmentation

03/03/2022
by   Stéphane Vujasinović, et al.
0

While current methods for interactive Video Object Segmentation (iVOS) rely on scribble-based interactions to generate precise object masks, we propose a Click-based interactive Video Object Segmentation (CiVOS) framework to simplify the required user workload as much as possible. CiVOS builds on de-coupled modules reflecting user interaction and mask propagation. The interaction module converts click-based interactions into an object mask, which is then inferred to the remaining frames by the propagation module. Additional user interactions allow for a refinement of the object mask. The approach is extensively evaluated on the popular interactive DAVIS dataset, but with an inevitable adaptation of scribble-based interactions with click-based counterparts. We consider several strategies for generating clicks during our evaluation to reflect various user inputs and adjust the DAVIS performance metric to perform a hardware-independent comparison. The presented CiVOS pipeline achieves competitive results, although requiring a lower user workload.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/14/2021

Modular Interactive Video Object Segmentation: Interaction-to-Mask, Propagation and Difference-Aware Fusion

We present Modular interactive VOS (MiVOS) framework which decouples int...
research
09/15/2021

UCP-Net: Unstructured Contour Points for Instance Segmentation

The goal of interactive segmentation is to assist users in producing seg...
research
03/30/2020

Memory Aggregation Networks for Efficient Interactive Video Object Segmentation

Interactive video object segmentation (iVOS) aims at efficiently harvest...
research
08/01/2017

Video Object Segmentation with Re-identification

Conventional video segmentation methods often rely on temporal continuit...
research
12/13/2009

Learning an Interactive Segmentation System

Many successful applications of computer vision to image or video manipu...
research
03/18/2021

Learning to Recommend Frame for Interactive Video Object Segmentation in the Wild

This paper proposes a framework for the interactive video object segment...
research
03/13/2016

Deep Interactive Object Selection

Interactive object selection is a very important research problem and ha...

Please sign up or login with your details

Forgot password? Click here to reset