Fast Interactive Video Object Segmentation with Graph Neural Networks

03/05/2021
by   Viktor Varga, et al.
16

Pixelwise annotation of image sequences can be very tedious for humans. Interactive video object segmentation aims to utilize automatic methods to speed up the process and reduce the workload of the annotators. Most contemporary approaches rely on deep convolutional networks to collect and process information from human annotations throughout the video. However, such networks contain millions of parameters and need huge amounts of labeled training data to avoid overfitting. Beyond that, label propagation is usually executed as a series of frame-by-frame inference steps, which is difficult to be parallelized and is thus time consuming. In this paper we present a graph neural network based approach for tackling the problem of interactive video object segmentation. Our network operates on superpixel-graphs which allow us to reduce the dimensionality of the problem by several magnitudes. We show, that our network possessing only a few thousand parameters is able to achieve state-of-the-art performance, while inference remains fast and can be trained quickly with very little data.

READ FULL TEXT

page 2

page 3

page 5

page 8

research
04/22/2019

Fast User-Guided Video Object Segmentation by Interaction-and-Propagation Networks

We present a deep learning method for the interactive video object segme...
research
12/31/2017

Interactive Video Object Segmentation in the Wild

In this paper we present our system for human-in-the-loop video object s...
research
06/10/2016

FOMTrace: Interactive Video Segmentation By Image Graphs and Fuzzy Object Models

Common users have changed from mere consumers to active producers of mul...
research
04/14/2022

Interactive Object Segmentation in 3D Point Clouds

Deep learning depends on large amounts of labeled training data. Manual ...
research
07/16/2020

Interactive Video Object Segmentation Using Global and Local Transfer Modules

An interactive video object segmentation algorithm, which takes scribble...
research
04/03/2018

Dynamic Video Segmentation Network

In this paper, we present a detailed design of dynamic video segmentatio...
research
12/13/2022

Connectivity-constrained Interactive Panoptic Segmentation

We address interactive panoptic annotation, where one segment all object...

Please sign up or login with your details

Forgot password? Click here to reset