FOMTrace: Interactive Video Segmentation By Image Graphs and Fuzzy Object Models

06/10/2016
by   Thiago Vallin Spina, et al.
0

Common users have changed from mere consumers to active producers of multimedia data content. Video editing plays an important role in this scenario, calling for simple segmentation tools that can handle fast-moving and deformable video objects with possible occlusions, color similarities with the background, among other challenges. We present an interactive video segmentation method, named FOMTrace, which addresses the problem in an effective and efficient way. From a user-provided object mask in a first frame, the method performs semi-automatic video segmentation on a spatiotemporal superpixel-graph, and then estimates a Fuzzy Object Model (FOM), which refines segmentation of the second frame by constraining delineation on a pixel-graph within a region where the object's boundary is expected to be. The user can correct/accept the refined object mask in the second frame, which is then similarly used to improve the spatiotemporal video segmentation of the remaining frames. Both steps are repeated alternately, within interactive response times, until the segmentation refinement of the final frame is accepted by the user. Extensive experiments demonstrate FOMTrace's ability for tracing objects in comparison with state-of-the-art approaches for interactive video segmentation, supervised, and unsupervised object tracking.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 7

page 10

page 11

page 12

research
12/31/2017

Interactive Video Object Segmentation in the Wild

In this paper we present our system for human-in-the-loop video object s...
research
03/01/2018

The 2018 DAVIS Challenge on Video Object Segmentation

We present the 2018 DAVIS Challenge on Video Object Segmentation, a publ...
research
07/05/2016

Click Carving: Segmenting Objects in Video with Point Clicks

We present a novel form of interactive video object segmentation where a...
research
01/22/2013

Efficient MRF Energy Propagation for Video Segmentation via Bilateral Filters

Segmentation of an object from a video is a challenging task in multimed...
research
03/05/2021

Fast Interactive Video Object Segmentation with Graph Neural Networks

Pixelwise annotation of image sequences can be very tedious for humans. ...
research
02/28/2017

Super-Trajectory for Video Segmentation

We introduce a novel semi-supervised video segmentation approach based o...
research
01/12/2021

DuctTake: Spatiotemporal Video Compositing

DuctTake is a system designed to enable practical compositing of multipl...

Please sign up or login with your details

Forgot password? Click here to reset