Unsupervised Video Object Segmentation using Motion Saliency-Guided Spatio-Temporal Propagation

09/04/2018
by   Yuan-Ting Hu, et al.
0

Unsupervised video segmentation plays an important role in a wide variety of applications from object identification to compression. However, to date, fast motion, motion blur and occlusions pose significant challenges. To address these challenges for unsupervised video segmentation, we develop a novel saliency estimation technique as well as a novel neighborhood graph, based on optical flow and edge cues. Our approach leads to significantly better initial foreground-background estimates and their robust as well as accurate diffusion across time. We evaluate our proposed algorithm on the challenging DAVIS, SegTrack v2 and FBMS-59 datasets. Despite the usage of only a standard edge detector trained on 200 images, our method achieves state-of-the-art results outperforming deep learning based methods in the unsupervised setting. We even demonstrate competitive results comparable to deep learning based methods in the semi-supervised setting on the DAVIS dataset.

READ FULL TEXT

page 2

page 4

page 13

page 14

research
01/25/2023

Flow-guided Semi-supervised Video Object Segmentation

We propose an optical flow-guided approach for semi-supervised video obj...
research
08/12/2019

Semi-Supervised Video Salient Object Detection Using Pseudo-Labels

Deep learning-based video salient object detection has recently achieved...
research
10/24/2019

Anchor Diffusion for Unsupervised Video Object Segmentation

Unsupervised video object segmentation has often been tackled by methods...
research
08/01/2022

BATMAN: Bilateral Attention Transformer in Motion-Appearance Neighboring Space for Video Object Segmentation

Video Object Segmentation (VOS) is fundamental to video understanding. T...
research
11/19/2018

Tukey-Inspired Video Object Segmentation

We investigate the problem of strictly unsupervised video object segment...
research
07/10/2023

FODVid: Flow-guided Object Discovery in Videos

Segmentation of objects in a video is challenging due to the nuances suc...
research
07/07/2019

Spacetime Graph Optimization for Video Object Segmentation

In this paper we address the challenging task of object discovery and se...

Please sign up or login with your details

Forgot password? Click here to reset