VideoMatch: Matching based Video Object Segmentation

09/04/2018
by   Yuan-Ting Hu, et al.
6

Video object segmentation is challenging yet important in a wide variety of applications for video analysis. Recent works formulate video object segmentation as a prediction task using deep nets to achieve appealing state-of-the-art performance. Due to the formulation as a prediction task, most of these methods require fine-tuning during test time, such that the deep nets memorize the appearance of the objects of interest in the given video. However, fine-tuning is time-consuming and computationally expensive, hence the algorithms are far from real time. To address this issue, we develop a novel matching based algorithm for video object segmentation. In contrast to memorization based classification techniques, the proposed approach learns to match extracted features to a provided template without memorizing the appearance of the objects. We validate the effectiveness and the robustness of the proposed method on the challenging DAVIS-16, DAVIS-17, Youtube-Objects and JumpCut datasets. Extensive results show that our method achieves comparable performance without fine-tuning and is much more favorable in terms of computational time.

READ FULL TEXT

page 6

page 14

research
12/03/2020

Make One-Shot Video Object Segmentation Efficient Again

Video object segmentation (VOS) describes the task of segmenting a set o...
research
11/28/2018

A Generative Appearance Model for End-to-end Video Object Segmentation

One of the fundamental challenges in video object segmentation is to fin...
research
02/17/2020

Directional Deep Embedding and Appearance Learning for Fast Video Object Segmentation

Most recent semi-supervised video object segmentation (VOS) methods rely...
research
02/04/2018

Efficient Video Object Segmentation via Network Modulation

Video object segmentation targets at segmenting a specific object throug...
research
12/04/2018

Meta Learning Deep Visual Words for Fast Video Object Segmentation

Meta learning has attracted a lot of attention recently. In this paper, ...
research
04/11/2019

Knowledge Flow: Improve Upon Your Teachers

A zoo of deep nets is available these days for almost any given task, an...
research
08/19/2019

In defense of OSVOS

As a milestone for video object segmentation, one-shot video object segm...

Please sign up or login with your details

Forgot password? Click here to reset