Iteratively Selecting an Easy Reference Frame Makes Unsupervised Video Object Segmentation Easier

12/23/2021
by   Youngjo Lee, et al.
0

Unsupervised video object segmentation (UVOS) is a per-pixel binary labeling problem which aims at separating the foreground object from the background in the video without using the ground truth (GT) mask of the foreground object. Most of the previous UVOS models use the first frame or the entire video as a reference frame to specify the mask of the foreground object. Our question is why the first frame should be selected as a reference frame or why the entire video should be used to specify the mask. We believe that we can select a better reference frame to achieve the better UVOS performance than using only the first frame or the entire video as a reference frame. In our paper, we propose Easy Frame Selector (EFS). The EFS enables us to select an 'easy' reference frame that makes the subsequent VOS become easy, thereby improving the VOS performance. Furthermore, we propose a new framework named as Iterative Mask Prediction (IMP). In the framework, we repeat applying EFS to the given video and selecting an 'easier' reference frame from the video than the previous iteration, increasing the VOS performance incrementally. The IMP consists of EFS, Bi-directional Mask Prediction (BMP), and Temporal Information Updating (TIU). From the proposed framework, we achieve state-of-the-art performance in three UVOS benchmark sets: DAVIS16, FBMS, and SegTrack-V2.

READ FULL TEXT

page 3

page 6

research
07/09/2021

Fast Pixel-Matching for Video Object Segmentation

Video object segmentation, aiming to segment the foreground objects give...
research
11/25/2018

Background Subtraction with Real-time Semantic Segmentation

Accurate and fast foreground object extraction is very important for obj...
research
11/24/2021

Layered Controllable Video Generation

We introduce layered controllable video generation, where we, without an...
research
05/22/2023

UVOSAM: A Mask-free Paradigm for Unsupervised Video Object Segmentation via Segment Anything Model

Unsupervised video object segmentation has made significant progress in ...
research
08/28/2019

Fast Video Object Segmentation via Mask Transfer Network

Accuracy and processing speed are two important factors that affect the ...
research
09/04/2022

Pixel-Level Equalized Matching for Video Object Segmentation

Feature similarity matching, which transfers the information of the refe...
research
09/27/2019

Adaptive ROI Generation for Video Object Segmentation Using Reinforcement Learning

In this paper, we aim to tackle the task of semi-supervised video object...

Please sign up or login with your details

Forgot password? Click here to reset