Log In Sign Up

Learning Dynamic Network Using a Reuse Gate Function in Semi-supervised Video Object Segmentation

by   Hyojin Park, et al.

Current state-of-the-art approaches for Semi-supervised Video Object Segmentation (Semi-VOS) propagates information from previous frames to generate segmentation mask for the current frame. This results in high-quality segmentation across challenging scenarios such as changes in appearance and occlusion. But it also leads to unnecessary computations for stationary or slow-moving objects where the change across frames is minimal. In this work, we exploit this observation by using temporal information to quickly identify frames with minimal change and skip the heavyweight mask generation step. To realize this efficiency, we propose a novel dynamic network that estimates change across frames and decides which path – computing a full network or reusing previous frame's feature – to choose depending on the expected similarity. Experimental results show that our approach significantly improves inference speed without much accuracy degradation on challenging Semi-VOS datasets – DAVIS 16, DAVIS 17, and YouTube-VOS. Furthermore, our approach can be applied to multiple Semi-VOS methods demonstrating its generality.


page 5

page 9


CapsuleVOS: Semi-Supervised Video Object Segmentation Using Capsule Routing

In this work we propose a capsule-based approach for semi-supervised vid...

Video Object Segmentation Without Temporal Information

Video Object Segmentation, and video processing in general, has been his...

CRVOS: Clue Refining Network for Video Object Segmentation

The encoder-decoder based methods for semi-supervised video object segme...

Semantically-Guided Video Object Segmentation

This paper tackles the problem of semi-supervised video object segmentat...

Adaptive ROI Generation for Video Object Segmentation Using Reinforcement Learning

In this paper, we aim to tackle the task of semi-supervised video object...

Revisiting Sequence-to-Sequence Video Object Segmentation with Multi-Task Loss and Skip-Memory

Video Object Segmentation (VOS) is an active research area of the visual...

A Semi-Automated Method for Object Segmentation in Infant's Egocentric Videos to Study Object Perception

Object segmentation in infant's egocentric videos is a fundamental step ...