DeepAI AI Chat
Log In Sign Up

Exploring Rich and Efficient Spatial Temporal Interactions for Real Time Video Salient Object Detection

08/07/2020
by   Chenglizhao Chen, et al.
NetEase, Inc
0

The current main stream methods formulate their video saliency mainly from two independent venues, i.e., the spatial and temporal branches. As a complementary component, the main task for the temporal branch is to intermittently focus the spatial branch on those regions with salient movements. In this way, even though the overall video saliency quality is heavily dependent on its spatial branch, however, the performance of the temporal branch still matter. Thus, the key factor to improve the overall video saliency is how to further boost the performance of these branches efficiently. In this paper, we propose a novel spatiotemporal network to achieve such improvement in a full interactive fashion. We integrate a lightweight temporal model into the spatial branch to coarsely locate those spatially salient regions which are correlated with trustworthy salient movements. Meanwhile, the spatial branch itself is able to recurrently refine the temporal model in a multi-scale manner. In this way, both the spatial and temporal branches are able to interact with each other, achieving the mutual performance improvement. Our method is easy to implement yet effective, achieving high quality video saliency detection in real-time speed with 50 FPS.

READ FULL TEXT

page 1

page 3

page 7

page 9

07/12/2018

Video Saliency Detection by 3D Convolutional Neural Networks

Different from salient object detection methods for still images, a key ...
02/02/2017

Video Salient Object Detection via Fully Convolutional Networks

This paper proposes a deep learning model to efficiently detect salient ...
12/09/2020

DS-Net: Dynamic Spatiotemporal Network for Video Salient Object Detection

As moving objects always draw more attention of human eyes, the temporal...
07/20/2020

TENet: Triple Excitation Network for Video Salient Object Detection

In this paper, we propose a simple yet effective approach, named Triple ...
08/04/2017

Region-Based Multiscale Spatiotemporal Saliency for Video

Detecting salient objects from a video requires exploiting both spatial ...
07/25/2017

Graph-Theoretic Spatiotemporal Context Modeling for Video Saliency Detection

As an important and challenging problem in computer vision, video salien...
07/04/2022

Identifying Rhythmic Patterns for Face Forgery Detection and Categorization

With the emergence of GAN, face forgery technologies have been heavily a...