Video Salient Object Detection via Adaptive Local-Global Refinement

04/29/2021
by   Yi Tang, et al.
0

Video salient object detection (VSOD) is an important task in many vision applications. Reliable VSOD requires to simultaneously exploit the information from both the spatial domain and the temporal domain. Most of the existing algorithms merely utilize simple fusion strategies, such as addition and concatenation, to merge the information from different domains. Despite their simplicity, such fusion strategies may introduce feature redundancy, and also fail to fully exploit the relationship between multi-level features extracted from both spatial and temporal domains. In this paper, we suggest an adaptive local-global refinement framework for VSOD. Different from previous approaches, we propose a local refinement architecture and a global one to refine the simply fused features with different scopes, which can fully explore the local dependence and the global dependence of multi-level features. In addition, to emphasize the effective information and suppress the useless one, an adaptive weighting mechanism is designed based on graph convolutional neural network (GCN). We show that our weighting methodology can further exploit the feature correlations, thus driving the network to learn more discriminative feature representation. Extensive experimental results on public video datasets demonstrate the superiority of our method over the existing ones.

READ FULL TEXT

page 3

page 6

research
05/05/2020

Multi-interactive Encoder-decoder Network for RGBT Salient Object Detection

RGBT salient object detection (SOD) aims to segment the common prominent...
research
07/27/2021

Perception-and-Regulation Network for Salient Object Detection

Effective fusion of different types of features is the key to salient ob...
research
11/26/2019

F3Net: Fusion, Feedback and Focus for Salient Object Detection

Most of existing salient object detection models have achieved great pro...
research
07/06/2020

BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network

Multi-level feature fusion is a fundamental topic in computer vision for...
research
07/26/2019

Multi-level Domain Adaptive learning for Cross-Domain Detection

In recent years, object detection has shown impressive results using sup...
research
05/14/2021

Confidence-guided Adaptive Gate and Dual Differential Enhancement for Video Salient Object Detection

Video salient object detection (VSOD) aims to locate and segment the mos...
research
12/16/2020

Domain Adaptive Object Detection via Feature Separation and Alignment

Recently, adversarial-based domain adaptive object detection (DAOD) meth...

Please sign up or login with your details

Forgot password? Click here to reset