RGB-D Salient Object Detection with Ubiquitous Target Awareness

09/08/2021
by   Yifan Zhao, et al.
0

Conventional RGB-D salient object detection methods aim to leverage depth as complementary information to find the salient regions in both modalities. However, the salient object detection results heavily rely on the quality of captured depth data which sometimes are unavailable. In this work, we make the first attempt to solve the RGB-D salient object detection problem with a novel depth-awareness framework. This framework only relies on RGB data in the testing phase, utilizing captured depth data as supervision for representation learning. To construct our framework as well as achieving accurate salient detection results, we propose a Ubiquitous Target Awareness (UTA) network to solve three important challenges in RGB-D SOD task: 1) a depth awareness module to excavate depth information and to mine ambiguous regions via adaptive depth-error weights, 2) a spatial-aware cross-modal interaction and a channel-aware cross-level interaction, exploiting the low-level boundary cues and amplifying high-level salient channels, and 3) a gated multi-scale predictor module to perceive the object saliency in different contextual scales. Besides its high performance, our proposed UTA network is depth-free for inference and runs in real-time with 43 FPS. Experimental evidence demonstrates that our proposed network not only surpasses the state-of-the-art methods on five public RGB-D SOD benchmarks by a large margin, but also verifies its extensibility on five public RGB SOD benchmarks.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 10

page 11

page 12

research
05/30/2020

Is Depth Really Necessary for Salient Object Detection?

Salient object detection (SOD) is a crucial and preliminary task for man...
research
05/10/2017

Learning RGB-D Salient Object Detection using background enclosure, depth contrast, and top-down features

Recently, deep Convolutional Neural Networks (CNN) have demonstrated str...
research
07/23/2020

Accurate RGB-D Salient Object Detection via Collaborative Learning

Benefiting from the spatial cues embedded in depth images, recent progre...
research
01/17/2023

Rethinking Lightweight Salient Object Detection via Network Depth-Width Tradeoff

Existing salient object detection methods often adopt deeper and wider n...
research
08/07/2020

Depth Quality Aware Salient Object Detection

The existing fusion based RGB-D salient object detection methods usually...
research
08/07/2020

Cascade Graph Neural Networks for RGB-D Salient Object Detection

In this paper, we study the problem of salient object detection (SOD) fo...
research
06/22/2022

Depth-aware Glass Surface Detection with Cross-modal Context Mining

Glass surfaces are becoming increasingly ubiquitous as modern buildings ...

Please sign up or login with your details

Forgot password? Click here to reset