Does Thermal Really Always Matter for RGB-T Salient Object Detection?

10/09/2022
by   Runmin Cong, et al.
0

In recent years, RGB-T salient object detection (SOD) has attracted continuous attention, which makes it possible to identify salient objects in environments such as low light by introducing thermal image. However, most of the existing RGB-T SOD models focus on how to perform cross-modality feature fusion, ignoring whether thermal image is really always matter in SOD task. Starting from the definition and nature of this task, this paper rethinks the connotation of thermal modality, and proposes a network named TNet to solve the RGB-T SOD task. In this paper, we introduce a global illumination estimation module to predict the global illuminance score of the image, so as to regulate the role played by the two modalities. In addition, considering the role of thermal modality, we set up different cross-modality interaction mechanisms in the encoding phase and the decoding phase. On the one hand, we introduce a semantic constraint provider to enrich the semantics of thermal images in the encoding phase, which makes thermal modality more suitable for the SOD task. On the other hand, we introduce a two-stage localization and complementation module in the decoding phase to transfer object localization cue and internal integrity cue in thermal features to the RGB modality. Extensive experiments on three datasets show that the proposed TNet achieves competitive performance compared with 20 state-of-the-art methods.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 8

page 10

page 11

research
07/07/2022

Mirror Complementary Transformer Network for RGB-thermal Salient Object Detection

RGB-thermal salient object detection (RGB-T SOD) aims to locate the comm...
research
07/26/2019

Semantic Deep Intermodal Feature Transfer: Transferring Feature Descriptors Between Imaging Modalities

Under difficult environmental conditions, the view of RGB cameras may be...
research
08/03/2023

Erasure-based Interaction Network for RGBT Video Object Detection and A Unified Benchmark

Recently, many breakthroughs are made in the field of Video Object Detec...
research
08/17/2023

Point-aware Interaction and CNN-induced Refinement Network for RGB-D Salient Object Detection

By integrating complementary information from RGB image and depth map, t...
research
12/06/2021

Cross-Modality Attentive Feature Fusion for Object Detection in Multispectral Remote Sensing Imagery

Cross-modality fusing complementary information of multispectral remote ...
research
10/12/2022

PSNet: Parallel Symmetric Network for Video Salient Object Detection

For the video salient object detection (VSOD) task, how to excavate the ...
research
03/17/2023

Scribble-Supervised RGB-T Salient Object Detection

Salient object detection segments attractive objects in scenes. RGB and ...

Please sign up or login with your details

Forgot password? Click here to reset