Multi-Projection Fusion and Refinement Network for Salient Object Detection in 360° Omnidirectional Image

12/23/2022
by   Runmin Cong, et al.
0

Salient object detection (SOD) aims to determine the most visually attractive objects in an image. With the development of virtual reality technology, 360 omnidirectional image has been widely used, but the SOD task in 360 omnidirectional image is seldom studied due to its severe distortions and complex scenes. In this paper, we propose a Multi-Projection Fusion and Refinement Network (MPFR-Net) to detect the salient objects in 360 omnidirectional image. Different from the existing methods, the equirectangular projection image and four corresponding cube-unfolding images are embedded into the network simultaneously as inputs, where the cube-unfolding images not only provide supplementary information for equirectangular projection image, but also ensure the object integrity of the cube-map projection. In order to make full use of these two projection modes, a Dynamic Weighting Fusion (DWF) module is designed to adaptively integrate the features of different projections in a complementary and dynamic manner from the perspective of inter and intra features. Furthermore, in order to fully explore the way of interaction between encoder and decoder features, a Filtration and Refinement (FR) module is designed to suppress the redundant information between the feature itself and the feature. Experimental results on two omnidirectional datasets demonstrate that the proposed approach outperforms the state-of-the-art methods both qualitatively and quantitatively.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 8

page 10

page 11

research
06/07/2021

Progressive Multi-scale Fusion Network for RGB-D Salient Object Detection

Salient object detection(SOD) aims at locating the most significant obje...
research
05/05/2020

Multi-interactive Encoder-decoder Network for RGBT Salient Object Detection

RGBT salient object detection (SOD) aims to segment the common prominent...
research
08/22/2019

EGNet:Edge Guidance Network for Salient Object Detection

Fully convolutional neural networks (FCNs) have shown their advantages i...
research
03/17/2023

Adaptive Graph Convolution Module for Salient Object Detection

Salient object detection (SOD) is a task that involves identifying and s...
research
04/19/2022

Global-and-Local Collaborative Learning for Co-Salient Object Detection

The goal of co-salient object detection (CoSOD) is to discover salient o...
research
05/21/2018

Object Detection in Equirectangular Panorama

We introduced a high-resolution equirectangular panorama (360-degree, vi...
research
05/12/2021

CT-Net: Complementary Transfering Network for Garment Transfer with Arbitrary Geometric Changes

Garment transfer shows great potential in realistic applications with th...

Please sign up or login with your details

Forgot password? Click here to reset