Multispectral Fusion for Object Detection with Cyclic Fuse-and-Refine Blocks

09/26/2020
by   Heng Zhang, et al.
0

Multispectral images (e.g. visible and infrared) may be particularly useful when detecting objects with the same model in different environments (e.g. day/night outdoor scenes). To effectively use the different spectra, the main technical problem resides in the information fusion process. In this paper, we propose a new halfway feature fusion method for neural networks that leverages the complementary/consistency balance existing in multispectral features by adding to the network architecture, a particular module that cyclically fuses and refines each spectral feature. We evaluate the effectiveness of our fusion method on two challenging multispectral datasets for object detection. Our results show that implementing our Cyclic Fuse-and-Refine module in any network improves the performance on both datasets compared to other state-of-the-art multispectral object detection methods.

READ FULL TEXT

page 1

page 3

page 4

research
08/29/2021

MBDF-Net: Multi-Branch Deep Fusion Network for 3D Object Detection

Point clouds and images could provide complementary information when rep...
research
12/04/2017

FSSD: Feature Fusion Single Shot Multibox Detector

SSD (Single Shot Multibox Detetor) is one of the best object detection a...
research
03/30/2022

Target-aware Dual Adversarial Learning and a Multi-scenario Multi-Modality Benchmark to Fuse Infrared and Visible for Object Detection

This study addresses the issue of fusing infrared and visible images tha...
research
01/08/2019

3D Object Detection Using Scale Invariant and Feature Reweighting Networks

3D object detection plays an important role in a large number of real-wo...
research
04/05/2022

Learning to Reduce Information Bottleneck for Object Detection in Aerial Images

Object detection in aerial images is a fundamental research topic in the...
research
05/07/2022

Graph Fusion Network for Multi-Oriented Object Detection

In object detection, non-maximum suppression (NMS) methods are extensive...
research
09/15/2020

AMRNet: Chips Augmentation in Areial Images Object Detection

Detecting object in aerial image is challenging task due to 1) objects a...

Please sign up or login with your details

Forgot password? Click here to reset