Infrared and Visible Image Fusion using a Deep Learning Framework

04/19/2018
by   Hui Li, et al.
0

In recent years, deep learning has become a very active research tool which is used in many image processing fields. In this paper, we propose an effective image fusion method using a deep learning framework to generate a single image which contains all the features from infrared and visible images. First, the source images are decomposed into base parts and detail content. Then the base parts are fused by weighted-averaging. For the detail content, we use a deep learning network to extract multi-layer features. Using these features, we use l_1-norm and weighted-average strategy to generate several candidates of the fused detail content. Once we get these candidates, the max selection strategy is used to get final fused detail content. Finally, the fused image will be reconstructed by combining the fused base part and detail content. The experimental results demonstrate that our proposed method achieves state-of-the-art performance in both objective assessment and visual quality. The Code of our fusion method is available at https://github.com/exceptionLi/imagefusion_deeplearning.

READ FULL TEXT

page 3

page 4

page 5

research
11/06/2018

Infrared and visible image fusion using a novel deep decomposition method

Infrared and visible image fusion is an important problem in image fusio...
research
06/19/2018

Infrared and Visible Image Fusion with ResNet and zero-phase component analysis

In image fusion task, feature extraction and processing are keys for fus...
research
04/24/2018

Infrared and visible image fusion using Latent Low-Rank Representation

Infrared and visible image fusion is an important problem in the field o...
research
06/30/2022

A Medical Image Fusion Method based on MDLatLRRv2

Since MDLatLRR only considers detailed parts (salient features) of input...
research
01/27/2021

Assessing the applicability of Deep Learning-based visible-infrared fusion methods for fire imagery

Early wildfire detection is of paramount importance to avoid as much dam...
research
05/25/2016

Deeply-Fused Nets

In this paper, we present a novel deep learning approach, deeply-fused n...
research
05/03/2020

Fusion of visible and infrared images via complex function

We propose an algorithm for the fusion of partial images collected from ...

Please sign up or login with your details

Forgot password? Click here to reset