Unsupervised Image Fusion Method based on Feature Mutual Mapping

01/25/2022
by   Dongyu Rao, et al.
6

Deep learning-based image fusion approaches have obtained wide attention in recent years, achieving promising performance in terms of visual perception. However, the fusion module in the current deep learning-based methods suffers from two limitations, i.e., manually designed fusion function, and input-independent network learning. In this paper, we propose an unsupervised adaptive image fusion method to address the above issues. We propose a feature mutual mapping fusion module and dual-branch multi-scale autoencoder. More specifically, we construct a global map to measure the connections of pixels between the input source images. image fusion. Besides, we design a dual-branch multi-scale network through sampling transformation to extract discriminative image features. We further enrich feature representations of different scales through feature aggregation in the decoding process. Finally, we propose a modified loss function to train the network with efficient convergence property. Through sufficient training on infrared and visible image data sets, our method also shows excellent generalized performance in multi-focus and medical image fusion. Our method achieves superior performance in both visual perception and objective evaluation. Experiments prove that the performance of our proposed method on a variety of image fusion tasks surpasses other state-of-the-art methods, proving the effectiveness and versatility of our approach.

READ FULL TEXT

page 3

page 5

page 6

page 7

page 8

research
12/23/2019

A Robust Non-Linear and Feature-Selection Image Fusion Theory

The human visual perception system has strong robustness in image fusion...
research
11/30/2022

Two-branch Multi-scale Deep Neural Network for Generalized Document Recapture Attack Detection

The image recapture attack is an effective image manipulation method to ...
research
01/19/2022

DMF-Net: Dual-Branch Multi-Scale Feature Fusion Network for copy forgery identification of anti-counterfeiting QR code

Anti-counterfeiting QR codes are widely used in people's work and life, ...
research
08/09/2023

Learning multi-domain feature relation for visible and Long-wave Infrared image patch matching

Recently, learning-based algorithms have achieved promising performance ...
research
09/23/2021

Cross Attention-guided Dense Network for Images Fusion

In recent years, various applications in computer vision have achieved s...
research
07/19/2023

Uncertainty-Driven Multi-Scale Feature Fusion Network for Real-time Image Deraining

Visual-based measurement systems are frequently affected by rainy weathe...
research
11/29/2022

Segment-based fusion of multi-sensor multi-scale satellite soil moisture retrievals

Synergetic use of sensors for soil moisture retrieval is attracting cons...

Please sign up or login with your details

Forgot password? Click here to reset