Gradient Aware Cascade Network for Multi-Focus Image Fusion

10/17/2020
by   Boyuan Ma, et al.
0

The general aim of multi-focus image fusion is to gather focused regions of different images to generate a unique all-in-focus fused image. Deep learning based methods become the mainstream of image fusion by virtue of its powerful feature representation ability. However, most of the existing deep learning structures failed to balance fusion quality and end-to-end implementation convenience. End-to-end decoder design often leads to poor performance because of its non-linear mapping mechanism. On the other hand, generating an intermediate decision map achieves better quality for the fused image, but relies on the rectification with empirical post-processing parameter choices. In this work, to handle the requirements of both output image quality and comprehensive simplicity of structure implementation, we propose a cascade network to simultaneously generate decision map and fused result with an end-to-end training procedure. It avoids the dependence on empirical post-processing methods in the inference stage. To improve the fusion quality, we introduce a gradient aware loss function to preserve gradient information in output fused image. In addition, we design a decision calibration strategy to decrease the time consumption in the application of multiple image fusion. Extensive experiments are conducted to compare with 16 different state-of-the-art multi-focus image fusion structures with 6 assessment metrics. The results prove that our designed structure can generally ameliorate the output fused image quality, while implementation efficiency increases over 30% for multiple image fusion.

READ FULL TEXT

page 4

page 7

research
01/12/2021

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

Traditional and deep learning-based fusion methods generated the interme...
research
01/03/2020

FFusionCGAN: An end-to-end fusion method for few-focus images using conditional GAN in cytopathological digital slides

Multi-focus image fusion technologies compress different focus depth ima...
research
06/19/2018

Unsupervised Deep Multi-focus Image Fusion

Convolutional neural networks have recently been used for multi-focus im...
research
08/28/2019

A Multiple Source Hourglass Deep Network for Multi-Focus Image Fusion

Multi-Focus Image Fusion seeks to improve the quality of an acquired bur...
research
07/27/2023

EqGAN: Feature Equalization Fusion for Few-shot Image Generation

Due to the absence of fine structure and texture information, existing f...
research
05/25/2016

Deeply-Fused Nets

In this paper, we present a novel deep learning approach, deeply-fused n...
research
08/05/2019

SESF-Fuse: An Unsupervised Deep Model for Multi-Focus Image Fusion

In this work, we propose a novel unsupervised deep learning model to add...

Please sign up or login with your details

Forgot password? Click here to reset