Log In Sign Up

Gradient Aware Cascade Network for Multi-Focus Image Fusion

by   Boyuan Ma, et al.

The general aim of multi-focus image fusion is to gather focused regions of different images to generate a unique all-in-focus fused image. Deep learning based methods become the mainstream of image fusion by virtue of its powerful feature representation ability. However, most of the existing deep learning structures failed to balance fusion quality and end-to-end implementation convenience. End-to-end decoder design often leads to poor performance because of its non-linear mapping mechanism. On the other hand, generating an intermediate decision map achieves better quality for the fused image, but relies on the rectification with empirical post-processing parameter choices. In this work, to handle the requirements of both output image quality and comprehensive simplicity of structure implementation, we propose a cascade network to simultaneously generate decision map and fused result with an end-to-end training procedure. It avoids the dependence on empirical post-processing methods in the inference stage. To improve the fusion quality, we introduce a gradient aware loss function to preserve gradient information in output fused image. In addition, we design a decision calibration strategy to decrease the time consumption in the application of multiple image fusion. Extensive experiments are conducted to compare with 16 different state-of-the-art multi-focus image fusion structures with 6 assessment metrics. The results prove that our designed structure can generally ameliorate the output fused image quality, while implementation efficiency increases over 30% for multiple image fusion.


page 4

page 7


UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

Traditional and deep learning-based fusion methods generated the interme...

Unsupervised Deep Multi-focus Image Fusion

Convolutional neural networks have recently been used for multi-focus im...

A Multiple Source Hourglass Deep Network for Multi-Focus Image Fusion

Multi-Focus Image Fusion seeks to improve the quality of an acquired bur...

Deeply-Fused Nets

In this paper, we present a novel deep learning approach, deeply-fused n...

Fusion of visible and infrared images via complex function

We propose an algorithm for the fusion of partial images collected from ...

Efficient Misalignment-Robust Multi-Focus Microscopical Images Fusion

In this paper we propose a very efficient method to fuse the unregistere...

Code Repositories


SESF-Fuse: An Unsupervised Deep Model for Multi-Focus Image Fusion

view repo