A Multiple Source Hourglass Deep Network for Multi-Focus Image Fusion

08/28/2019
by   Fidel Alejandro Guerrero Peña, et al.
23

Multi-Focus Image Fusion seeks to improve the quality of an acquired burst of images with different focus planes. For solving the task, an activity level measurement and a fusion rule are typically established to select and fuse the most relevant information from the sources. However, the design of this kind of method by hand is really hard and sometimes restricted to solution spaces where the optimal all-in-focus images are not contained. Then, we propose here two fast and straightforward approaches for image fusion based on deep neural networks. Our solution uses a multiple source Hourglass architecture trained in an end-to-end fashion. Models are data-driven and can be easily generalized for other kinds of fusion problems. A segmentation approach is used for recognition of the focus map, while the weighted average rule is used for fusion. We designed a training loss function for our regression-based fusion function, which allows the network to learn both the activity level measurement and the fusion rule. Experimental results show our approach has comparable results to the state-of-the-art methods with a 60X increase of computational efficiency for 520X520 resolution images.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

page 9

page 10

01/12/2021

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

Traditional and deep learning-based fusion methods generated the interme...
04/01/2019

The bilateral solver for quality estimation based multi-focus image fusion

In this work, a fast Bilateral Solver for Quality Estimation Based multi...
06/11/2019

On Single Source Robustness in Deep Fusion Models

Algorithms that fuse multiple input sources benefit from both complement...
03/30/2019

Boundary Aware Multi-Focus Image Fusion Using Deep Neural Network

Since it is usually difficult to capture an all-in-focus image of a 3D s...
10/17/2020

Gradient Aware Cascade Network for Multi-Focus Image Fusion

The general aim of multi-focus image fusion is to gather focused regions...
03/13/2013

Possibilistic Assumption based Truth Maintenance System, Validation in a Data Fusion Application

Data fusion allows the elaboration and the evaluation of a situation syn...
07/17/2020

AE-Net: Autonomous Evolution Image Fusion Method Inspired by Human Cognitive Mechanism

In order to solve the robustness and generality problems of the image fu...