A Multiple Source Hourglass Deep Network for Multi-Focus Image Fusion

Multi-Focus Image Fusion seeks to improve the quality of an acquired burst of images with different focus planes. For solving the task, an activity level measurement and a fusion rule are typically established to select and fuse the most relevant information from the sources. However, the design of this kind of method by hand is really hard and sometimes restricted to solution spaces where the optimal all-in-focus images are not contained. Then, we propose here two fast and straightforward approaches for image fusion based on deep neural networks. Our solution uses a multiple source Hourglass architecture trained in an end-to-end fashion. Models are data-driven and can be easily generalized for other kinds of fusion problems. A segmentation approach is used for recognition of the focus map, while the weighted average rule is used for fusion. We designed a training loss function for our regression-based fusion function, which allows the network to learn both the activity level measurement and the fusion rule. Experimental results show our approach has comparable results to the state-of-the-art methods with a 60X increase of computational efficiency for 520X520 resolution images.

READ FULL TEXT

page 1

page 3

page 4

page 6

page 7

page 8

page 9

page 10

research
01/12/2021

UFA-FUSE: A novel deep supervised and hybrid model for multi-focus image fusion

Traditional and deep learning-based fusion methods generated the interme...
research
04/01/2019

The bilateral solver for quality estimation based multi-focus image fusion

In this work, a fast Bilateral Solver for Quality Estimation Based multi...
research
06/11/2019

On Single Source Robustness in Deep Fusion Models

Algorithms that fuse multiple input sources benefit from both complement...
research
03/30/2019

Boundary Aware Multi-Focus Image Fusion Using Deep Neural Network

Since it is usually difficult to capture an all-in-focus image of a 3D s...
research
10/17/2020

Gradient Aware Cascade Network for Multi-Focus Image Fusion

The general aim of multi-focus image fusion is to gather focused regions...
research
04/11/2023

LRRNet: A Novel Representation Learning Guided Fusion Network for Infrared and Visible Images

Deep learning based fusion methods have been achieving promising perform...
research
03/13/2013

Possibilistic Assumption based Truth Maintenance System, Validation in a Data Fusion Application

Data fusion allows the elaboration and the evaluation of a situation syn...

Please sign up or login with your details

Forgot password? Click here to reset