MFIF-GAN: A New Generative Adversarial Network for Multi-Focus Image Fusion

09/21/2020
by   Yicheng Wang, et al.
0

Multi-Focus Image Fusion (MFIF) is one of the promising techniques to obtain all-in-focus images to meet people's visual needs and it is a precondition of other computer vision tasks. One of the research trends of MFIF is to solve the defocus spread effect (DSE) around the focus/defocus boundary (FDB). In this paper, we present a novel generative adversarial network termed MFIF-GAN to translate multi-focus images into focus maps and to get the all-in-focus images further. The Squeeze and Excitation Residual Network (SE-ResNet) module as an attention mechanism is employed in the network. During the training, we propose reconstruction and gradient regularization loss functions to guarantee the accuracy of generated focus maps. In addition, by combining the prior knowledge of training conditon, this network is trained on a synthetic dataset with DSE based on an α-matte model. A series of experimental results demonstrate that the MFIF-GAN is superior to several representative state-of-the-art (SOTA) algorithms in visual perception, quantitative analysis as well as efficiency.

READ FULL TEXT

page 18

page 20

research
05/20/2022

The effect of loss function on conditional generative adversarial networks

Conditional Generative Adversarial Network (cGAN) is a general purpose a...
research
12/22/2022

Jamdani Motif Generation using Conditional GAN

Jamdani is the strikingly patterned textile heritage of Bangladesh. The ...
research
02/12/2020

MFFW: A new dataset for multi-focus image fusion

Multi-focus image fusion (MFF) is a fundamental task in the field of com...
research
07/26/2019

VITAL: A Visual Interpretation on Text with Adversarial Learning for Image Labeling

In this paper, we propose a novel way to interpret text information by e...
research
07/03/2021

SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network

Single-pixel imaging is a novel imaging scheme that has gained popularit...
research
10/29/2019

An α-Matte Boundary Defocus Model Based Cascaded Network for Multi-focus Image Fusion

Capturing an all-in-focus image with a single camera is difficult since ...
research
11/16/2018

Generative Model for Material Experiments Based on Prior Knowledge and Attention Mechanism

Material irradiation experiment is dangerous and complex, thus it requir...

Please sign up or login with your details

Forgot password? Click here to reset