Deep Fusion Prior for Multi-Focus Image Super Resolution Fusion

10/12/2021
by   Yuanjie Gu, et al.
15

This paper unifies the multi-focus images fusion (MFIF) and blind super resolution (SR) problems as the multi-focus image super resolution fusion (MFISRF) task, and proposes a novel unified dataset-free unsupervised framework named deep fusion prior (DFP) to address such MFISRF task. DFP consists of SKIPnet network, DoubleReblur focus measurement tactic, decision embedding module and loss functions. In particular, DFP can obtain MFISRF only from two low-resolution inputs without any extent dataset; SKIPnet implementing unsupervised learning via deep image prior is an end-to-end generated network acting as the engine of DFP; DoubleReblur is used to determine the primary decision map without learning but based on estimated PSF and Gaussian kernels convolution; decision embedding module optimizes the decision map via learning; and DFP losses composed of content loss, joint gradient loss and gradient limit loss can obtain high-quality MFISRF results robustly. Experiments have proved that our proposed DFP approaches and even outperforms those state-of-art MFIF and SR method combinations. Additionally, DFP is a general framework, thus its networks and focus measurement tactics can be continuously updated to further improve the MFISRF performance. DFP codes are open source and will be available soon at http://github.com/GuYuanjie/DeepFusionPrior.

READ FULL TEXT

page 3

page 7

page 9

page 11

page 12

page 16

page 17

research
12/06/2021

A Dataset-free Self-supervised Disentangled Learning Method for Adaptive Infrared and Visible Images Super-resolution Fusion

This study proposes a novel general dataset-free self-supervised learnin...
research
03/16/2022

Hybrid Pixel-Unshuffled Network for Lightweight Image Super-Resolution

Convolutional neural network (CNN) has achieved great success on image s...
research
10/27/2010

Selective Image Super-Resolution

In this paper we propose a vision system that performs image Super Resol...
research
02/26/2022

Multi-image Super-resolution via Quality Map Associated Temporal Attention Network

With the rising interest in deep learning-based methods in remote sensin...
research
11/24/2020

Multi-Scale Progressive Fusion Learning for Depth Map Super-Resolution

Limited by the cost and technology, the resolution of depth map collecte...
research
07/27/2023

A full-resolution training framework for Sentinel-2 image fusion

This work presents a new unsupervised framework for training deep learni...
research
02/27/2021

Super-resolution-based Change Detection Network with Stacked Attention Module for Images with Different Resolutions

Change detection, which aims to distinguish surface changes based on bi-...

Please sign up or login with your details

Forgot password? Click here to reset