Accelerating Multiframe Blind Deconvolution via Deep Learning

06/21/2023
by   A. Asensio Ramos, et al.
0

Ground-based solar image restoration is a computationally expensive procedure that involves nonlinear optimization techniques. The presence of atmospheric turbulence produces perturbations in individual images that make it necessary to apply blind deconvolution techniques. These techniques rely on the observation of many short exposure frames that are used to simultaneously infer the instantaneous state of the atmosphere and the unperturbed object. We have recently explored the use of machine learning to accelerate this process, with promising results. We build upon this previous work to propose several interesting improvements that lead to better models. As well, we propose a new method to accelerate the restoration based on algorithm unrolling. In this method, the image restoration problem is solved with a gradient descent method that is unrolled and accelerated aided by a few small neural networks. The role of the neural networks is to correct the estimation of the solution at each iterative step. The model is trained to perform the optimization in a small fixed number of steps with a curated dataset. Our findings demonstrate that both methods significantly reduce the restoration time compared to the standard optimization procedure. Furthermore, we showcase that these models can be trained in an unsupervised manner using observed images from three different instruments. Remarkably, they also exhibit robust generalization capabilities when applied to new datasets. To foster further research and collaboration, we openly provide the trained models, along with the corresponding training and evaluation code, as well as the training dataset, to the scientific community.

READ FULL TEXT

page 16

page 17

page 19

page 20

page 21

research
06/02/2020

Learning to do multiframe blind deconvolution unsupervisedly

Observation from ground based telescopes are affected by the presence of...
research
05/17/2019

Rethinking Atmospheric Turbulence Mitigation

State-of-the-art atmospheric turbulence image restoration methods utiliz...
research
03/29/2017

Image Restoration using Autoencoding Priors

We propose to leverage denoising autoencoder networks as priors to addre...
research
11/10/2022

ClassPruning: Speed Up Image Restoration Networks by Dynamic N:M Pruning

Image restoration tasks have achieved tremendous performance improvement...
research
04/16/2019

A Deep Optimization Approach for Image Deconvolution

In blind image deconvolution, priors are often leveraged to constrain th...
research
04/10/2018

Learning an Optimizer for Image Deconvolution

As an integral component of blind image deblurring, non-blind deconvolut...
research
07/12/2020

Deep Learning-based Resource Allocation for Infrastructure Resilience

From an optimization point of view, resource allocation is one of the co...

Please sign up or login with your details

Forgot password? Click here to reset