Learning to restore images degraded by atmospheric turbulence using uncertainty

07/07/2022
by   Rajeev Yasarla, et al.
0

Atmospheric turbulence can significantly degrade the quality of images acquired by long-range imaging systems by causing spatially and temporally random fluctuations in the index of refraction of the atmosphere. Variations in the refractive index causes the captured images to be geometrically distorted and blurry. Hence, it is important to compensate for the visual degradation in images caused by atmospheric turbulence. In this paper, we propose a deep learning-based approach for restring a single image degraded by atmospheric turbulence. We make use of the epistemic uncertainty based on Monte Carlo dropouts to capture regions in the image where the network is having hard time restoring. The estimated uncertainty maps are then used to guide the network to obtain the restored image. Extensive experiments are conducted on synthetic and real images to show the significance of the proposed work. Code is available at : https://github.com/rajeevyasarla/AT-Net

READ FULL TEXT

page 2

page 4

research
04/26/2021

Recalibration of Aleatoric and Epistemic Regression Uncertainty in Medical Imaging

The consideration of predictive uncertainty in medical imaging with deep...
research
08/24/2022

AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models

Although many long-range imaging systems are designed to support extende...
research
07/19/2023

Uncertainty-Driven Multi-Scale Feature Fusion Network for Real-time Image Deraining

Visual-based measurement systems are frequently affected by rainy weathe...
research
04/05/2023

Learning to Compare Longitudinal Images

Longitudinal studies, where a series of images from the same set of indi...
research
03/31/2023

Joint Depth Estimation and Mixture of Rain Removal From a Single Image

Rainy weather significantly deteriorates the visibility of scene objects...
research
10/18/2022

Degradation-invariant Enhancement of Fundus Images via Pyramid Constraint Network

As an economical and efficient fundus imaging modality, retinal fundus i...
research
12/04/2021

LTT-GAN: Looking Through Turbulence by Inverting GANs

In many applications of long-range imaging, we are faced with a scenario...

Please sign up or login with your details

Forgot password? Click here to reset