Learning to Restore a Single Face Image Degraded by Atmospheric Turbulence using CNNs

07/16/2020
by   Rajeev Yasarla, et al.
4

Atmospheric turbulence significantly affects imaging systems which use light that has propagated through long atmospheric paths. Images captured under such condition suffer from a combination of geometric deformation and space varying blur. We present a deep learning-based solution to the problem of restoring a turbulence-degraded face image where prior information regarding the amount of geometric distortion and blur at each location of the face image is first estimated using two separate networks. The estimated prior information is then used by a network called, Turbulence Distortion Removal Network (TDRN), to correct geometric distortion and reduce blur in the face image. Furthermore, a novel loss is proposed to train TDRN where first and second order image gradients are computed along with their confidence maps to mitigate the effect of turbulence degradation. Comprehensive experiments on synthetic and real face images show that this framework is capable of alleviating blur and geometric distortion caused by atmospheric turbulence, and significantly improves the visual quality. In addition, an ablation study is performed to demonstrate the improvements obtained by different modules in the proposed method.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

page 8

page 10

research
05/13/2021

Network Architecture Search for Face Enhancement

Various factors such as ambient lighting conditions, noise, motion blur,...
research
10/07/2019

ATFaceGAN: Single Face Image Restoration and Recognition from Atmospheric Turbulence

Image degradation due to atmospheric turbulence is common while capturin...
research
11/27/2017

DeepDeblur: Fast one-step blurry face images restoration

We propose a very fast and effective one-step restoring method for blurr...
research
07/20/2022

Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Model

Image restoration algorithms for atmospheric turbulence are known to be ...
research
01/17/2014

Distortion-driven Turbulence Effect Removal using Variational Model

It remains a challenge to simultaneously remove geometric distortion and...
research
02/14/2023

Take a Prior from Other Tasks for Severe Blur Removal

Recovering clear structures from severely blurry inputs is a challenging...
research
08/24/2022

AT-DDPM: Restoring Faces degraded by Atmospheric Turbulence using Denoising Diffusion Probabilistic Models

Although many long-range imaging systems are designed to support extende...

Please sign up or login with your details

Forgot password? Click here to reset