Generative and Discriminative Learning for Distorted Image Restoration

11/11/2020
by   Yi Gu, et al.
5

Liquify is a common technique for image editing, which can be used for image distortion. Due to the uncertainty in the distortion variation, restoring distorted images caused by liquify filter is a challenging task. To edit images in an efficient way, distorted images are expected to be restored automatically. This paper aims at the distorted image restoration, which is characterized by seeking the appropriate warping and completion of a distorted image. Existing methods focus on the hardware assistance or the geometric principle to solve the specific regular deformation caused by natural phenomena, but they cannot handle the irregularity and uncertainty of artificial distortion in this task. To address this issue, we propose a novel generative and discriminative learning method based on deep neural networks, which can learn various reconstruction mappings and represent complex and high-dimensional data. This method decomposes the task into a rectification stage and a refinement stage. The first stage generative network predicts the mapping from the distorted images to the rectified ones. The second stage generative network then further optimizes the perceptual quality. Since there is no available dataset or benchmark to explore this task, we create a Distorted Face Dataset (DFD) by forward distortion mapping based on CelebA dataset. Extensive experimental evaluation on the proposed benchmark and the application demonstrates that our method is an effective way for distorted image restoration.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

page 7

page 8

research
10/07/2019

ATFaceGAN: Single Face Image Restoration and Recognition from Atmospheric Turbulence

Image degradation due to atmospheric turbulence is common while capturin...
research
11/16/2017

The Perception-Distortion Tradeoff

Image restoration algorithms are typically evaluated by some distortion ...
research
03/27/2017

Discriminative Transfer Learning for General Image Restoration

Recently, several discriminative learning approaches have been proposed ...
research
04/11/2023

Panoramic Image-to-Image Translation

In this paper, we tackle the challenging task of Panoramic Image-to-Imag...
research
11/30/2020

Image Quality Assessment for Perceptual Image Restoration: A New Dataset, Benchmark and Metric

Image quality assessment (IQA) is the key factor for the fast developmen...
research
07/20/2022

Single Frame Atmospheric Turbulence Mitigation: A Benchmark Study and A New Physics-Inspired Transformer Model

Image restoration algorithms for atmospheric turbulence are known to be ...
research
07/26/2023

Phenotype-preserving metric design for high-content image reconstruction by generative inpainting

In the past decades, automated high-content microscopy demonstrated its ...

Please sign up or login with your details

Forgot password? Click here to reset