DeepAI
Log In Sign Up

GAN Prior Embedded Network for Blind Face Restoration in the Wild

05/13/2021
by   Tao Yang, et al.
45

Blind face restoration (BFR) from severely degraded face images in the wild is a very challenging problem. Due to the high illness of the problem and the complex unknown degradation, directly training a deep neural network (DNN) usually cannot lead to acceptable results. Existing generative adversarial network (GAN) based methods can produce better results but tend to generate over-smoothed restorations. In this work, we propose a new method by first learning a GAN for high-quality face image generation and embedding it into a U-shaped DNN as a prior decoder, then fine-tuning the GAN prior embedded DNN with a set of synthesized low-quality face images. The GAN blocks are designed to ensure that the latent code and noise input to the GAN can be respectively generated from the deep and shallow features of the DNN, controlling the global face structure, local face details and background of the reconstructed image. The proposed GAN prior embedded network (GPEN) is easy-to-implement, and it can generate visually photo-realistic results. Our experiments demonstrated that the proposed GPEN achieves significantly superior results to state-of-the-art BFR methods both quantitatively and qualitatively, especially for the restoration of severely degraded face images in the wild. The source code and models can be found at https://github.com/yangxy/GPEN.

READ FULL TEXT

page 2

page 4

page 6

page 7

page 8

03/06/2022

Semantic-Aware Latent Space Exploration for Face Image Restoration

For image restoration, most existing deep learning based methods tend to...
09/18/2020

Progressive Semantic-Aware Style Transformation for Blind Face Restoration

Face restoration is important in face image processing, and has been wid...
03/16/2022

Panini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration

Emerging high-quality face restoration (FR) methods often utilize pre-tr...
03/30/2020

Exploiting Deep Generative Prior for Versatile Image Restoration and Manipulation

Learning a good image prior is a long-term goal for image restoration an...
03/07/2019

Learning deep neural networks in blind deblurring framework

Recently, end-to-end learning methods based on deep neural network (DNN)...
10/03/2021

Universal Face Restoration With Memorized Modulation

Blind face restoration (BFR) is a challenging problem because of the unc...
10/03/2022

From Face to Natural Image: Learning Real Degradation for Blind Image Super-Resolution

Designing proper training pairs is critical for super-resolving the real...

Code Repositories

SimSwap-colab

Colab notebooks to apply SimSwap to images, animated GIF files, and videos.


view repo