HiFaceGAN: Face Renovation via Collaborative Suppression and Replenishment

05/11/2020
by   Lingbo Yang, et al.
4

Existing face restoration researches typically relies on either the degradation prior or explicit guidance labels for training, which often results in limited generalization ability over real-world images with heterogeneous degradations and rich background contents. In this paper, we investigate the more challenging and practical "dual-blind" version of the problem by lifting the requirements on both types of prior, termed as "Face Renovation"(FR). Specifically, we formulated FR as a semantic-guided generation problem and tackle it with a collaborative suppression and replenishment (CSR) approach. This leads to HiFaceGAN, a multi-stage framework containing several nested CSR units that progressively replenish facial details based on the hierarchical semantic guidance extracted from the front-end content-adaptive suppression modules. Extensive experiments on both synthetic and real face images have verified the superior performance of HiFaceGAN over a wide range of challenging restoration subtasks, demonstrating its versatility, robustness and generalization ability towards real-world face processing applications.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

page 8

research
05/28/2022

Enhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior

Facial semantic guidance (facial landmarks, facial parsing maps, facial ...
research
10/12/2020

Implicit Subspace Prior Learning for Dual-Blind Face Restoration

Face restoration is an inherently ill-posed problem, where additional pr...
research
01/26/2023

Dual Diffusion Architecture for Fisheye Image Rectification: Synthetic-to-Real Generalization

Fisheye image rectification has a long-term unresolved issue with synthe...
research
08/14/2023

RestoreFormer++: Towards Real-World Blind Face Restoration from Undegraded Key-Value Pairs

Blind face restoration aims at recovering high-quality face images from ...
research
06/22/2022

Towards Robust Blind Face Restoration with Codebook Lookup Transformer

Blind face restoration is a highly ill-posed problem that often requires...
research
10/25/2021

Federated Test-Time Adaptive Face Presentation Attack Detection with Dual-Phase Privacy Preservation

Face presentation attack detection (fPAD) plays a critical role in the m...
research
04/19/2022

A comparison of different atmospheric turbulence simulation methods for image restoration

Atmospheric turbulence deteriorates the quality of images captured by lo...

Please sign up or login with your details

Forgot password? Click here to reset