Joint Face Super-Resolution and Deblurring Using a Generative Adversarial Network

12/22/2019
by   Jung Un Yun, et al.
31

Facial image super-resolution (SR) is an important preprocessing for facial image analysis, face recognition, and image-based 3D face reconstruction. Recent convolutional neural network (CNN) based method has shown excellent performance by learning mapping relation using pairs of low-resolution (LR) and high-resolution (HR) facial images. However, since the HR facial image reconstruction using CNN is conventionally aimed to increase the PSNR and SSIM metrics, the reconstructed HR image might not be realistic even with high scores. An adversarial framework is proposed in this study to reconstruct the HR facial image by simultaneously generating an HR image with and without blur. First, the spatial resolution of the LR facial image is increased by eight times using a five-layer CNN. Then, the encoder extracts the features of the up-scaled image. These features are finally sent to two branches (decoders) to generate an HR facial image with and without blur. In addition, local and global discriminators are combined to focus on the reconstruction of HR facial structures. Experiment results show that the proposed algorithm generates a realistic HR facial image. Furthermore, the proposed method can generate a variety of different facial images.

READ FULL TEXT

page 1

page 3

page 5

page 6

page 7

page 8

research
11/29/2017

FSRNet: End-to-End Learning Face Super-Resolution with Facial Priors

Face Super-Resolution (SR) is a domain-specific super-resolution problem...
research
10/22/2020

Face Hallucination Using Split-Attention in Split-Attention Network

Face hallucination is a domain-specific super-resolution (SR), that gene...
research
06/17/2019

Exemplar Guided Face Image Super-Resolution without Facial Landmarks

Nowadays, due to the ubiquitous visual media there are vast amounts of a...
research
04/19/2022

CTCNet: A CNN-Transformer Cooperation Network for Face Image Super-Resolution

Recently, deep convolution neural networks (CNNs) steered face super-res...
research
07/04/2017

High-Quality Face Image SR Using Conditional Generative Adversarial Networks

We propose a novel single face image super-resolution method, which name...
research
08/27/2020

Edge and Identity Preserving Network for Face Super-Resolution

Face super-resolution has become an indispensable part in security probl...
research
06/30/2020

Rethinking CNN-Based Pansharpening: Guided Colorization of Panchromatic Images via GANs

Convolutional Neural Networks (CNN)-based approaches have shown promisin...

Please sign up or login with your details

Forgot password? Click here to reset