SuperFront: From Low-resolution to High-resolution Frontal Face Synthesis

12/07/2020
by   Yu Yin, et al.
13

Advances in face rotation, along with other face-based generative tasks, are more frequent as we advance further in topics of deep learning. Even as impressive milestones are achieved in synthesizing faces, the importance of preserving identity is needed in practice and should not be overlooked. Also, the difficulty should not be more for data with obscured faces, heavier poses, and lower quality. Existing methods tend to focus on samples with variation in pose, but with the assumption data is high in quality. We propose a generative adversarial network (GAN) -based model to generate high-quality, identity preserving frontal faces from one or multiple low-resolution (LR) faces with extreme poses. Specifically, we propose SuperFront-GAN (SF-GAN) to synthesize a high-resolution (HR), frontal face from one-to-many LR faces with various poses and with the identity-preserved. We integrate a super-resolution (SR) side-view module into SF-GAN to preserve identity information and fine details of the side-views in HR space, which helps model reconstruct high-frequency information of faces (i.e., periocular, nose, and mouth regions). Moreover, SF-GAN accepts multiple LR faces as input, and improves each added sample. We squeeze additional gain in performance with an orthogonal constraint in the generator to penalize redundant latent representations and, hence, diversify the learned features space. Quantitative and qualitative results demonstrate the superiority of SF-GAN over others.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 3

page 5

page 6

page 7

05/16/2019

FH-GAN: Face Hallucination and Recognition using Generative Adversarial Network

There are many factors affecting visual face recognition, such as low re...
11/06/2018

Super-Identity Convolutional Neural Network for Face Hallucination

Face hallucination is a generative task to super-resolve the facial imag...
03/25/2021

JDSR-GAN: Constructing A Joint and Collaborative Learning Network for Masked Face Super-Resolution

With the growing importance of preventing the COVID-19 virus, face image...
10/03/2017

GP-GAN: Gender Preserving GAN for Synthesizing Faces from Landmarks

Facial landmarks constitute the most compressed representation of faces ...
03/09/2022

Region-Aware Face Swapping

This paper presents a novel Region-Aware Face Swapping (RAFSwap) network...
09/14/2018

A study on the use of Boundary Equilibrium GAN for Approximate Frontalization of Unconstrained Faces to aid in Surveillance

Face frontalization is the process of synthesizing frontal facing views ...
07/22/2018

SiGAN: Siamese Generative Adversarial Network for Identity-Preserving Face Hallucination

Despite generative adversarial networks (GANs) can hallucinate photo-rea...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.