Heterogeneous Face Frontalization via Domain Agnostic Learning

07/17/2021
by   Xing Di, et al.
3

Recent advances in deep convolutional neural networks (DCNNs) have shown impressive performance improvements on thermal to visible face synthesis and matching problems. However, current DCNN-based synthesis models do not perform well on thermal faces with large pose variations. In order to deal with this problem, heterogeneous face frontalization methods are needed in which a model takes a thermal profile face image and generates a frontal visible face. This is an extremely difficult problem due to the large domain as well as large pose discrepancies between the two modalities. Despite its applications in biometrics and surveillance, this problem is relatively unexplored in the literature. We propose a domain agnostic learning-based generative adversarial network (DAL-GAN) which can synthesize frontal views in the visible domain from thermal faces with pose variations. DAL-GAN consists of a generator with an auxiliary classifier and two discriminators which capture both local and global texture discriminations for better synthesis. A contrastive constraint is enforced in the latent space of the generator with the help of a dual-path training strategy, which improves the feature vector discrimination. Finally, a multi-purpose loss function is utilized to guide the network in synthesizing identity preserving cross-domain frontalization. Extensive experimental results demonstrate that DAL-GAN can generate better quality frontal views compared to the other baseline methods.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 6

page 7

research
04/15/2019

Polarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesis

Polarimetric thermal to visible face verification entails matching two i...
research
08/08/2017

Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Faces

The large domain discrepancy between faces captured in polarimetric (or ...
research
02/25/2022

FSGANv2: Improved Subject Agnostic Face Swapping and Reenactment

We present Face Swapping GAN (FSGAN) for face swapping and reenactment. ...
research
01/03/2019

Polarimetric Thermal to Visible Face Verification via Attribute Preserved Synthesis

Thermal to visible face verification is a challenging problem due to the...
research
09/10/2019

Pose Agnostic Cross-spectral Hallucination via Disentangling Independent Factors

The cross-sensor gap is one of the challenges that arise much research i...
research
08/16/2019

FSGAN: Subject Agnostic Face Swapping and Reenactment

We present Face Swapping GAN (FSGAN) for face swapping and reenactment. ...
research
12/11/2022

Mutimodal Ranking Optimization for Heterogeneous Face Re-identification

Heterogeneous face re-identification, namely matching heterogeneous face...

Please sign up or login with your details

Forgot password? Click here to reset