Synthesis of High-Quality Visible Faces from Polarimetric Thermal Faces using Generative Adversarial Networks

12/12/2018
by   He Zhang, et al.
8

The large domain discrepancy between faces captured in polarimetric (or conventional) thermal and visible domain makes cross-domain face verification a highly challenging problem for human examiners as well as computer vision algorithms. Previous approaches utilize either a two-step procedure (visible feature estimation and visible image reconstruction) or an input-level fusion technique, where different Stokes images are concatenated and used as a multi-channel input to synthesize the visible image given the corresponding polarimetric signatures. Although these methods have yielded improvements, we argue that input-level fusion alone may not be sufficient to realize the full potential of the available Stokes images. We propose a Generative Adversarial Networks (GAN) based multi-stream feature-level fusion technique to synthesize high-quality visible images from prolarimetric thermal images. The proposed network consists of a generator sub-network, constructed using an encoder-decoder network based on dense residual blocks, and a multi-scale discriminator sub-network. The generator network is trained by optimizing an adversarial loss in addition to a perceptual loss and an identity preserving loss to enable photo realistic generation of visible images while preserving discriminative characteristics. An extended dataset consisting of polarimetric thermal facial signatures of 111 subjects is also introduced. Multiple experiments evaluated on different experimental protocols demonstrate that the proposed method achieves state-of-the-art performance. Code will be made available at https://github.com/hezhangsprinter.

READ FULL TEXT

page 2

page 4

page 10

page 11

page 12

page 13

page 14

research
08/08/2017

Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Faces

The large domain discrepancy between faces captured in polarimetric (or ...
research
04/20/2020

Multi-Scale Thermal to Visible Face Verification via Attribute Guided Synthesis

Thermal-to-visible face verification is a challenging problem due to the...
research
12/08/2022

Shadow Removal by High-Quality Shadow Synthesis

Most shadow removal methods rely on the invasion of training images asso...
research
04/15/2019

Polarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesis

Polarimetric thermal to visible face verification entails matching two i...
research
01/03/2019

Polarimetric Thermal to Visible Face Verification via Attribute Preserved Synthesis

Thermal to visible face verification is a challenging problem due to the...
research
02/13/2020

PCSGAN: Perceptual Cyclic-Synthesized Generative Adversarial Networks for Thermal and NIR to Visible Image Transformation

In many real world scenarios, it is difficult to capture the images in t...
research
11/16/2021

Synthesis-Guided Feature Learning for Cross-Spectral Periocular Recognition

A common yet challenging scenario in periocular biometrics is cross-spec...

Please sign up or login with your details

Forgot password? Click here to reset