TV-GAN: Generative Adversarial Network Based Thermal to Visible Face Recognition

12/07/2017
by   Teng Zhang, et al.
0

This work tackles the face recognition task on images captured using thermal camera sensors which can operate in the non-light environment. While it can greatly increase the scope and benefits of the current security surveillance systems, performing such a task using thermal images is a challenging problem compared to face recognition task in the Visible Light Domain (VLD). This is partly due to the much smaller amount number of thermal imagery data collected compared to the VLD data. Unfortunately, direct application of the existing very strong face recognition models trained using VLD data into the thermal imagery data will not produce a satisfactory performance. This is due to the existence of the domain gap between the thermal and VLD images. To this end, we propose a Thermal-to-Visible Generative Adversarial Network (TV-GAN) that is able to transform thermal face images into their corresponding VLD images whilst maintaining identity information which is sufficient enough for the existing VLD face recognition models to perform recognition. Some examples are presented in Figure 1. Unlike the previous methods, our proposed TV-GAN uses an explicit closed-set face recognition loss to regularize the discriminator network training. This information will then be conveyed into the generator network in the forms of gradient loss. In the experiment, we show that by using this additional explicit regularization for the discriminator network, the TV-GAN is able to preserve more identity information when translating a thermal image of a person which is not seen before by the TV-GAN.

READ FULL TEXT

page 2

page 8

research
03/03/2019

Matching Thermal to Visible Face Images Using a Semantic-Guided Generative Adversarial Network

Designing face recognition systems that are capable of matching face ima...
research
08/08/2017

Generative Adversarial Network-based Synthesis of Visible Faces from Polarimetric Thermal Faces

The large domain discrepancy between faces captured in polarimetric (or ...
research
06/15/2021

Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels

Thermal images reveal medically important physiological information abou...
research
04/13/2021

Simultaneous Face Hallucination and Translation for Thermal to Visible Face Verification using Axial-GAN

Existing thermal-to-visible face verification approaches expect the ther...
research
07/27/2019

Attribute-Guided Deep Polarimetric Thermal-to-visible Face Recognition

In this paper, we present an attribute-guided deep coupled learning fram...
research
05/03/2022

A Bidirectional Conversion Network for Cross-Spectral Face Recognition

Face recognition in the infrared (IR) band has become an important suppl...
research
08/19/2020

Cross-Domain Identification for Thermal-to-Visible Face Recognition

Recent advances in domain adaptation, especially those applied to hetero...

Please sign up or login with your details

Forgot password? Click here to reset