Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels

by   Catherine Ordun, et al.

Thermal images reveal medically important physiological information about human stress, signs of inflammation, and emotional mood that cannot be seen on visible images. Providing a method to generate thermal faces from visible images would be highly valuable for the telemedicine community in order to show this medical information. To the best of our knowledge, there are limited works on visible-to-thermal (VT) face translation, and many current works go the opposite direction to generate visible faces from thermal surveillance images (TV) for law enforcement applications. As a result, we introduce favtGAN, a VT GAN which uses the pix2pix image translation model with an auxiliary sensor label prediction network for generating thermal faces from visible images. Since most TV methods are trained on only one data source drawn from one thermal sensor, we combine datasets from faces and cityscapes. These combined data are captured from similar sensors in order to bootstrap the training and transfer learning task, especially valuable because visible-thermal face datasets are limited. Experiments on these combined datasets show that favtGAN demonstrates an increase in SSIM and PSNR scores of generated thermal faces, compared to training on a single face dataset alone.



There are no comments yet.


page 4


TV-GAN: Generative Adversarial Network Based Thermal to Visible Face Recognition

This work tackles the face recognition task on images captured using the...

Deep Cross Polarimetric Thermal-to-visible Face Recognition

In this paper, we present a deep coupled learning frame- work to address...

Polarimetric Thermal to Visible Face Verification via Self-Attention Guided Synthesis

Polarimetric thermal to visible face verification entails matching two i...

A Large-Scale, Time-Synchronized Visible and Thermal Face Dataset

Thermal face imagery, which captures the naturally emitted heat from the...

Human Detection for Night Surveillance using Adaptive Background Subtracted Image

Surveillance based on Computer Vision has become a major necessity in cu...

Multi-Scale Thermal to Visible Face Verification via Attribute Guided Synthesis

Thermal-to-visible face verification is a challenging problem due to the...

Unsupervised Image-generation Enhanced Adaptation for Object Detection in Thermal images

Object detection in thermal images is an important computer vision task ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.