When Visible-to-Thermal Facial GAN Beats Conditional Diffusion

02/18/2023
by   Catherine Ordun, et al.
0

Thermal facial imagery offers valuable insight into physiological states such as inflammation and stress by detecting emitted radiation in the infrared spectrum, which is unseen in the visible spectra. Telemedicine applications could benefit from thermal imagery, but conventional computers are reliant on RGB cameras and lack thermal sensors. As a result, we propose the Visible-to-Thermal Facial GAN (VTF-GAN) that is specifically designed to generate high-resolution thermal faces by learning both the spatial and frequency domains of facial regions, across spectra. We compare VTF-GAN against several popular GAN baselines and the first conditional Denoising Diffusion Probabilistic Model (DDPM) for VT face translation (VTF-Diff). Results show that VTF-GAN achieves high quality, crisp, and perceptually realistic thermal faces using a combined set of patch, temperature, perceptual, and Fourier Transform losses, compared to all baselines including diffusion.

READ FULL TEXT

page 1

page 2

page 4

page 5

page 8

page 9

page 10

research
06/15/2021

Generating Thermal Human Faces for Physiological Assessment Using Thermal Sensor Auxiliary Labels

Thermal images reveal medically important physiological information abou...
research
09/19/2022

T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models

Modern-day surveillance systems perform person recognition using deep le...
research
04/22/2023

VisiTherS: Visible-thermal infrared stereo disparity estimation of human silhouette

This paper presents a novel approach for visible-thermal infrared stereo...
research
11/17/2022

Learning Domain and Pose Invariance for Thermal-to-Visible Face Recognition

Interest in thermal to visible face recognition has grown significantly ...
research
06/10/2023

Vista-Morph: Unsupervised Image Registration of Visible-Thermal Facial Pairs

For a variety of biometric cross-spectral tasks, Visible-Thermal (VT) fa...
research
08/23/2023

A Generative Approach for Image Registration of Visible-Thermal (VT) Cancer Faces

Since thermal imagery offers a unique modality to investigate pain, the ...
research
06/07/2013

Vesselness features and the inverse compositional AAM for robust face recognition using thermal IR

Over the course of the last decade, infrared (IR) and particularly therm...

Please sign up or login with your details

Forgot password? Click here to reset