A Synthesis-Based Approach for Thermal-to-Visible Face Verification

08/21/2021
by   Neehar Peri, et al.
2

In recent years, visible-spectrum face verification systems have been shown to match expert forensic examiner recognition performance. However, such systems are ineffective in low-light and nighttime conditions. Thermal face imagery, which captures body heat emissions, effectively augments the visible spectrum, capturing discriminative facial features in scenes with limited illumination. Due to the increased cost and difficulty of obtaining diverse, paired thermal and visible spectrum datasets, algorithms and large-scale benchmarks for low-light recognition are limited. This paper presents an algorithm that achieves state-of-the-art performance on both the ARL-VTF and TUFTS multi-spectral face datasets. Importantly, we study the impact of face alignment, pixel-level correspondence, and identity classification with label smoothing for multi-spectral face synthesis and verification. We show that our proposed method is widely applicable, robust, and highly effective. In addition, we show that the proposed method significantly outperforms face frontalization methods on profile-to-frontal verification. Finally, we present MILAB-VTF(B), a challenging multi-spectral face dataset that is composed of paired thermal and visible videos. To the best of our knowledge, with face data from 400 subjects, this dataset represents the most extensive collection of publicly available indoor and long-range outdoor thermal-visible face imagery. Lastly, we show that our end-to-end thermal-to-visible face verification system provides strong performance on the MILAB-VTF(B) dataset.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 6

research
01/07/2021

A Large-Scale, Time-Synchronized Visible and Thermal Face Dataset

Thermal face imagery, which captures the naturally emitted heat from the...
research
04/06/2022

Thermal to Visible Image Synthesis under Atmospheric Turbulence

In many practical applications of long-range imaging such as biometrics ...
research
03/20/2018

Thermal to Visible Synthesis of Face Images using Multiple Regions

Synthesis of visible spectrum faces from thermal facial imagery is a pro...
research
03/30/2022

Escaping Data Scarcity for High-Resolution Heterogeneous Face Hallucination

In Heterogeneous Face Recognition (HFR), the objective is to match faces...
research
05/02/2023

Humans as Light Bulbs: 3D Human Reconstruction from Thermal Reflection

The relatively hot temperature of the human body causes people to turn i...
research
09/19/2022

T2V-DDPM: Thermal to Visible Face Translation using Denoising Diffusion Probabilistic Models

Modern-day surveillance systems perform person recognition using deep le...
research
06/08/2020

Pixel-Wise Motion Deblurring of Thermal Videos

Uncooled microbolometers can enable robots to see in the absence of visi...

Please sign up or login with your details

Forgot password? Click here to reset