The Use of AI for Thermal Emotion Recognition: A Review of Problems and Limitations in Standard Design and Data

09/22/2020
by   Catherine Ordun, et al.
7

With the increased attention on thermal imagery for Covid-19 screening, the public sector may believe there are new opportunities to exploit thermal as a modality for computer vision and AI. Thermal physiology research has been ongoing since the late nineties. This research lies at the intersections of medicine, psychology, machine learning, optics, and affective computing. We will review the known factors of thermal vs. RGB imaging for facial emotion recognition. But we also propose that thermal imagery may provide a semi-anonymous modality for computer vision, over RGB, which has been plagued by misuse in facial recognition. However, the transition to adopting thermal imagery as a source for any human-centered AI task is not easy and relies on the availability of high fidelity data sources across multiple demographics and thorough validation. This paper takes the reader on a short review of machine learning in thermal FER and the limitations of collecting and developing thermal FER data for AI training. Our motivation is to provide an introductory overview into recent advances for thermal FER and stimulate conversation about the limitations in current datasets.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 7

page 8

page 9

research
08/23/2023

A Generative Approach for Image Registration of Visible-Thermal (VT) Cancer Faces

Since thermal imagery offers a unique modality to investigate pain, the ...
research
09/20/2019

PST900: RGB-Thermal Calibration, Dataset and Segmentation Network

In this work we propose long wave infrared (LWIR) imagery as a viable su...
research
12/13/2020

Spontaneous Emotion Recognition from Facial Thermal Images

One of the key research areas in computer vision addressed by a vast num...
research
04/29/2022

A Novel Fully Annotated Thermal Infrared Face Dataset: Recorded in Various Environment Conditions and Distances From The Camera

Facial thermography is one of the most popular research areas in infrare...
research
05/19/2023

RGB-D And Thermal Sensor Fusion: A Systematic Literature Review

In the last decade, the computer vision field has seen significant progr...
research
07/29/2020

3D Fusion of Infrared Images with Dense RGB Reconstruction from Multiple Views – with Application to Fire-fighting Robots

This project integrates infrared and RGB imagery to produce dense 3D env...

Please sign up or login with your details

Forgot password? Click here to reset