DeepAI AI Chat
Log In Sign Up

Overcoming Difficulty in Obtaining Dark-skinned Subjects for Remote-PPG by Synthetic Augmentation

by   Yunhao Ba, et al.

Camera-based remote photoplethysmography (rPPG) provides a non-contact way to measure physiological signals (e.g., heart rate) using facial videos. Recent deep learning architectures have improved the accuracy of such physiological measurement significantly, yet they are restricted by the diversity of the annotated videos. The existing datasets MMSE-HR, AFRL, and UBFC-RPPG contain roughly 10 training sets result in a poor generalization capability to unseen subjects and lead to unwanted bias toward different demographic groups. In Western academia, it is regrettably difficult in a university setting to collect data on these dark-skinned subjects. Here we show a first attempt to overcome the lack of dark-skinned subjects by synthetic augmentation. A joint optimization framework is utilized to translate real videos from light-skinned subjects to dark skin tones while retaining their pulsatile signals. In the experiment, our method exhibits around 31 and 46 previous work trained with just real samples.


page 2

page 3

page 4

page 6

page 7

page 14


Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling

Remote physiological measurements, e.g., remote photoplethysmography (rP...

Video-based Remote Physiological Measurement via Self-supervised Learning

Video-based remote physiological measurement aims to estimate remote pho...

Depression Recognition using Remote Photoplethysmography from Facial Videos

Depression is a mental illness that may be harmful to an individual's he...

PhysBench: A Benchmark Framework for Remote Physiological Sensing with New Dataset and Baseline

In recent years, due to the widespread use of internet videos, physiolog...

MetaPhys: Unsupervised Few-Shot Adaptation for Non-Contact Physiological Measurement

There are large individual differences in physiological processes, makin...

Advancing Non-Contact Vital Sign Measurement using Synthetic Avatars

Non-contact physiological measurement has the potential to provide low-c...

Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing

Synthetic data is a powerful tool in training data hungry deep learning ...