Face2PPG: An unsupervised pipeline for blood volume pulse extraction from faces

by   Constantino Álvarez Casado, et al.
University of Oulu

Photoplethysmography (PPG) signals have become a key technology in many fields such as medicine, well-being, or sports. Our work proposes a set of pipelines to extract remote PPG signals (rPPG) from the face, robustly, reliably, and in a configurable manner. We identify and evaluate the possible choices in the critical steps of unsupervised rPPG methodologies. We evaluate a state-of-the-art processing pipeline in six different datasets, incorporating important corrections in the methodology that ensure reproducible and fair comparisons. In addition, we extend the pipeline by proposing three novel ideas; 1) a new method to stabilize the detected face based on a rigid mesh normalization; 2) a new method to dynamically select the different regions in the face that provide the best raw signals, and 3) a new RGB to rPPG transformation method called Orthogonal Matrix Image Transformation (OMIT) based on QR decomposition, that increases robustness against compression artifacts. We show that all three changes introduce noticeable improvements in retrieving rPPG signals from faces, obtaining state-of-the-art results compared with unsupervised, non-learning-based methodologies, and in some databases, very close to supervised, learning-based methods. We perform a comparative study to quantify the contribution of each proposed idea. In addition, we depict a series of observations that could help in future implementations.


page 3

page 6

page 8

page 9

page 10

page 16


Contrast-Phys: Unsupervised Video-based Remote Physiological Measurement via Spatiotemporal Contrast

Video-based remote physiological measurement utilizes face videos to mea...

The Way to my Heart is through Contrastive Learning: Remote Photoplethysmography from Unlabelled Video

The ability to reliably estimate physiological signals from video is a p...

RANSIP : From noisy point clouds to complete ear models, unsupervised

Ears are a particularly difficult region of the human face to model, not...

Unsupervised ore/waste classification on open-cut mine faces using close-range hyperspectral data

The remote mapping of minerals and discrimination of ore and waste on su...

LDFA: Latent Diffusion Face Anonymization for Self-driving Applications

In order to protect vulnerable road users (VRUs), such as pedestrians or...

Improved Touchless Respiratory Rate Sensing

Recently, remote respiratory rate measurement techniques gained much att...

Please sign up or login with your details

Forgot password? Click here to reset