MetaPhys: Unsupervised Few-Shot Adaptation for Non-Contact Physiological Measurement

10/05/2020
by   Xin Liu, et al.
10

There are large individual differences in physiological processes, making designing personalized health sensing algorithms challenging. Existing machine learning systems struggle to generalize well to unseen subjects or contexts, especially in video-based physiological measurement. Although fine-tuning for a user might address this issue, it is difficult to collect large sets of training data for specific individuals because supervised algorithms require medical-grade sensors for generating the training target. Therefore, learning personalized or customized models from a small number of unlabeled samples is very attractive as it would allow fast calibrations. In this paper, we present a novel unsupervised meta-learning approach called MetaPhys for learning personalized cardiac signals from 18-seconds of unlabeled video data. We evaluate our proposed approach on two benchmark datasets and demonstrate superior performance in cross-dataset evaluation with substantial reductions (42 of attention maps and ablation experiments reveal how the model adapts to each subject and why our proposed approach leads to these improvements. We have also demonstrated our proposed method significantly helps reduce the bias in skin type.

READ FULL TEXT

page 4

page 7

page 8

research
01/11/2022

MobilePhys: Personalized Mobile Camera-Based Contactless Physiological Sensing

Camera-based contactless photoplethysmography refers to a set of popular...
research
06/10/2021

Overcoming Difficulty in Obtaining Dark-skinned Subjects for Remote-PPG by Synthetic Augmentation

Camera-based remote photoplethysmography (rPPG) provides a non-contact w...
research
10/24/2020

Advancing Non-Contact Vital Sign Measurement using Synthetic Avatars

Non-contact physiological measurement has the potential to provide low-c...
research
10/07/2022

Private and Efficient Meta-Learning with Low Rank and Sparse Decomposition

Meta-learning is critical for a variety of practical ML systems – like p...
research
03/21/2023

Motion Matters: Neural Motion Transfer for Better Camera Physiological Sensing

Machine learning models for camera-based physiological measurement can h...
research
10/10/2021

Synthetic Data for Multi-Parameter Camera-Based Physiological Sensing

Synthetic data is a powerful tool in training data hungry deep learning ...
research
06/12/2022

DRNet: Decomposition and Reconstruction Network for Remote Physiological Measurement

Remote photoplethysmography (rPPG) based physiological measurement has g...

Please sign up or login with your details

Forgot password? Click here to reset