DeepAI AI Chat
Log In Sign Up

DRNet: Decomposition and Reconstruction Network for Remote Physiological Measurement

by   Yuhang Dong, et al.
Shandong University
Tencent QQ

Remote photoplethysmography (rPPG) based physiological measurement has great application values in affective computing, non-contact health monitoring, telehealth monitoring, etc, which has become increasingly important especially during the COVID-19 pandemic. Existing methods are generally divided into two groups. The first focuses on mining the subtle blood volume pulse (BVP) signals from face videos, but seldom explicitly models the noises that dominate face video content. They are susceptible to the noises and may suffer from poor generalization ability in unseen scenarios. The second focuses on modeling noisy data directly, resulting in suboptimal performance due to the lack of regularity of these severe random noises. In this paper, we propose a Decomposition and Reconstruction Network (DRNet) focusing on the modeling of physiological features rather than noisy data. A novel cycle loss is proposed to constrain the periodicity of physiological information. Besides, a plug-and-play Spatial Attention Block (SAB) is proposed to enhance features along with the spatial location information. Furthermore, an efficient Patch Cropping (PC) augmentation strategy is proposed to synthesize augmented samples with different noise and features. Extensive experiments on different public datasets as well as the cross-database testing demonstrate the effectiveness of our approach.


page 3

page 4

page 5

page 6


Video-based Remote Physiological Measurement via Cross-verified Feature Disentangling

Remote physiological measurements, e.g., remote photoplethysmography (rP...

Neuron Structure Modeling for Generalizable Remote Physiological Measurement

Remote photoplethysmography (rPPG) technology has drawn increasing atten...

Dual-path TokenLearner for Remote Photoplethysmography-based Physiological Measurement with Facial Videos

Remote photoplethysmography (rPPG) based physiological measurement is an...

Remote Blood Oxygen Estimation From Videos Using Neural Networks

Blood oxygen saturation (SpO_2) is an essential indicator of respiratory...

Non-Contrastive Unsupervised Learning of Physiological Signals from Video

Subtle periodic signals such as blood volume pulse and respiration can b...

MetaPhys: Unsupervised Few-Shot Adaptation for Non-Contact Physiological Measurement

There are large individual differences in physiological processes, makin...