DeepAI AI Chat
Log In Sign Up

Multi-Head Cross-Attentional PPG and Motion Signal Fusion for Heart Rate Estimation

by   Panagiotis Kasnesis, et al.

Nowadays, Hearth Rate (HR) monitoring is a key feature of almost all wrist-worn devices exploiting photoplethysmography (PPG) sensors. However, arm movements affect the performance of PPG-based HR tracking. This issue is usually addressed by fusing the PPG signal with data produced by inertial measurement units. Thus, deep learning algorithms have been proposed, but they are considered too complex to deploy on wearable devices and lack the explainability of results. In this work, we present a new deep learning model, PULSE, which exploits temporal convolutions and multi-head cross-attention to improve sensor fusion's effectiveness and achieve a step towards explainability. We evaluate the performance of PULSE on three publicly available datasets, reducing the mean absolute error by 7.56 extensive available dataset, PPG-DaLiA. Finally, we demonstrate the explainability of PULSE and the benefits of applying attention modules to PPG and motion data.


page 2

page 4


Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices

Hearth Rate (HR) monitoring is increasingly performed in wrist-worn devi...

PPGnet: Deep Network for Device Independent Heart Rate Estimation from Photoplethysmogram

Photoplethysmogram (PPG) is increasingly used to provide monitoring of t...

Embedding Temporal Convolutional Networks for Energy-Efficient PPG-Based Heart Rate Monitoring

Photoplethysmography (PPG) sensors allow for non-invasive and comfortabl...

Augmenting Inertial Motion Capture with SLAM Using EKF and SRUKF Data Fusion Algorithms

Inertial motion capture systems widely use low-cost IMUs to obtain the o...

Motion-resilient Heart Rate Monitoring with In-ear Microphones

With the soaring adoption of in-ear wearables, the research community ha...

RRWaveNet: A Compact End-to-End Multi-Scale Residual CNN for Robust PPG Respiratory Rate Estimation

Respiratory rate (RR) is an important biomarker as RR changes can reflec...