Multi-Head Cross-Attentional PPG and Motion Signal Fusion for Heart Rate Estimation

10/14/2022
by   Panagiotis Kasnesis, et al.
0

Nowadays, Hearth Rate (HR) monitoring is a key feature of almost all wrist-worn devices exploiting photoplethysmography (PPG) sensors. However, arm movements affect the performance of PPG-based HR tracking. This issue is usually addressed by fusing the PPG signal with data produced by inertial measurement units. Thus, deep learning algorithms have been proposed, but they are considered too complex to deploy on wearable devices and lack the explainability of results. In this work, we present a new deep learning model, PULSE, which exploits temporal convolutions and multi-head cross-attention to improve sensor fusion's effectiveness and achieve a step towards explainability. We evaluate the performance of PULSE on three publicly available datasets, reducing the mean absolute error by 7.56 extensive available dataset, PPG-DaLiA. Finally, we demonstrate the explainability of PULSE and the benefits of applying attention modules to PPG and motion data.

READ FULL TEXT

page 2

page 4

research
03/24/2022

Q-PPG: Energy-Efficient PPG-based Heart Rate Monitoring on Wearable Devices

Hearth Rate (HR) monitoring is increasingly performed in wrist-worn devi...
research
03/21/2019

PPGnet: Deep Network for Device Independent Heart Rate Estimation from Photoplethysmogram

Photoplethysmogram (PPG) is increasingly used to provide monitoring of t...
research
03/01/2022

Embedding Temporal Convolutional Networks for Energy-Efficient PPG-Based Heart Rate Monitoring

Photoplethysmography (PPG) sensors allow for non-invasive and comfortabl...
research
02/16/2023

Augmenting Inertial Motion Capture with SLAM Using EKF and SRUKF Data Fusion Algorithms

Inertial motion capture systems widely use low-cost IMUs to obtain the o...
research
08/14/2023

Deep convolutional neural networks for cyclic sensor data

Predictive maintenance plays a critical role in ensuring the uninterrupt...
research
08/18/2022

RRWaveNet: A Compact End-to-End Multi-Scale Residual CNN for Robust PPG Respiratory Rate Estimation

Respiratory rate (RR) is an important biomarker as RR changes can reflec...

Please sign up or login with your details

Forgot password? Click here to reset