Blood Oxygen Saturation Estimation from Facial Video via DC and AC components of Spatio-temporal Map

12/14/2022
by   Yusuke Akamatsu, et al.
0

Peripheral blood oxygen saturation (SpO2), an indicator of oxygen levels in the blood, is one of the most important physiological parameters. Although SpO2 is usually measured using a pulse oximeter, non-contact SpO2 estimation methods from facial or hand videos have been attracting attention in recent years. In this paper, we propose an SpO2 estimation method from facial videos based on convolutional neural networks (CNN). Our method constructs CNN models that consider the direct current (DC) and alternating current (AC) components extracted from the RGB signals of facial videos, which are important in the principle of SpO2 estimation. Specifically, we extract the DC and AC components from the spatio-temporal map using filtering processes and train CNN models to predict SpO2 from these components. We also propose an end-to-end model that predicts SpO2 directly from the spatio-temporal map by extracting the DC and AC components via convolutional layers. Experiments using facial videos and SpO2 data from 50 subjects demonstrate that the proposed method achieves a better estimation performance than current state-of-the-art SpO2 estimation methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/25/2015

Initialization Strategies of Spatio-Temporal Convolutional Neural Networks

We propose a new way of incorporating temporal information present in vi...
research
05/07/2019

Recovering remote Photoplethysmograph Signal from Facial videos Using Spatio-Temporal Convolutional Networks

Recently average heart rate (HR) can be measured relatively accurately f...
research
11/23/2017

Attended End-to-end Architecture for Age Estimation from Facial Expression Videos

The main challenges of age estimation from facial expression videos lie ...
research
11/23/2021

PhysFormer: Facial Video-based Physiological Measurement with Temporal Difference Transformer

Remote photoplethysmography (rPPG), which aims at measuring heart activi...
research
02/07/2023

PhysFormer++: Facial Video-based Physiological Measurement with SlowFast Temporal Difference Transformer

Remote photoplethysmography (rPPG), which aims at measuring heart activi...
research
07/11/2021

Remote Blood Oxygen Estimation From Videos Using Neural Networks

Blood oxygen saturation (SpO_2) is an essential indicator of respiratory...
research
12/12/2020

Coverless Video Steganography based on Maximum DC Coefficients

Coverless steganography has been a great interest in recent years, since...

Please sign up or login with your details

Forgot password? Click here to reset