In Search of Life: Learning from Synthetic Data to Detect Vital Signs in Videos

04/16/2020
by   Florin Condrea, et al.
9

Automatically detecting vital signs in videos, such as the estimation of heart and respiration rates, is a challenging research problem in computer vision with important applications in the medical field. One of the key difficulties in tackling this task is the lack of sufficient supervised training data, which severely limits the use of powerful deep neural networks. In this paper we address this limitation through a novel deep learning approach, in which a recurrent deep neural network is trained to detect vital signs in the infrared thermal domain from purely synthetic data. What is most surprising is that our novel method for synthetic training data generation is general, relatively simple and uses almost no prior medical domain knowledge. Moreover, our system, which is trained in a purely automatic manner and needs no human annotation, also learns to predict the respiration or heart intensity signal for each moment in time and to detect the region of interest that is most relevant for the given task, e.g. the nose area in the case of respiration. We test the effectiveness of our proposed system on the recent LCAS dataset and obtain state-of-the-art results.

READ FULL TEXT

page 2

page 3

page 4

page 5

page 7

page 8

research
10/21/2022

Real-time Detection of 2D Tool Landmarks with Synthetic Training Data

In this paper a deep learning architecture is presented that can, in rea...
research
02/26/2019

An Annotation Saved is an Annotation Earned: Using Fully Synthetic Training for Object Instance Detection

Deep learning methods typically require vast amounts of training data to...
research
10/26/2021

Semi-supervised dry herbage mass estimation using automatic data and synthetic images

Monitoring species-specific dry herbage biomass is an important aspect o...
research
03/05/2021

Training a First-Order Theorem Prover from Synthetic Data

A major challenge in applying machine learning to automated theorem prov...
research
02/12/2020

Deep-HR: Fast Heart Rate Estimation from Face Video Under Realistic Conditions

This paper presents a novel method for remote heart rate (HR) estimation...
research
08/14/2022

Remote Photoplethysmography from Low Resolution videos: An end-to-end solution using Efficient ConvNets

Measurement of the cardiac pulse from facial video has become an interes...
research
12/06/2017

Separating Reflection and Transmission Images in the Wild

The reflections caused by common semi-reflectors, such as glass windows,...

Please sign up or login with your details

Forgot password? Click here to reset