Preterm infants' limb-pose estimation from depth images using convolutional neural networks

07/26/2019
by   Sara Moccia, et al.
6

Preterm infants' limb-pose estimation is a crucial but challenging task, which may improve patients' care and facilitate clinicians in infant's movements monitoring. Work in the literature either provides approaches to whole-body segmentation and tracking, which, however, has poor clinical value, or retrieve a posteriori limb pose from limb segmentation, increasing computational costs and introducing inaccuracy sources. In this paper, we address the problem of limb-pose estimation under a different point of view. We proposed a 2D fully-convolutional neural network for roughly detecting limb joints and joint connections, followed by a regression convolutional neural network for accurate joint and joint-connection position estimation. Joints from the same limb are then connected with a maximum bipartite matching approach. Our analysis does not require any prior modeling of infants' body structure, neither any manual interventions. For developing and testing the proposed approach, we built a dataset of four videos (video length = 90 s) recorded with a depth sensor in a neonatal intensive care unit (NICU) during the actual clinical practice, achieving median root mean square distance [pixels] of 10.790 (right arm), 10.542 (left arm), 8.294 (right leg), 11.270 (left leg) with respect to the ground-truth limb pose. The idea of estimating limb pose directly from depth images may represent a future paradigm for addressing the problem of preterm-infants' movement monitoring and offer all possible support to clinicians in NICUs.

READ FULL TEXT

page 1

page 2

page 3

page 5

page 6

page 7

research
08/14/2020

Preterm Infants’ Pose Estimation With Spatio-Temporal Features

Objective: Preterm infants’ limb monitoring in neonatal intensive care u...
research
11/23/2016

PoseTrack: Joint Multi-Person Pose Estimation and Tracking

In this work, we introduce the challenging problem of joint multi-person...
research
04/07/2017

Hand3D: Hand Pose Estimation using 3D Neural Network

We propose a novel 3D neural network architecture for 3D hand pose estim...
research
10/13/2022

THE IDENTIFICATION OF KNEE DEVIATION DURING THE SQUAT MOVEMENT

This paper describes software to evaluate the ideal form to prevent inju...
research
09/21/2017

Human Pose Estimation using Global and Local Normalization

In this paper, we address the problem of estimating the positions of hum...
research
08/31/2016

Human Pose Estimation in Space and Time using 3D CNN

This paper explores the capabilities of convolutional neural networks to...
research
07/10/2018

Towards Head Motion Compensation Using Multi-Scale Convolutional Neural Networks

Head pose estimation and tracking is useful in variety of medical applic...

Please sign up or login with your details

Forgot password? Click here to reset