Foot Pressure from Video: A Deep Learning Approach to Predict Dynamics from Kinematics

11/30/2018
by   Savinay Nagendra, et al.
10

Human gait stability analysis is a key to understanding locomotion and control of body equilibrium, with numerous applications in the fields of Kinesiology, Medicine and Robotics. This work introduces a novel approach to learn dynamics of a human body from kinematics to aid stability analysis. We propose an end-to-end deep learning architecture to regress foot pressure from a human pose derived from video. This approach utilizes human Body-25 joints extracted from videos of subjects performing choreographed Taiji (Tai Chi) sequences using OpenPose estimation. The derived human pose data and corresponding foot pressure maps are used to train a convolutional neural network with residual architecture, termed PressNET, in an end-to-end fashion to predict the foot pressure corresponding to a given human pose. We create the largest dataset for simultaneous video and foot pressure on five subjects containing greater than 350k frames. We perform cross-subject evaluation with data from the five subjects on two versions of PressNET to evaluate the performance of our networks. KNearest Neighbors (KNN) is used to establish a baseline for comparisons and evaluation. We empirically show that PressNet significantly outperform KNN on all the splits.

READ FULL TEXT

page 1

page 3

page 7

page 8

page 10

page 11

research
01/02/2020

From Kinematics To Dynamics: Estimating Center of Pressure and Base of Support from Video Frames of Human Motion

To gain an understanding of the relation between a given human pose imag...
research
04/02/2020

Bodies at Rest: 3D Human Pose and Shape Estimation from a Pressure Image using Synthetic Data

People spend a substantial part of their lives at rest in bed. 3D human ...
research
04/25/2022

PedRecNet: Multi-task deep neural network for full 3D human pose and orientation estimation

We present a multitask network that supports various deep neural network...
research
04/21/2018

Estimating 3D Human Pose on a Configurable Bed from a Single Pressure Image

Robots have the potential to assist people in bed, such as in healthcare...
research
03/17/2023

MassNet: A Deep Learning Approach for Body Weight Extraction from A Single Pressure Image

Body weight, as an essential physiological trait, is of considerable sig...
research
06/27/2022

A View Independent Classification Framework for Yoga Postures

Yoga is a globally acclaimed and widely recommended practice for a healt...
research
02/02/2018

Activity-conditioned continuous human pose estimation for performance analysis of athletes using the example of swimming

In this paper we consider the problem of human pose estimation in real-w...

Please sign up or login with your details

Forgot password? Click here to reset