Bodies at Rest: 3D Human Pose and Shape Estimation from a Pressure Image using Synthetic Data

04/02/2020
by   Henry M. Clever, et al.
0

People spend a substantial part of their lives at rest in bed. 3D human pose and shape estimation for this activity would have numerous beneficial applications, yet line-of-sight perception is complicated by occlusion from bedding. Pressure sensing mats are a promising alternative, but training data is challenging to collect at scale. We describe a physics-based method that simulates human bodies at rest in a bed with a pressure sensing mat, and present PressurePose, a synthetic dataset with 206K pressure images with 3D human poses and shapes. We also present PressureNet, a deep learning model that estimates human pose and shape given a pressure image and gender. PressureNet incorporates a pressure map reconstruction (PMR) network that models pressure image generation to promote consistency between estimated 3D body models and pressure image input. In our evaluations, PressureNet performed well with real data from participants in diverse poses, even though it had only been trained with synthetic data. When we ablated the PMR network, performance dropped substantially.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 8

page 9

page 14

page 15

research
05/20/2021

BodyPressure – Inferring Body Pose and Contact Pressure from a Depth Image

Contact pressure between the human body and its surroundings has importa...
research
04/21/2018

Estimating 3D Human Pose on a Configurable Bed from a Single Pressure Image

Robots have the potential to assist people in bed, such as in healthcare...
research
11/30/2018

Foot Pressure from Video: A Deep Learning Approach to Predict Dynamics from Kinematics

Human gait stability analysis is a key to understanding locomotion and c...
research
12/12/2020

Multimodal In-bed Pose and Shape Estimation under the Blankets

Humans spend vast hours in bed – about one-third of the lifetime on aver...
research
06/25/2021

Image-to-image Transformation with Auxiliary Condition

The performance of image recognition like human pose detection, trained ...
research
01/02/2020

From Kinematics To Dynamics: Estimating Center of Pressure and Base of Support from Video Frames of Human Motion

To gain an understanding of the relation between a given human pose imag...

Please sign up or login with your details

Forgot password? Click here to reset