Total Capture: A 3D Deformation Model for Tracking Faces, Hands, and Bodies

01/05/2018
by   Hanbyul Joo, et al.
0

We present a unified deformation model for the markerless capture of multiple scales of human movement, including facial expressions, body motion, and hand gestures. An initial model is generated by locally stitching together models of the individual parts of the human body, which we refer to as the "Frankenstein" model. This model enables the full expression of part movements, including face and hands by a single seamless model. Using a large-scale capture of people wearing everyday clothes, we optimize the Frankenstein model to create "Adam". Adam is a calibrated model that shares the same skeleton hierarchy as the initial model but can express hair and clothing geometry, making it directly usable for fitting people as they normally appear in everyday life. Finally, we demonstrate the use of these models for total motion tracking, simultaneously capturing the large-scale body movements and the subtle face and hand motion of a social group of people.

READ FULL TEXT

page 1

page 6

page 7

page 8

research
08/19/2020

FrankMocap: Fast Monocular 3D Hand and Body Motion Capture by Regression and Integration

Although the essential nuance of human motion is often conveyed as a com...
research
12/09/2016

Panoptic Studio: A Massively Multiview System for Social Interaction Capture

We present an approach to capture the 3D motion of a group of people eng...
research
02/11/2014

Animation of 3D Human Model Using Markerless Motion Capture Applied To Sports

Markerless motion capture is an active research in 3D virtualization. In...
research
01/07/2023

Towards early prediction of neurodevelopmental disorders: Computational model for Face Touch and Self-adaptors in Infants

Infants' neurological development is heavily influenced by their motor s...
research
10/25/2022

SUPR: A Sparse Unified Part-Based Human Representation

Statistical 3D shape models of the head, hands, and fullbody are widely ...
research
04/03/2023

Motion Capture Benchmark of Real Industrial Tasks and Traditional Crafts for Human Movement Analysis

Human movement analysis is a key area of research in robotics, biomechan...
research
02/07/2022

Imposing Temporal Consistency on Deep Monocular Body Shape and Pose Estimation

Accurate and temporally consistent modeling of human bodies is essential...

Please sign up or login with your details

Forgot password? Click here to reset