PIANO: A Parametric Hand Bone Model from Magnetic Resonance Imaging

06/21/2021
by   Yuwei Li, et al.
18

Hand modeling is critical for immersive VR/AR, action understanding, or human healthcare. Existing parametric models account only for hand shape, pose, or texture, without modeling the anatomical attributes like bone, which is essential for realistic hand biomechanics analysis. In this paper, we present PIANO, the first parametric bone model of human hands from MRI data. Our PIANO model is biologically correct, simple to animate, and differentiable, achieving more anatomically precise modeling of the inner hand kinematic structure in a data-driven manner than the traditional hand models based on the outer surface only. Furthermore, our PIANO model can be applied in neural network layers to enable training with a fine-grained semantic loss, which opens up the new task of data-driven fine-grained hand bone anatomic and semantic understanding from MRI or even RGB images. We make our model publicly available.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

page 7

research
02/09/2022

NIMBLE: A Non-rigid Hand Model with Bones and Muscles

Emerging Metaverse applications demand reliable, accurate, and photoreal...
research
04/23/2021

SportsCap: Monocular 3D Human Motion Capture and Fine-grained Understanding in Challenging Sports Videos

Markerless motion capture and understanding of professional non-daily hu...
research
10/09/2018

Inter-Scanner Harmonization of High Angular Resolution DW-MRI using Null Space Deep Learning

Diffusion-weighted magnetic resonance imaging (DW-MRI) allows for non-in...
research
09/16/2023

AffordPose: A Large-scale Dataset of Hand-Object Interactions with Affordance-driven Hand Pose

How human interact with objects depends on the functional roles of the t...
research
01/19/2012

Progress in animation of an EMA-controlled tongue model for acoustic-visual speech synthesis

We present a technique for the animation of a 3D kinematic tongue model,...
research
12/15/2016

A Multilinear Tongue Model Derived from Speech Related MRI Data of the Human Vocal Tract

We present a multilinear statistical model of the human tongue that capt...
research
04/22/2023

NaviNeRF: NeRF-based 3D Representation Disentanglement by Latent Semantic Navigation

3D representation disentanglement aims to identify, decompose, and manip...

Please sign up or login with your details

Forgot password? Click here to reset