SMPL-IK: Learned Morphology-Aware Inverse Kinematics for AI Driven Artistic Workflows

08/16/2022
by   Vikram Voleti, et al.
8

Inverse Kinematics (IK) systems are often rigid with respect to their input character, thus requiring user intervention to be adapted to new skeletons. In this paper we aim at creating a flexible, learned IK solver applicable to a wide variety of human morphologies. We extend a state-of-the-art machine learning IK solver to operate on the well known Skinned Multi-Person Linear model (SMPL). We call our model SMPL-IK, and show that when integrated into real-time 3D software, this extended system opens up opportunities for defining novel AI-assisted animation workflows. For example, pose authoring can be made more flexible with SMPL-IK by allowing users to modify gender and body shape while posing a character. Additionally, when chained with existing pose estimation algorithms, SMPL-IK accelerates posing by allowing users to bootstrap 3D scenes from 2D images while allowing for further editing. Finally, we propose a novel SMPL Shape Inversion mechanism (SMPL-SI) to map arbitrary humanoid characters to the SMPL space, allowing artists to leverage SMPL-IK on custom characters. In addition to qualitative demos showing proposed tools, we present quantitative SMPL-IK baselines on the H36M and AMASS datasets.

READ FULL TEXT

page 1

page 3

page 6

research
01/06/2012

Interactive Character Posing by Sparse Coding

Character posing is of interest in computer animation. It is difficult d...
research
09/30/2019

Expressive Inverse Kinematics Solving in Real-time for Virtual and Robotic Interactive Characters

With new advancements in interaction techniques, character animation als...
research
08/04/2021

Transfer Learning for Pose Estimation of Illustrated Characters

Human pose information is a critical component in many downstream image ...
research
01/16/2023

Pose Metrics: a New Paradigm for Character Motion Edition

In animation, style can be considered as a distinctive layer over the co...
research
04/08/2014

Expression driven Trignometric based Procedural Animation of Quadrupeds

This research paper addresses the problem of generating involuntary and ...

Please sign up or login with your details

Forgot password? Click here to reset