Self-Supervised Motion Retargeting with Safety Guarantee

03/11/2021
by   Sungjoon Choi, et al.
0

In this paper, we present self-supervised shared latent embedding (S3LE), a data-driven motion retargeting method that enables the generation of natural motions in humanoid robots from motion capture data or RGB videos. While it requires paired data consisting of human poses and their corresponding robot configurations, it significantly alleviates the necessity of time-consuming data-collection via novel paired data generating processes. Our self-supervised learning procedure consists of two steps: automatically generating paired data to bootstrap the motion retargeting, and learning a projection-invariant mapping to handle the different expressivity of humans and humanoid robots. Furthermore, our method guarantees that the generated robot pose is collision-free and satisfies position limits by utilizing nonparametric regression in the shared latent space. We demonstrate that our method can generate expressive robotic motions from both the CMU motion capture database and YouTube videos.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 5

page 6

05/07/2020

Self-Supervised Human Depth Estimation from Monocular Videos

Previous methods on estimating detailed human depth often require superv...
05/12/2020

Unpaired Motion Style Transfer from Video to Animation

Transferring the motion style from one animation clip to another, while ...
02/21/2022

Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtube

We build a system that enables any human to control a robot hand and arm...
02/11/2020

Self-Supervised Object-in-Gripper Segmentation from Robotic Motions

We present a novel technique to automatically generate annotated data fo...
04/13/2020

SpeedNet: Learning the Speediness in Videos

We wish to automatically predict the "speediness" of moving objects in v...
08/15/2019

DeepHuMS: Deep Human Motion Signature for 3D Skeletal Sequences

3D Human Motion Indexing and Retrieval is an interesting problem due to ...
05/12/2020

Skeleton-Aware Networks for Deep Motion Retargeting

We introduce a novel deep learning framework for data-driven motion reta...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.