Self-Supervised Motion Retargeting with Safety Guarantee

by   Sungjoon Choi, et al.

In this paper, we present self-supervised shared latent embedding (S3LE), a data-driven motion retargeting method that enables the generation of natural motions in humanoid robots from motion capture data or RGB videos. While it requires paired data consisting of human poses and their corresponding robot configurations, it significantly alleviates the necessity of time-consuming data-collection via novel paired data generating processes. Our self-supervised learning procedure consists of two steps: automatically generating paired data to bootstrap the motion retargeting, and learning a projection-invariant mapping to handle the different expressivity of humans and humanoid robots. Furthermore, our method guarantees that the generated robot pose is collision-free and satisfies position limits by utilizing nonparametric regression in the shared latent space. We demonstrate that our method can generate expressive robotic motions from both the CMU motion capture database and YouTube videos.



There are no comments yet.


page 5

page 6


Self-Supervised Human Depth Estimation from Monocular Videos

Previous methods on estimating detailed human depth often require superv...

Unpaired Motion Style Transfer from Video to Animation

Transferring the motion style from one animation clip to another, while ...

Robotic Telekinesis: Learning a Robotic Hand Imitator by Watching Humans on Youtube

We build a system that enables any human to control a robot hand and arm...

Self-Supervised Object-in-Gripper Segmentation from Robotic Motions

We present a novel technique to automatically generate annotated data fo...

SpeedNet: Learning the Speediness in Videos

We wish to automatically predict the "speediness" of moving objects in v...

DeepHuMS: Deep Human Motion Signature for 3D Skeletal Sequences

3D Human Motion Indexing and Retrieval is an interesting problem due to ...

Skeleton-Aware Networks for Deep Motion Retargeting

We introduce a novel deep learning framework for data-driven motion reta...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.