DeepAI AI Chat
Log In Sign Up

Learning Dynamic Manipulation Skills from Haptic-Play

07/28/2022
by   Taeyoon Lee, et al.
NAVER LABS Corp.
Seoul National University
0

In this paper, we propose a data-driven skill learning approach to solve highly dynamic manipulation tasks entirely from offline teleoperated play data. We use a bilateral teleoperation system to continuously collect a large set of dexterous and agile manipulation behaviors, which is enabled by providing direct force feedback to the operator. We jointly learn the state conditional latent skill distribution and skill decoder network in the form of goal-conditioned policy and skill conditional state transition dynamics using a two-stage generative modeling framework. This allows one to perform robust model-based planning, both online and offline planning methods, in the learned skill-space to accomplish any given downstream tasks at test time. We provide both simulated and real-world dual-arm box manipulation experiments showing that a sequence of force-controlled dynamic manipulation skills can be composed in real-time to successfully configure the box to the randomly selected target position and orientation; please refer to the supplementary video, https://youtu.be/LA5B236ILzM.

READ FULL TEXT

page 1

page 6

10/12/2022

ControlVAE: Model-Based Learning of Generative Controllers for Physics-Based Characters

In this paper, we introduce ControlVAE, a novel model-based framework fo...
09/18/2021

Geometric Task Networks: Learning Efficient and Explainable Skill Coordination for Object Manipulation

Complex manipulation tasks can contain various execution branches of pri...
11/23/2022

Choreographer: Learning and Adapting Skills in Imagination

Unsupervised skill learning aims to learn a rich repertoire of behaviors...
05/22/2018

A Framework for Robot Manipulation: Skill Formalism, Meta Learning and Adaptive Control

In this paper we introduce a novel framework for expressing and learning...
05/04/2023

Confidence-Based Skill Reproduction Through Perturbation Analysis

Several methods exist for teaching robots, with one of the most prominen...
07/04/2022

Controlling the Cascade: Kinematic Planning for N-ball Toss Juggling

Dynamic movements are ubiquitous in human motor behavior as they tend to...
08/11/2021

Skill Preferences: Learning to Extract and Execute Robotic Skills from Human Feedback

A promising approach to solving challenging long-horizon tasks has been ...