Zero-Shot Transfer of Haptics-Based Object Insertion Policies

01/29/2023
by   Samarth Brahmbhatt, et al.
0

Humans naturally exploit haptic feedback during contact-rich tasks like loading a dishwasher or stocking a bookshelf. Current robotic systems focus on avoiding unexpected contact, often relying on strategically placed environment sensors. Recently, contact-exploiting manipulation policies have been trained in simulation and deployed on real robots. However, they require some form of real-world adaptation to bridge the sim-to-real gap, which might not be feasible in all scenarios. In this paper we train a contact-exploiting manipulation policy in simulation for the contact-rich household task of loading plates into a slotted holder, which transfers without any fine-tuning to the real robot. We investigate various factors necessary for this zero-shot transfer, like time delay modeling, memory representation, and domain randomization. Our policy transfers with minimal sim-to-real gap and significantly outperforms heuristic and learnt baselines. It also generalizes to plates of different sizes and weights. Demonstration videos and code are available at https://sites.google.com/view/compliant-object-insertion.

READ FULL TEXT

page 1

page 4

page 5

page 6

research
09/06/2023

Pre- and post-contact policy decomposition for non-prehensile manipulation with zero-shot sim-to-real transfer

We present a system for non-prehensile manipulation that require a signi...
research
03/31/2021

Causal Reasoning in Simulation for Structure and Transfer Learning of Robot Manipulation Policies

We present CREST, an approach for causal reasoning in simulation to lear...
research
10/13/2022

Augmentation for Learning From Demonstration with Environmental Constraints

We introduce a Learning from Demonstration (LfD) approach for contact-ri...
research
11/24/2018

Hardware Conditioned Policies for Multi-Robot Transfer Learning

Deep reinforcement learning could be used to learn dexterous robotic pol...
research
11/04/2021

A System for General In-Hand Object Re-Orientation

In-hand object reorientation has been a challenging problem in robotics ...
research
09/19/2023

Augmenting Tactile Simulators with Real-like and Zero-Shot Capabilities

Simulating tactile perception could potentially leverage the learning ca...
research
06/25/2022

Learning Preconditions of Hybrid Force-Velocity Controllers for Contact-Rich Manipulation

Robots need to manipulate objects in constrained environments like shelv...

Please sign up or login with your details

Forgot password? Click here to reset