COCOI: Contact-aware Online Context Inference for Generalizable Non-planar Pushing

11/23/2020
by   Zhuo Xu, et al.
0

General contact-rich manipulation problems are long-standing challenges in robotics due to the difficulty of understanding complicated contact physics. Deep reinforcement learning (RL) has shown great potential in solving robot manipulation tasks. However, existing RL policies have limited adaptability to environments with diverse dynamics properties, which is pivotal in solving many contact-rich manipulation tasks. In this work, we propose Contact-aware Online COntext Inference (COCOI), a deep RL method that encodes a context embedding of dynamics properties online using contact-rich interactions. We study this method based on a novel and challenging non-planar pushing task, where the robot uses a monocular camera image and wrist force torque sensor reading to push an object to a goal location while keeping it upright. We run extensive experiments to demonstrate the capability of COCOI in a wide range of settings and dynamics properties in simulation, and also in a sim-to-real transfer scenario on a real robot (Video: https://youtu.be/nrmJYksh1Kc)

READ FULL TEXT

page 1

page 4

page 6

research
07/27/2022

A Contact-Safe Reinforcement Learning Framework for Contact-Rich Robot Manipulation

Reinforcement learning shows great potential to solve complex contact-ri...
research
08/04/2023

Nonprehensile Planar Manipulation through Reinforcement Learning with Multimodal Categorical Exploration

Developing robot controllers capable of achieving dexterous nonprehensil...
research
03/02/2020

Learning Contact-Rich Manipulation Tasks with Rigid Position-Controlled Robots: Learning to Force Control

To fully realize industrial automation, it is indispensable to give the ...
research
06/22/2022

Global Planning for Contact-Rich Manipulation via Local Smoothing of Quasi-dynamic Contact Models

The empirical success of Reinforcement Learning (RL) in the setting of c...
research
10/16/2020

Uncertainty-aware Contact-safe Model-based Reinforcement Learning

This paper presents contact-safe Model-based Reinforcement Learning (MBR...
research
04/19/2023

Progressive Transfer Learning for Dexterous In-Hand Manipulation with Multi-Fingered Anthropomorphic Hand

Dexterous in-hand manipulation for a multi-fingered anthropomorphic hand...
research
02/27/2020

Assembly robots with optimized control stiffness through reinforcement learning

There is an increased demand for task automation in robots. Contact-rich...

Please sign up or login with your details

Forgot password? Click here to reset