Deep Reinforcement Learning for Contact-Rich Skills Using Compliant Movement Primitives

08/30/2020
by   Oren Spector, et al.
0

In recent years, industrial robots have been installed in various industries to handle advanced manufacturing and high precision tasks. However, further integration of industrial robots is hampered by their limited flexibility, adaptability and decision making skills compared to human operators. Assembly tasks are especially challenging for robots since they are contact-rich and sensitive to even small uncertainties. While reinforcement learning (RL) offers a promising framework to learn contact-rich control policies from scratch, its applicability to high-dimensional continuous state-action spaces remains rather limited due to high brittleness and sample complexity. To address those issues, we propose different pruning methods that facilitate convergence and generalization. In particular, we divide the task into free and contact-rich sub-tasks, perform the control in Cartesian rather than joint space, and parameterize the control policy. Those pruning methods are naturally implemented within the framework of dynamic movement primitives (DMP). To handle contact-rich tasks, we extend the DMP framework by introducing a coupling term that acts like the human wrist and provides active compliance under contact with the environment. We demonstrate that the proposed method can learn insertion skills that are invariant to space, size, shape, and closely related scenarios, while handling large uncertainties. Finally we demonstrate that the learned policy can be easily transferred from simulations to real world and achieve similar performance on UR5e robot.

READ FULL TEXT

page 9

page 12

page 13

page 14

page 15

page 16

page 18

research
07/27/2022

A Contact-Safe Reinforcement Learning Framework for Contact-Rich Robot Manipulation

Reinforcement learning shows great potential to solve complex contact-ri...
research
02/27/2020

Assembly robots with optimized control stiffness through reinforcement learning

There is an increased demand for task automation in robots. Contact-rich...
research
03/20/2018

Learning Robotic Assembly from CAD

In this work, motivated by recent manufacturing trends, we investigate a...
research
07/17/2019

Learning Variable Impedance Control for Contact Sensitive Tasks

Reinforcement learning algorithms have shown great success in solving di...
research
10/24/2018

Making Sense of Vision and Touch: Self-Supervised Learning of Multimodal Representations for Contact-Rich Tasks

Contact-rich manipulation tasks in unstructured environments often requi...
research
09/27/2021

Learning of Parameters in Behavior Trees for Movement Skills

Reinforcement Learning (RL) is a powerful mathematical framework that al...
research
07/28/2019

Making Sense of Vision and Touch: Learning Multimodal Representations for Contact-Rich Tasks

Contact-rich manipulation tasks in unstructured environments often requi...

Please sign up or login with your details

Forgot password? Click here to reset