Uncertainty-aware Contact-safe Model-based Reinforcement Learning

10/16/2020
by   Cheng-Yu Kuo, et al.
0

This paper presents contact-safe Model-based Reinforcement Learning (MBRL) for robot applications that achieves contact-safe behaviors in the learning process. In typical MBRL, we cannot expect the data-driven model to generate accurate and reliable policies to the intended robotic tasks during the learning process due to data scarcity. Operating these unreliable policies in a contact-rich environment could cause damage to the robot and its surroundings. To alleviate the risk of causing damage through unexpected intensive physical contacts, we present the contact-safe MBRL that associates the probabilistic Model Predictive Control's (pMPC) control limits with the model uncertainty so that the allowed acceleration of controlled behavior is adjusted according to learning progress. Control planning with such uncertainty-aware control limits is formulated as a deterministic MPC problem using a computationally-efficient approximated GP dynamics and an approximated inference technique. Our approach's effectiveness is evaluated through bowl mixing tasks with simulated and real robots, scooping tasks with a real robot as examples of contact-rich manipulation skills. (video: https://youtu.be/8uTDYYUKeFM)

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 8

research
09/18/2022

Multi-contact MPC for Dynamic Loco-manipulation on Humanoid Robots

This paper presents a novel method to control humanoid robot dynamic loc...
research
08/26/2020

Safe Model-Based Meta-Reinforcement Learning: A Sequential Exploration-Exploitation Framework

Safe deployment of autonomous robots in diverse environments requires ag...
research
11/23/2020

COCOI: Contact-aware Online Context Inference for Generalizable Non-planar Pushing

General contact-rich manipulation problems are long-standing challenges ...
research
03/09/2019

Data-Driven Model Predictive Control for Food-Cutting

Modelling of contact-rich tasks is challenging and cannot be entirely so...
research
09/24/2021

RMPs for Safe Impedance Control in Contact-Rich Manipulation

Variable impedance control in operation-space is a promising approach to...
research
10/11/2022

A Learning-Based Estimation and Control Framework for Contact-Intensive Tight-Tolerance Tasks

We propose a novel data-driven estimation and control framework for cont...
research
05/15/2017

Probabilistically Safe Policy Transfer

Although learning-based methods have great potential for robotics, one c...

Please sign up or login with your details

Forgot password? Click here to reset