Active Exploration for Robotic Manipulation

10/23/2022
by   Tim Schneider, et al.
0

Robotic manipulation stands as a largely unsolved problem despite significant advances in robotics and machine learning in recent years. One of the key challenges in manipulation is the exploration of the dynamics of the environment when there is continuous contact between the objects being manipulated. This paper proposes a model-based active exploration approach that enables efficient learning in sparse-reward robotic manipulation tasks. The proposed method estimates an information gain objective using an ensemble of probabilistic models and deploys model predictive control (MPC) to plan actions online that maximize the expected reward while also performing directed exploration. We evaluate our proposed algorithm in simulation and on a real robot, trained from scratch with our method, on a challenging ball pushing task on tilted tables, where the target ball position is not known to the agent a-priori. Our real-world robot experiment serves as a fundamental application of active exploration in model-based reinforcement learning of complex robotic manipulation tasks.

READ FULL TEXT

page 1

page 4

page 7

page 11

research
06/01/2022

Active Inference for Robotic Manipulation

Robotic manipulation stands as a largely unsolved problem despite signif...
research
05/20/2023

Bridging Active Exploration and Uncertainty-Aware Deployment Using Probabilistic Ensemble Neural Network Dynamics

In recent years, learning-based control in robotics has gained significa...
research
11/19/2020

The Robot Household Marathon Experiment

In this paper, we present an experiment, designed to investigate and eva...
research
08/10/2019

Learning to Explore in Motion and Interaction Tasks

Model free reinforcement learning suffers from the high sampling complex...
research
03/10/2020

Active Reward Learning for Co-Robotic Vision Based Exploration in Bandwidth Limited Environments

We present a novel POMDP problem formulation for a robot that must auton...
research
03/13/2020

Action for Better Prediction

Good prediction is necessary for autonomous robotics to make informed de...
research
06/18/2018

Learning from Outside the Viability Kernel: Why we Should Build Robots that can Fall with Grace

Despite impressive results using reinforcement learning to solve complex...

Please sign up or login with your details

Forgot password? Click here to reset