Learning to Execute: Efficient Learning of Universal Plan-Conditioned Policies in Robotics

11/15/2021
by   Ingmar Schubert, et al.
0

Applications of Reinforcement Learning (RL) in robotics are often limited by high data demand. On the other hand, approximate models are readily available in many robotics scenarios, making model-based approaches like planning a data-efficient alternative. Still, the performance of these methods suffers if the model is imprecise or wrong. In this sense, the respective strengths and weaknesses of RL and model-based planners are. In the present work, we investigate how both approaches can be integrated into one framework that combines their strengths. We introduce Learning to Execute (L2E), which leverages information contained in approximate plans to learn universal policies that are conditioned on plans. In our robotic manipulation experiments, L2E exhibits increased performance when compared to pure RL, pure planning, or baseline methods combining learning and planning.

READ FULL TEXT

page 7

page 16

page 17

research
08/12/2020

Model-Based Offline Planning

Offline learning is a key part of making reinforcement learning (RL) use...
research
03/16/2023

Efficient Learning of High Level Plans from Play

Real-world robotic manipulation tasks remain an elusive challenge, since...
research
05/16/2021

Model-Based Offline Planning with Trajectory Pruning

Offline reinforcement learning (RL) enables learning policies using pre-...
research
12/05/2020

RLOC: Terrain-Aware Legged Locomotion using Reinforcement Learning and Optimal Control

We present a unified model-based and data-driven approach for quadrupeda...
research
06/30/2020

Model-based Reinforcement Learning: A Survey

Sequential decision making, commonly formalized as Markov Decision Proce...
research
01/30/2023

Passivizing learned policies and learning passive policies with virtual energy tanks in robotics

Within a robotic context, we merge the techniques of passivity-based con...
research
06/20/2017

Toward Real-Time Decentralized Reinforcement Learning using Finite Support Basis Functions

This paper addresses the design and implementation of complex Reinforcem...

Please sign up or login with your details

Forgot password? Click here to reset