Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic Manipulation

09/17/2021
by   Jacky Liang, et al.
Carnegie Mellon University
0

Lifelong-learning robots need to be able to acquire new skills and plan for new tasks over time. Prior works on planning with skills often make assumptions on the structure of skills and tasks, like subgoal skills, shared skill implementations, or learning task-specific plan skeletons, that limit their application to new and different skills and tasks. By contrast, we propose doing task planning by jointly searching in the space of skills and their parameters with skill effect models learned in simulation. Our approach is flexible about skill parameterizations and task specifications, and we use an iterative training procedure to efficiently generate relevant data to train such models. Experiments demonstrate the ability of our planner to integrate new skills in a lifelong manner, finding new task strategies with lower costs in both train and test tasks. We additionally show that our method can transfer to the real world without further fine-tuning.

READ FULL TEXT

page 1

page 4

page 13

10/19/2021

A Simple Approach to Continual Learning by Transferring Skill Parameters

In order to be effective general purpose machines in real world environm...
06/03/2017

Visuospatial Skill Learning for Robots

A novel skill learning approach is proposed that allows a robot to acqui...
11/17/2020

Sim-to-Real Task Planning and Execution from Perception via Reactivity and Recovery

Zero-shot execution of unseen robotic tasks is an important problem in r...
10/21/2022

Sample Efficient Robot Learning with Structured World Models

Reinforcement learning has been demonstrated as a flexible and effective...
06/18/2019

Learning to Plan Hierarchically from Curriculum

We present a framework for learning to plan hierarchically in domains wi...
08/11/2019

Experience Reuse with Probabilistic Movement Primitives

Acquiring new robot motor skills is cumbersome, as learning a skill from...

Please sign up or login with your details

Forgot password? Click here to reset