Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic Manipulation

by   Jacky Liang, et al.
Carnegie Mellon University

Lifelong-learning robots need to be able to acquire new skills and plan for new tasks over time. Prior works on planning with skills often make assumptions on the structure of skills and tasks, like subgoal skills, shared skill implementations, or learning task-specific plan skeletons, that limit their application to new and different skills and tasks. By contrast, we propose doing task planning by jointly searching in the space of skills and their parameters with skill effect models learned in simulation. Our approach is flexible about skill parameterizations and task specifications, and we use an iterative training procedure to efficiently generate relevant data to train such models. Experiments demonstrate the ability of our planner to integrate new skills in a lifelong manner, finding new task strategies with lower costs in both train and test tasks. We additionally show that our method can transfer to the real world without further fine-tuning.


page 1

page 4

page 13


A Simple Approach to Continual Learning by Transferring Skill Parameters

In order to be effective general purpose machines in real world environm...

Visuospatial Skill Learning for Robots

A novel skill learning approach is proposed that allows a robot to acqui...

Sim-to-Real Task Planning and Execution from Perception via Reactivity and Recovery

Zero-shot execution of unseen robotic tasks is an important problem in r...

Sample Efficient Robot Learning with Structured World Models

Reinforcement learning has been demonstrated as a flexible and effective...

Learning to Plan Hierarchically from Curriculum

We present a framework for learning to plan hierarchically in domains wi...

Experience Reuse with Probabilistic Movement Primitives

Acquiring new robot motor skills is cumbersome, as learning a skill from...

Please sign up or login with your details

Forgot password? Click here to reset