Search-Based Task Planning with Learned Skill Effect Models for Lifelong Robotic Manipulation

09/17/2021
by   Jacky Liang, et al.
0

Lifelong-learning robots need to be able to acquire new skills and plan for new tasks over time. Prior works on planning with skills often make assumptions on the structure of skills and tasks, like subgoal skills, shared skill implementations, or learning task-specific plan skeletons, that limit their application to new and different skills and tasks. By contrast, we propose doing task planning by jointly searching in the space of skills and their parameters with skill effect models learned in simulation. Our approach is flexible about skill parameterizations and task specifications, and we use an iterative training procedure to efficiently generate relevant data to train such models. Experiments demonstrate the ability of our planner to integrate new skills in a lifelong manner, finding new task strategies with lower costs in both train and test tasks. We additionally show that our method can transfer to the real world without further fine-tuning.

READ FULL TEXT

page 1

page 4

page 13

research
10/19/2021

A Simple Approach to Continual Learning by Transferring Skill Parameters

In order to be effective general purpose machines in real world environm...
research
06/03/2017

Visuospatial Skill Learning for Robots

A novel skill learning approach is proposed that allows a robot to acqui...
research
11/11/2022

Active Task Randomization: Learning Visuomotor Skills for Sequential Manipulation by Proposing Feasible and Novel Tasks

Solving real-world sequential manipulation tasks requires robots to have...
research
11/17/2020

Sim-to-Real Task Planning and Execution from Perception via Reactivity and Recovery

Zero-shot execution of unseen robotic tasks is an important problem in r...
research
10/21/2022

Sample Efficient Robot Learning with Structured World Models

Reinforcement learning has been demonstrated as a flexible and effective...
research
06/18/2019

Learning to Plan Hierarchically from Curriculum

We present a framework for learning to plan hierarchically in domains wi...
research
08/11/2019

Experience Reuse with Probabilistic Movement Primitives

Acquiring new robot motor skills is cumbersome, as learning a skill from...

Please sign up or login with your details

Forgot password? Click here to reset