Meta-Learning Transferable Parameterized Skills

06/07/2022
by   Haotian Fu, et al.
11

We propose a novel parameterized skill-learning algorithm that aims to learn transferable parameterized skills and synthesize them into a new action space that supports efficient learning in long-horizon tasks. We first propose novel learning objectives – trajectory-centric diversity and smoothness – that allow an agent to meta-learn reusable parameterized skills. Our agent can use these learned skills to construct a temporally-extended parameterized-action Markov decision process, for which we propose a hierarchical actor-critic algorithm that aims to efficiently learn a high-level control policy with the learned skills. We empirically demonstrate that the proposed algorithms enable an agent to solve a complicated long-horizon obstacle-course environment.

READ FULL TEXT

page 1

page 7

page 17

research
01/28/2022

Transfering Hierarchical Structure with Dual Meta Imitation Learning

Hierarchical Imitation Learning (HIL) is an effective way for robots to ...
research
04/25/2022

Skill-based Meta-Reinforcement Learning

While deep reinforcement learning methods have shown impressive results ...
research
11/25/2021

Robot Skill Adaptation via Soft Actor-Critic Gaussian Mixture Models

A core challenge for an autonomous agent acting in the real world is to ...
research
06/11/2015

Bootstrapping Skills

The monolithic approach to policy representation in Markov Decision Proc...
research
09/21/2021

Example-Driven Model-Based Reinforcement Learning for Solving Long-Horizon Visuomotor Tasks

In this paper, we study the problem of learning a repertoire of low-leve...
research
10/10/2016

Situational Awareness by Risk-Conscious Skills

Hierarchical Reinforcement Learning has been previously shown to speed u...
research
10/23/2021

Guided Policy Search for Parameterized Skills using Adverbs

We present a method for using adverb phrases to adjust skill parameters ...

Please sign up or login with your details

Forgot password? Click here to reset