Grounding Hierarchical Reinforcement Learning Models for Knowledge Transfer

12/19/2014
by   Mark Wernsdorfer, et al.
0

Methods of deep machine learning enable to to reuse low-level representations efficiently for generating more abstract high-level representations. Originally, deep learning has been applied passively (e.g., for classification purposes). Recently, it has been extended to estimate the value of actions for autonomous agents within the framework of reinforcement learning (RL). Explicit models of the environment can be learned to augment such a value function. Although "flat" connectionist methods have already been used for model-based RL, up to now, only model-free variants of RL have been equipped with methods from deep learning. We propose a variant of deep model-based RL that enables an agent to learn arbitrarily abstract hierarchical representations of its environment. In this paper, we present research on how such hierarchical representations can be grounded in sensorimotor interaction between an agent and its environment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/12/2022

RLang: A Declarative Language for Expression Prior Knowledge for Reinforcement Learning

Communicating useful background knowledge to reinforcement learning (RL)...
research
12/10/2022

Relate to Predict: Towards Task-Independent Knowledge Representations for Reinforcement Learning

Reinforcement Learning (RL) can enable agents to learn complex tasks. Ho...
research
11/18/2020

Adaptive Contention Window Design using Deep Q-learning

We study the problem of adaptive contention window (CW) design for rando...
research
10/25/2021

Self-Consistent Models and Values

Learned models of the environment provide reinforcement learning (RL) ag...
research
11/25/2019

Theory-based Causal Transfer: Integrating Instance-level Induction and Abstract-level Structure Learning

Learning transferable knowledge across similar but different settings is...
research
04/05/2013

Model-based Bayesian Reinforcement Learning for Dialogue Management

Reinforcement learning methods are increasingly used to optimise dialogu...
research
01/20/2018

Learning model-based strategies in simple environments with hierarchical q-networks

Recent advances in deep learning have allowed artificial agents to rival...

Please sign up or login with your details

Forgot password? Click here to reset