Log In Sign Up

Deep Reinforcement Learning with Stacked Hierarchical Attention for Text-based Games

by   Yunqiu Xu, et al.

We study reinforcement learning (RL) for text-based games, which are interactive simulations in the context of natural language. While different methods have been developed to represent the environment information and language actions, existing RL agents are not empowered with any reasoning capabilities to deal with textual games. In this work, we aim to conduct explicit reasoning with knowledge graphs for decision making, so that the actions of an agent are generated and supported by an interpretable inference procedure. We propose a stacked hierarchical attention mechanism to construct an explicit representation of the reasoning process by exploiting the structure of the knowledge graph. We extensively evaluate our method on a number of man-made benchmark games, and the experimental results demonstrate that our method performs better than existing text-based agents.


page 20

page 26

page 28

page 33

page 34

page 35

page 36

page 39


Generalization in Text-based Games via Hierarchical Reinforcement Learning

Deep reinforcement learning provides a promising approach for text-based...

Explaining Deep Reinforcement Learning Agents In The Atari Domain through a Surrogate Model

One major barrier to applications of deep Reinforcement Learning (RL) bo...

Transfer in Deep Reinforcement Learning using Knowledge Graphs

Text adventure games, in which players must make sense of the world thro...

Case-based Reasoning for Better Generalization in Text-Adventure Games

Text-based games (TBG) have emerged as promising environments for drivin...

Learning Knowledge Graph-based World Models of Textual Environments

World models improve a learning agent's ability to efficiently operate i...

Learning Two-Step Hybrid Policy for Graph-Based Interpretable Reinforcement Learning

We present a two-step hybrid reinforcement learning (RL) policy that is ...

Revisiting the Roles of "Text" in Text Games

Text games present opportunities for natural language understanding (NLU...