How To Avoid Being Eaten By a Grue: Exploration Strategies for Text-Adventure Agents

02/19/2020
by   Prithviraj Ammanabrolu, et al.
0

Text-based games – in which an agent interacts with the world through textual natural language – present us with the problem of combinatorially-sized action-spaces. Most current reinforcement learning algorithms are not capable of effectively handling such a large number of possible actions per turn. Poor sample efficiency, consequently, results in agents that are unable to pass bottleneck states, where they are unable to proceed because they do not see the right action sequence to pass the bottleneck enough times to be sufficiently reinforced. Building on prior work using knowledge graphs in reinforcement learning, we introduce two new game state exploration strategies. We compare our exploration strategies against strong baselines on the classic text-adventure game, Zork1, where prior agent have been unable to get past a bottleneck where the agent is eaten by a Grue.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/12/2020

How to Avoid Being Eaten by a Grue: Structured Exploration Strategies for Textual Worlds

Text-based games are long puzzles or quests, characterized by a sequence...
research
05/06/2023

A Minimal Approach for Natural Language Action Space in Text-based Games

Text-based games (TGs) are language-based interactive environments for r...
research
01/24/2020

Exploration Based Language Learning for Text-Based Games

This work presents an exploration and imitation-learning-based agent cap...
research
01/04/2022

Multi-Stage Episodic Control for Strategic Exploration in Text Games

Text adventure games present unique challenges to reinforcement learning...
research
06/17/2021

Learning Knowledge Graph-based World Models of Textual Environments

World models improve a learning agent's ability to efficiently operate i...
research
05/17/2021

To be a fast adaptive learner: using game history to defeat opponents

In many real-world games, such as traders repeatedly bargaining with cus...
research
10/15/2022

Revisiting the Roles of "Text" in Text Games

Text games present opportunities for natural language understanding (NLU...

Please sign up or login with your details

Forgot password? Click here to reset