A Minimal Approach for Natural Language Action Space in Text-based Games

05/06/2023
by   Dongwon Kelvin Ryu, et al.
0

Text-based games (TGs) are language-based interactive environments for reinforcement learning. While language models (LMs) and knowledge graphs (KGs) are commonly used for handling large action space in TGs, it is unclear whether these techniques are necessary or overused. In this paper, we revisit the challenge of exploring the action space in TGs and propose ϵ-admissible exploration, a minimal approach of utilizing admissible actions, for training phase. Additionally, we present a text-based actor-critic (TAC) agent that produces textual commands for game, solely from game observations, without requiring any KG or LM. Our method, on average across 10 games from Jericho, outperforms strong baselines and state-of-the-art agents that use LM and KG. Our approach highlights that a much lighter model design, with a fresh perspective on utilizing the information within the environments, suffices for an effective exploration of exponentially large action spaces.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/23/2020

Graph Constrained Reinforcement Learning for Natural Language Action Spaces

Interactive Fiction games are text-based simulations in which an agent i...
research
10/06/2020

Keep CALM and Explore: Language Models for Action Generation in Text-based Games

Text-based games present a unique challenge for autonomous agents to ope...
research
10/13/2022

Behavior Cloned Transformers are Neurosymbolic Reasoners

In this work, we explore techniques for augmenting interactive agents wi...
research
02/19/2020

How To Avoid Being Eaten By a Grue: Exploration Strategies for Text-Adventure Agents

Text-based games – in which an agent interacts with the world through te...
research
04/06/2020

Predicting Strategic Behavior from Free Text

The connection between messaging and action is fundamental both to web a...
research
01/04/2022

Multi-Stage Episodic Control for Strategic Exploration in Text Games

Text adventure games present unique challenges to reinforcement learning...
research
05/16/2017

Text-based Adventures of the Golovin AI Agent

The domain of text-based adventure games has been recently established a...

Please sign up or login with your details

Forgot password? Click here to reset