Toward Collaborative Reinforcement Learning Agents that Communicate Through Text-Based Natural Language

07/20/2021
by   Kevin Eloff, et al.
0

Communication between agents in collaborative multi-agent settings is in general implicit or a direct data stream. This paper considers text-based natural language as a novel form of communication between multiple agents trained with reinforcement learning. This could be considered first steps toward a truly autonomous communication without the need to define a limited set of instructions, and natural collaboration between humans and robots. Inspired by the game of Blind Leads, we propose an environment where one agent uses natural language instructions to guide another through a maze. We test the ability of reinforcement learning agents to effectively communicate through discrete word-level symbols and show that the agents are able to sufficiently communicate through natural language with a limited vocabulary. Although the communication is not always perfect English, the agents are still able to navigate the maze. We achieve a BLEU score of 0.85, which is an improvement of 0.61 over randomly generated sequences while maintaining a 100 rate. This is a 3.5 times the performance of the random baseline using our reference set.

READ FULL TEXT

page 4

page 6

research
04/18/2017

Beating Atari with Natural Language Guided Reinforcement Learning

We introduce the first deep reinforcement learning agent that learns to ...
research
07/11/2019

Collaborative Multi-Agent Dialogue Model Training Via Reinforcement Learning

We present the first complete attempt at concurrently training conversat...
research
05/31/2017

Emergence of Language with Multi-agent Games: Learning to Communicate with Sequences of Symbols

Learning to communicate through interaction, rather than relying on expl...
research
08/04/2021

Emergent Discrete Communication in Semantic Spaces

Neural agents trained in reinforcement learning settings can learn to co...
research
08/14/2019

Mastering emergent language: learning to guide in simulated navigation

To cooperate with humans effectively, virtual agents need to be able to ...
research
10/12/2016

A Paradigm for Situated and Goal-Driven Language Learning

A distinguishing property of human intelligence is the ability to flexib...
research
10/11/2016

Navigational Instruction Generation as Inverse Reinforcement Learning with Neural Machine Translation

Modern robotics applications that involve human-robot interaction requir...

Please sign up or login with your details

Forgot password? Click here to reset