Incorporating Pragmatic Reasoning Communication into Emergent Language

06/07/2020
by   Yipeng Kang, et al.
8

Emergentism and pragmatics are two research fields that study the dynamics of linguistic communication along substantially different timescales and intelligence levels. From the perspective of multi-agent reinforcement learning, they correspond to stochastic games with reinforcement training and stage games with opponent awareness. Given that their combination has been explored in linguistics, we propose computational models that combine short-term mutual reasoning-based pragmatics with long-term language emergentism. We explore this for agent communication referential games as well as in Starcraft II, assessing the relative merits of different kinds of mutual reasoning pragmatics models both empirically and theoretically. Our results shed light on their importance for making inroads towards getting more natural, accurate, robust, fine-grained, and succinct utterances.

READ FULL TEXT

page 3

page 7

research
04/05/2022

Learning to Bid Long-Term: Multi-Agent Reinforcement Learning with Long-Term and Sparse Reward in Repeated Auction Games

We propose a multi-agent distributed reinforcement learning algorithm th...
research
11/30/2020

Low-Bandwidth Communication Emerges Naturally in Multi-Agent Learning Systems

In this work, we study emergent communication through the lens of cooper...
research
03/31/2022

A 23 MW data centre is all you need

The field of machine learning has achieved striking progress in recent y...
research
01/25/2019

Emergent Linguistic Phenomena in Multi-Agent Communication Games

In this work, we propose a computational framework in which agents equip...
research
06/30/2020

R2-B2: Recursive Reasoning-Based Bayesian Optimization for No-Regret Learning in Games

This paper presents a recursive reasoning formalism of Bayesian optimiza...
research
02/02/2022

Adaptive Discrete Communication Bottlenecks with Dynamic Vector Quantization

Vector Quantization (VQ) is a method for discretizing latent representat...

Please sign up or login with your details

Forgot password? Click here to reset