Theory of Mind as Intrinsic Motivation for Multi-Agent Reinforcement Learning

07/03/2023
by   Ini Oguntola, et al.
0

The ability to model the mental states of others is crucial to human social intelligence, and can offer similar benefits to artificial agents with respect to the social dynamics induced in multi-agent settings. We present a method of grounding semantically meaningful, human-interpretable beliefs within policies modeled by deep networks. We then consider the task of 2nd-order belief prediction. We propose that ability of each agent to predict the beliefs of the other agents can be used as an intrinsic reward signal for multi-agent reinforcement learning. Finally, we present preliminary empirical results in a mixed cooperative-competitive environment.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/04/2022

Learning to Deceive in Multi-Agent Hidden Role Games

Deception is prevalent in human social settings. However, studies into t...
research
04/24/2023

Stubborn: An Environment for Evaluating Stubbornness between Agents with Aligned Incentives

Recent research in multi-agent reinforcement learning (MARL) has shown s...
research
02/03/2021

Neural Recursive Belief States in Multi-Agent Reinforcement Learning

In multi-agent reinforcement learning, the problem of learning to act is...
research
05/29/2019

Modeling Theory of Mind in Multi-Agent Games Using Adaptive Feedback Control

A major challenge in cognitive science and AI has been to understand how...
research
01/21/2020

Emergence of Pragmatics from Referential Game between Theory of Mind Agents

Pragmatics studies how context can contribute to language meanings [1]. ...
research
05/27/2023

Attention Schema in Neural Agents

Attention has become a common ingredient in deep learning architectures....
research
06/10/2020

The Emergence of Individuality in Multi-Agent Reinforcement Learning

Individuality is essential in human society, which induces the division ...

Please sign up or login with your details

Forgot password? Click here to reset