A framework for the emergence and analysis of language in social learning agents

05/04/2023
by   Tobias J. Wieczorek, et al.
0

Artificial neural networks (ANNs) are increasingly used as research models, but questions remain about their generalizability and representational invariance. Biological neural networks under social constraints evolved to enable communicable representations, demonstrating generalization capabilities. This study proposes a communication protocol between cooperative agents to analyze the formation of individual and shared abstractions and their impact on task performance. This communication protocol aims to mimic language features by encoding high-dimensional information through low-dimensional representation. Using grid-world mazes and reinforcement learning, teacher ANNs pass a compressed message to a student ANN for better task completion. Through this, the student achieves a higher goal-finding rate and generalizes the goal location across task worlds. Further optimizing message content to maximize student reward improves information encoding, suggesting that an accurate representation in the space of messages requires bi-directional input. This highlights the role of language as a common representation between agents and its implications on generalization capabilities.

READ FULL TEXT

page 1

page 3

page 4

page 7

page 9

page 13

page 19

page 20

research
08/09/2023

Scalability of Message Encoding Techniques for Continuous Communication Learned with Multi-Agent Reinforcement Learning

Many multi-agent systems require inter-agent communication to properly a...
research
04/19/2021

Learning to Communicate with Strangers via Channel Randomisation Methods

We introduce two methods for improving the performance of agents meeting...
research
08/19/2020

A new role for circuit expansion for learning in neural networks

Many sensory pathways in the brain rely on sparsely active populations o...
research
11/29/2020

A Q-values Sharing Framework for Multiagent Reinforcement Learning under Budget Constraint

In teacher-student framework, a more experienced agent (teacher) helps a...
research
02/28/2023

On the Role of Emergent Communication for Social Learning in Multi-Agent Reinforcement Learning

Explicit communication among humans is key to coordinating and learning....
research
05/20/2022

Emergence of Double-slit Interference by Representing Visual Space in Artificial Neural Networks

Artificial neural networks have realized incredible successes at image r...

Please sign up or login with your details

Forgot password? Click here to reset