DeepAI
Log In Sign Up

Interpretation of Emergent Communication in Heterogeneous Collaborative Embodied Agents

10/12/2021
by   Shivansh Patel, et al.
8

Communication between embodied AI agents has received increasing attention in recent years. Despite its use, it is still unclear whether the learned communication is interpretable and grounded in perception. To study the grounding of emergent forms of communication, we first introduce the collaborative multi-object navigation task CoMON. In this task, an oracle agent has detailed environment information in the form of a map. It communicates with a navigator agent that perceives the environment visually and is tasked to find a sequence of goals. To succeed at the task, effective communication is essential. CoMON hence serves as a basis to study different communication mechanisms between heterogeneous agents, that is, agents with different capabilities and roles. We study two common communication mechanisms and analyze their communication patterns through an egocentric and spatial lens. We show that the emergent communication can be grounded to the agent observations and the spatial structure of the 3D environment. Video summary: https://youtu.be/kLv2rxO9t0g

READ FULL TEXT

page 7

page 14

page 17

page 18

page 19

page 20

04/11/2018

Emergent Communication through Negotiation

Multi-agent reinforcement learning offers a way to study how communicati...
07/13/2021

Teaching Agents how to Map: Spatial Reasoning for Multi-Object Navigation

In the context of visual navigation, the capacity to map a novel environ...
08/21/2021

Heterogeneous Graph Attention Networks for Learning Diverse Communication

Multi-agent teaming achieves better performance when there is communicat...
09/26/2022

Where2comm: Communication-Efficient Collaborative Perception via Spatial Confidence Maps

Multi-agent collaborative perception could significantly upgrade the per...
05/09/2021

gComm: An environment for investigating generalization in Grounded Language Acquisition

gComm is a step towards developing a robust platform to foster research ...
10/02/2018

On Learning How to Communicate Over Noisy Channels for Collaborative Tasks

Consider a collaborative task carried out by two autonomous agents that ...
05/28/2019

Miss Tools and Mr Fruit: Emergent communication in agents learning about object affordances

Recent research studies communication emergence in communities of deep n...