Symbol Emergence as an Interpersonal Multimodal Categorization

05/31/2019
by   Yoshinobu Hagiwara, et al.
0

This study focuses on category formation for individual agents and the dynamics of symbol emergence in a multi-agent system through semiotic communication. Semiotic communication is defined, in this study, as the generation and interpretation of signs associated with the categories formed through the agent's own sensory experience or by exchange of signs with other agents. From the viewpoint of language evolution and symbol emergence, organization of a symbol system in a multi-agent system is considered as a bottom-up and dynamic process, where individual agents share the meaning of signs and categorize sensory experience. A constructive computational model can explain the mutual dependency of the two processes and has mathematical support that guarantees a symbol system's emergence and sharing within the multi-agent system. In this paper, we describe a new computational model that represents symbol emergence in a two-agent system based on a probabilistic generative model for multimodal categorization. It models semiotic communication via a probabilistic rejection based on the receiver's own belief. We have found that the dynamics by which cognitively independent agents create a symbol system through their semiotic communication can be regarded as the inference process of a hidden variable in an interpersonal multimodal categorizer, if we define the rejection probability based on the Metropolis-Hastings algorithm. The validity of the proposed model and algorithm for symbol emergence is also verified in an experiment with two agents observing daily objects in the real-world environment. The experimental results demonstrate that our model reproduces the phenomena of symbol emergence, which does not require a teacher who would know a pre-existing symbol system. Instead, the multi-agent system can form and use a symbol system without having pre-existing categories.

READ FULL TEXT

page 6

page 7

page 8

page 9

page 10

page 11

page 14

page 16

research
09/15/2021

Multiagent Multimodal Categorization for Symbol Emergence: Emergent Communication via Interpersonal Cross-modal Inference

This paper describes a computational model of multiagent multimodal cate...
research
05/24/2022

Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Models

Emergent communication, also known as symbol emergence, seeks to investi...
research
05/31/2023

Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Models

In the studies on symbol emergence and emergent communication in a popul...
research
05/10/2023

Context-dependent communication under environmental constraints

There is significant evidence that real-world communication cannot be re...
research
01/25/2016

The Utility of Hedged Assertions in the Emergence of Shared Categorical Labels

We investigate the emergence of shared concepts in a community of langua...
research
05/24/2022

Symbol Emergence as Inter-personal Categorization with Head-to-head Latent Word

In this study, we propose a head-to-head type (H2H-type) inter-personal ...
research
01/26/2018

Symbol Emergence in Cognitive Developmental Systems: a Survey

Symbol emergence through a robot's own interactive exploration of the wo...

Please sign up or login with your details

Forgot password? Click here to reset