Symbol Emergence as Inter-personal Categorization with Head-to-head Latent Word

05/24/2022
by   Kazuma Furukawa, et al.
0

In this study, we propose a head-to-head type (H2H-type) inter-personal multimodal Dirichlet mixture (Inter-MDM) by modifying the original Inter-MDM, which is a probabilistic generative model that represents the symbol emergence between two agents as multiagent multimodal categorization. A Metropolis–Hastings method-based naming game based on the Inter-MDM enables two agents to collaboratively perform multimodal categorization and share signs with a solid mathematical foundation of convergence. However, the conventional Inter-MDM presumes a tail-to-tail connection across a latent word variable, causing inflexibility of the further extension of Inter-MDM for modeling a more complex symbol emergence. Therefore, we propose herein a head-to-head type (H2H-type) Inter-MDM that treats a latent word variable as a child node of an internal variable of each agent in the same way as many prior studies of multimodal categorization. On the basis of the H2H-type Inter-MDM, we propose a naming game in the same way as the conventional Inter-MDM. The experimental results show that the H2H-type Inter-MDM yields almost the same performance as the conventional Inter-MDM from the viewpoint of multimodal categorization and sign sharing.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/15/2021

Multiagent Multimodal Categorization for Symbol Emergence: Emergent Communication via Interpersonal Cross-modal Inference

This paper describes a computational model of multiagent multimodal cate...
research
05/31/2019

Symbol Emergence as an Interpersonal Multimodal Categorization

This study focuses on category formation for individual agents and the d...
research
05/24/2022

Emergent Communication through Metropolis-Hastings Naming Game with Deep Generative Models

Emergent communication, also known as symbol emergence, seeks to investi...
research
10/20/2019

Neuro-SERKET: Development of Integrative Cognitive System through the Composition of Deep Probabilistic Generative Models

This paper describes a framework for the development of an integrative c...
research
05/31/2023

Recursive Metropolis-Hastings Naming Game: Symbol Emergence in a Multi-agent System based on Probabilistic Generative Models

In the studies on symbol emergence and emergent communication in a popul...
research
06/27/2023

Symbol emergence as interpersonal cross-situational learning: the emergence of lexical knowledge with combinatoriality

We present a computational model for a symbol emergence system that enab...

Please sign up or login with your details

Forgot password? Click here to reset