Learning Evolved Combinatorial Symbols with a Neuro-symbolic Generative Model

04/16/2021
by   Matthias Hofer, et al.
0

Humans have the ability to rapidly understand rich combinatorial concepts from limited data. Here we investigate this ability in the context of auditory signals, which have been evolved in a cultural transmission experiment to study the emergence of combinatorial structure in language. We propose a neuro-symbolic generative model which combines the strengths of previous approaches to concept learning. Our model performs fast inference drawing on neural network methods, while still retaining the interpretability and generalization from limited data seen in structured generative approaches. This model outperforms a purely neural network-based approach on classification as evaluated against both ground truth and human experimental classification preferences, and produces superior reproductions of observed signals as well. Our results demonstrate the power of flexible combined neural-symbolic architectures for human-like generalization in raw perceptual domains and offers a step towards developing precise computational models of inductive biases in language evolution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
10/23/2020

Generative Neurosymbolic Machines

Reconciling symbolic and distributed representations is a crucial challe...
research
03/29/2019

Out-of-the box neural networks can support combinatorial generalization

Combinatorial generalization - the ability to understand and produce nov...
research
06/03/2022

Drawing out of Distribution with Neuro-Symbolic Generative Models

Learning general-purpose representations from perceptual inputs is a hal...
research
07/04/2020

Neuro-Symbolic Generative Art: A Preliminary Study

There are two classes of generative art approaches: neural, where a deep...
research
05/17/2018

Learning is Compiling: Experience Shapes Concept Learning by Combining Primitives in a Language of Thought

Recent approaches to human concept learning have successfully combined t...
research
03/31/2021

A Signal-Centric Perspective on the Evolution of Symbolic Communication

The evolution of symbolic communication is a longstanding open research ...
research
03/19/2020

Generating new concepts with hybrid neuro-symbolic models

Human conceptual knowledge supports the ability to generate novel yet hi...

Please sign up or login with your details

Forgot password? Click here to reset