Learning Evolved Combinatorial Symbols with a Neuro-symbolic Generative Model

by   Matthias Hofer, et al.

Humans have the ability to rapidly understand rich combinatorial concepts from limited data. Here we investigate this ability in the context of auditory signals, which have been evolved in a cultural transmission experiment to study the emergence of combinatorial structure in language. We propose a neuro-symbolic generative model which combines the strengths of previous approaches to concept learning. Our model performs fast inference drawing on neural network methods, while still retaining the interpretability and generalization from limited data seen in structured generative approaches. This model outperforms a purely neural network-based approach on classification as evaluated against both ground truth and human experimental classification preferences, and produces superior reproductions of observed signals as well. Our results demonstrate the power of flexible combined neural-symbolic architectures for human-like generalization in raw perceptual domains and offers a step towards developing precise computational models of inductive biases in language evolution.



There are no comments yet.


page 1

page 2

page 3

page 4


Generative Neurosymbolic Machines

Reconciling symbolic and distributed representations is a crucial challe...

Out-of-the box neural networks can support combinatorial generalization

Combinatorial generalization - the ability to understand and produce nov...

Learning Task-General Representations with Generative Neuro-Symbolic Modeling

A hallmark of human intelligence is the ability to interact directly wit...

Learning is Compiling: Experience Shapes Concept Learning by Combining Primitives in a Language of Thought

Recent approaches to human concept learning have successfully combined t...

A Signal-Centric Perspective on the Evolution of Symbolic Communication

The evolution of symbolic communication is a longstanding open research ...

Generating new concepts with hybrid neuro-symbolic models

Human conceptual knowledge supports the ability to generate novel yet hi...

Learning like humans with Deep Symbolic Networks

We introduce the Deep Symbolic Network (DSN) model, which aims at becomi...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.