The Relational Bottleneck as an Inductive Bias for Efficient Abstraction

09/12/2023
by   Taylor W. Webb, et al.
0

A central challenge for cognitive science is to explain how abstract concepts are acquired from limited experience. This effort has often been framed in terms of a dichotomy between empiricist and nativist approaches, most recently embodied by debates concerning deep neural networks and symbolic cognitive models. Here, we highlight a recently emerging line of work that suggests a novel reconciliation of these approaches, by exploiting an inductive bias that we term the relational bottleneck. We review a family of models that employ this approach to induce abstractions in a data-efficient manner, emphasizing their potential as candidate models for the acquisition of abstract concepts in the human mind and brain.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/31/2019

Disentangled Relational Representations for Explaining and Learning from Demonstration

Learning from demonstration is an effective method for human users to in...
research
07/23/2021

Constellation: Learning relational abstractions over objects for compositional imagination

Learning structured representations of visual scenes is currently a majo...
research
06/09/2022

On Neural Architecture Inductive Biases for Relational Tasks

Current deep learning approaches have shown good in-distribution general...
research
10/03/2017

AutoMode: Relational Learning With Less Black Magic

Relational databases are valuable resources for learning novel and inter...
research
06/15/2020

Generalisable Relational Reasoning With Comparators in Low-Dimensional Manifolds

While modern deep neural architectures generalise well when test data is...
research
04/26/2023

The Roles of Symbols in Neural-based AI: They are Not What You Think!

We propose that symbols are first and foremost external communication to...
research
05/10/2023

Davinci the Dualist: the mind-body divide in large language models and in human learners

A large literature suggests that people are intuitive Dualists–they cons...

Please sign up or login with your details

Forgot password? Click here to reset