What underlies rapid learning and systematic generalization in humans

07/10/2021
by   Andrew Joohun Nam, et al.
5

Despite the groundbreaking successes of neural networks, contemporary models require extensive training with massive datasets and exhibit poor out-of-sample generalization. One proposed solution is to build systematicity and domain-specific constraints into the model, echoing the tenets of classical, symbolic cognitive architectures. In this paper, we consider the limitations of this approach by examining human adults' ability to learn an abstract reasoning task from a brief instructional tutorial and explanatory feedback for incorrect responses, demonstrating that human learning dynamics and ability to generalize outside the range of the training examples differ drastically from those of a representative neural network model, and that the model is brittle to changes in features not anticipated by its authors. We present further evidence from human data that the ability to consistently solve the puzzles was associated with education, particularly basic mathematics education, and with the ability to provide a reliably identifiable, valid description of the strategy used. We propose that rapid learning and systematic generalization in humans may depend on a gradual, experience-dependent process of learning-to-learn using instructions and explanations to guide the construction of explicit abstract rules that support generalizable inferences.

READ FULL TEXT
research
06/11/2021

Sample-efficient Linguistic Generalizations through Program Synthesis: Experiments with Phonology Problems

Neural models excel at extracting statistical patterns from large amount...
research
05/24/2023

Modeling rapid language learning by distilling Bayesian priors into artificial neural networks

Humans can learn languages from remarkably little experience. Developing...
research
07/09/2020

Learning Representations that Support Extrapolation

Extrapolation – the ability to make inferences that go beyond the scope ...
research
06/14/2020

Relational reasoning and generalization using non-symbolic neural networks

Humans have a remarkable capacity to reason about abstract relational st...
research
12/13/2020

A Memory-Augmented Neural Network Model of Abstract Rule Learning

Human intelligence is characterized by a remarkable ability to infer abs...
research
06/05/2018

Human-like generalization in a machine through predicate learning

Humans readily generalize, applying prior knowledge to novel situations ...
research
10/01/2019

Emergent Systematic Generalization in a Situated Agent

The question of whether deep neural networks are good at generalising be...

Please sign up or login with your details

Forgot password? Click here to reset