Human few-shot learning of compositional instructions

01/14/2019
by   Brenden M. Lake, et al.
0

People learn in fast and flexible ways that have not been emulated by machines. Once a person learns a new verb "dax," he or she can effortlessly understand how to "dax twice," "walk and dax," or "dax vigorously." There have been striking recent improvements in machine learning for natural language processing, yet the best algorithms require vast amounts of experience and struggle to generalize new concepts in compositional ways. To better understand these distinctively human abilities, we study the compositional skills of people through language-like instruction learning tasks. Our results show that people can learn and use novel functional concepts from very few examples (few-shot learning), successfully applying familiar functions to novel inputs. People can also compose concepts in complex ways that go beyond the provided demonstrations. Two additional experiments examined the assumptions and inductive biases that people make when solving these tasks, revealing three biases: mutual exclusivity, one-to-one mappings, and iconic concatenation. We discuss the implications for cognitive modeling and the potential for building machines with more human-like language learning capabilities.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
05/30/2023

Compositional diversity in visual concept learning

Humans leverage compositionality to efficiently learn new concepts, unde...
research
05/23/2022

Using Natural Language and Program Abstractions to Instill Human Inductive Biases in Machines

Strong inductive biases are a key component of human intelligence, allow...
research
02/09/2022

Can Humans Do Less-Than-One-Shot Learning?

Being able to learn from small amounts of data is a key characteristic o...
research
04/17/2019

People infer recursive visual concepts from just a few examples

Machine learning has made major advances in categorizing objects in imag...
research
09/12/2019

Analyzing machine-learned representations: A natural language case study

As modern deep networks become more complex, and get closer to human-lik...
research
09/17/2018

The Fast and the Flexible: training neural networks to learn to follow instructions from small data

Learning to follow human instructions is a challenging task because whil...
research
05/19/2020

Human-like general language processing

Using language makes human beings surpass animals in wisdom. To let mach...

Please sign up or login with your details

Forgot password? Click here to reset