The Emergence of the Shape Bias Results from Communicative Efficiency

09/13/2021
by   Eva Portelance, et al.
7

By the age of two, children tend to assume that new word categories are based on objects' shape, rather than their color or texture; this assumption is called the shape bias. They are thought to learn this bias by observing that their caregiver's language is biased towards shape based categories. This presents a chicken and egg problem: if the shape bias must be present in the language in order for children to learn it, how did it arise in language in the first place? In this paper, we propose that communicative efficiency explains both how the shape bias emerged and why it persists across generations. We model this process with neural emergent language agents that learn to communicate about raw pixelated images. First, we show that the shape bias emerges as a result of efficient communication strategies employed by agents. Second, we show that pressure brought on by communicative need is also necessary for it to persist across generations; simply having a shape bias in an agent's input language is insufficient. These results suggest that, over and above the operation of other learning strategies, the shape bias in human learners may emerge and be sustained by communicative pressures.

READ FULL TEXT

page 1

page 4

page 12

page 17

research
11/20/2019

Exploring the Origins and Prevalence of Texture Bias in Convolutional Neural Networks

Recent work has indicated that, unlike humans, ImageNet-trained CNNs ten...
research
01/30/2023

Communication Drives the Emergence of Language Universals in Neural Agents: Evidence from the Word-order/Case-marking Trade-off

Artificial learners often behave differently from human learners in the ...
research
02/16/2022

A Developmentally-Inspired Examination of Shape versus Texture Bias in Machines

Early in development, children learn to extend novel category labels to ...
research
03/21/2018

Assessing Shape Bias Property of Convolutional Neural Networks

It is known that humans display "shape bias" when classifying new items,...
research
09/06/2016

Template shape estimation: correcting an asymptotic bias

We use tools from geometric statistics to analyze the usual estimation p...
research
02/08/2018

Learning Inductive Biases with Simple Neural Networks

People use rich prior knowledge about the world in order to efficiently ...
research
05/24/2021

The advent and fall of a vocabulary learning bias from communicative efficiency

It is well-known that, when sufficiently young children encounter a new ...

Please sign up or login with your details

Forgot password? Click here to reset