Language Acquisition is Embodied, Interactive, Emotive: a Research Proposal

05/10/2021
by   Casey Kennington, et al.
0

Humans' experience of the world is profoundly multimodal from the beginning, so why do existing state-of-the-art language models only use text as a modality to learn and represent semantic meaning? In this paper we review the literature on the role of embodiment and emotion in the interactive setting of spoken dialogue as necessary prerequisites for language learning for human children, including how words in child vocabularies are largely concrete, then shift to become more abstract as the children get older. We sketch a model of semantics that leverages current transformer-based models and a word-level grounded model, then explain the robot-dialogue system that will make use of our semantic model, the setting for the system to learn language, and existing benchmarks for evaluation.

READ FULL TEXT
research
10/05/2021

Word Acquisition in Neural Language Models

We investigate how neural language models acquire individual words durin...
research
07/10/2023

On the Computational Modeling of Meaning: Embodied Cognition Intertwined with Emotion

This document chronicles this author's attempt to explore how words come...
research
03/16/2021

Conversational User Interfaces As Assistive interlocutors For Young Children's Bilingual Language Acquisition

Children in a large number of international and cross-cultural families ...
research
05/14/2018

Word learning and the acquisition of syntactic--semantic overhypotheses

Children learning their first language face multiple problems of inducti...
research
11/09/2020

AI Stories: An Interactive Narrative System for Children

AI Stories is a proposed interactive dialogue system, that lets children...
research
11/07/2015

The Goldilocks Principle: Reading Children's Books with Explicit Memory Representations

We introduce a new test of how well language models capture meaning in c...
research
04/16/2023

The language of sounds unheard: Exploring musical timbre semantics of large language models

Semantic dimensions of sound have been playing a central role in underst...

Please sign up or login with your details

Forgot password? Click here to reset