Self-play for Data Efficient Language Acquisition

10/10/2020
by   Charles Lovering, et al.
0

When communicating, people behave consistently across conversational roles: People understand the words they say and are able to produce the words they hear. To date, artificial agents developed for language tasks have lacked such symmetry, meaning agents trained to produce language are unable to understand it and vice-versa. In this work, we exploit the symmetric nature of communication in order to improve both the efficiency and quality of language acquisition in learning agents. Specifically, we consider the setting in which an agent must learn to both understand and generate words in an existing language, but with the assumption that access to interaction with "oracle" speakers of the language is very limited. We show that using self-play as a substitute for direct supervision enables the agent to transfer its knowledge across roles (e.g. training as a listener but testing as a speaker) and make better inferences about the ground truth lexicon using only a handful of interactions with the oracle.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/19/2019

What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents

Conversational agents promise conversational interaction but fail to del...
research
05/28/2018

Memory Augmented Self-Play

Self-play is an unsupervised training procedure which enables the reinfo...
research
05/16/2022

How do people incorporate advice from artificial agents when making physical judgments?

How do people build up trust with artificial agents? Here, we study a ke...
research
06/01/2022

Understanding How People Rate Their Conversations

User ratings play a significant role in spoken dialogue systems. Typical...
research
09/22/2020

Lifelong Learning Dialogue Systems: Chatbots that Self-Learn On the Job

Dialogue systems, also called chatbots, are now used in a wide range of ...
research
05/18/2022

Color Overmodification Emerges from Data-Driven Learning and Pragmatic Reasoning

Speakers' referential expressions often depart from communicative ideals...
research
06/03/2018

A Framework for Speechreading Acquisition Tools

At least 360 million people worldwide have disabling hearing loss that f...

Please sign up or login with your details

Forgot password? Click here to reset