Listen, Interact and Talk: Learning to Speak via Interaction

05/28/2017
by   Haichao Zhang, et al.
0

One of the long-term goals of artificial intelligence is to build an agent that can communicate intelligently with human in natural language. Most existing work on natural language learning relies heavily on training over a pre-collected dataset with annotated labels, leading to an agent that essentially captures the statistics of the fixed external training data. As the training data is essentially a static snapshot representation of the knowledge from the annotator, the agent trained this way is limited in adaptiveness and generalization of its behavior. Moreover, this is very different from the language learning process of humans, where language is acquired during communication by taking speaking action and learning from the consequences of speaking action in an interactive manner. This paper presents an interactive setting for grounded natural language learning, where an agent learns natural language by interacting with a teacher and learning from feedback, thus learning and improving language skills while taking part in the conversation. To achieve this goal, we propose a model which incorporates both imitation and reinforcement by leveraging jointly sentence and reward feedbacks from the teacher. Experiments are conducted to validate the effectiveness of the proposed approach.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/26/2018

Interactive Language Acquisition with One-shot Visual Concept Learning through a Conversational Game

Building intelligent agents that can communicate with and learn from hum...
research
11/21/2017

Mastering the Dungeon: Grounded Language Learning by Mechanical Turker Descent

Contrary to most natural language processing research, which makes use o...
research
02/20/2017

Parent Oriented Teacher Selection Causes Language Diversity

An evolutionary model for emergence of diversity in language is develope...
research
09/24/2019

Talk2Car: Taking Control of Your Self-Driving Car

A long-term goal of artificial intelligence is to have an agent execute ...
research
07/19/2019

Interactive Learning of Environment Dynamics for Sequential Tasks

In order for robots and other artificial agents to efficiently learn to ...
research
03/28/2023

Exploring Natural Language Processing Methods for Interactive Behaviour Modelling

Analysing and modelling interactive behaviour is an important topic in h...
research
10/18/2018

BabyAI: First Steps Towards Grounded Language Learning With a Human In the Loop

Allowing humans to interactively train artificial agents to understand l...

Please sign up or login with your details

Forgot password? Click here to reset