Unsupervised Online Grounding of Natural Language during Human-Robot Interactions

07/05/2020
by   Oliver Roesler, et al.
0

Allowing humans to communicate through natural language with robots requires connections between words and percepts. The process of creating these connections is called symbol grounding and has been studied for nearly three decades. Although many studies have been conducted, not many considered grounding of synonyms and the employed algorithms either work only offline or in a supervised manner. In this paper, a cross-situational learning based grounding framework is proposed that allows grounding of words and phrases through corresponding percepts without human supervision and online, i.e. it does not require any explicit training phase, but instead updates the obtained mappings for every new encountered situation. The proposed framework is evaluated through an interaction experiment between a human tutor and a robot, and compared to an existing unsupervised grounding framework. The results show that the proposed framework is able to ground words through their corresponding percepts online and in an unsupervised manner, while outperforming the baseline framework.

READ FULL TEXT

page 3

page 7

page 8

page 9

research
12/12/2018

Towards Understanding Language through Perception in Situated Human-Robot Interaction: From Word Grounding to Grammar Induction

Robots are widely collaborating with human users in diferent tasks that ...
research
09/29/2017

Symbol, Conversational, and Societal Grounding with a Toy Robot

Essential to meaningful interaction is grounding at the symbolic, conver...
research
09/05/2022

Trust in Language Grounding: a new AI challenge for human-robot teams

The challenge of language grounding is to fully understand natural langu...
research
05/05/2023

Interactive Acquisition of Fine-grained Visual Concepts by Exploiting Semantics of Generic Characterizations in Discourse

Interactive Task Learning (ITL) concerns learning about unforeseen domai...
research
03/17/2021

Few-Shot Visual Grounding for Natural Human-Robot Interaction

Natural Human-Robot Interaction (HRI) is one of the key components for s...
research
10/09/2021

Natural Language for Human-Robot Collaboration: Problems Beyond Language Grounding

To enable robots to instruct humans in collaborations, we identify sever...
research
04/21/2017

Accurately and Efficiently Interpreting Human-Robot Instructions of Varying Granularities

Humans can ground natural language commands to tasks at both abstract an...

Please sign up or login with your details

Forgot password? Click here to reset