Towards Understanding Language through Perception in Situated Human-Robot Interaction: From Word Grounding to Grammar Induction

12/12/2018
by   Amir Aly, et al.
0

Robots are widely collaborating with human users in diferent tasks that require high-level cognitive functions to make them able to discover the surrounding environment. A difcult challenge that we briefy highlight in this short paper is inferring the latent grammatical structure of language, which includes grounding parts of speech (e.g., verbs, nouns, adjectives, and prepositions) through visual perception, and induction of Combinatory Categorial Grammar (CCG) for phrases. This paves the way towards grounding phrases so as to make a robot able to understand human instructions appropriately during interaction.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

07/20/2016

Robust Natural Language Processing - Combining Reasoning, Cognitive Semantics and Construction Grammar for Spatial Language

We present a system for generating and understanding of dynamic and stat...
07/05/2020

Unsupervised Online Grounding of Natural Language during Human-Robot Interactions

Allowing humans to communicate through natural language with robots requ...
03/17/2021

Few-Shot Visual Grounding for Natural Human-Robot Interaction

Natural Human-Robot Interaction (HRI) is one of the key components for s...
02/16/2021

Composing Pick-and-Place Tasks By Grounding Language

Controlling robots to perform tasks via natural language is one of the m...
04/22/2016

Exploiting Deep Semantics and Compositionality of Natural Language for Human-Robot-Interaction

We develop a natural language interface for human robot interaction that...
10/03/2018

Grounding Perception: A Developmental Approach to Sensorimotor Contingencies

Sensorimotor contingency theory offers a promising account of the nature...
04/19/2021

Production vs Perception: The Role of Individuality in Usage-Based Grammar Induction

This paper asks whether a distinction between production-based and perce...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.