Towards Abstract Relational Learning in Human Robot Interaction

Humans have a rich representation of the entities in their environment. Entities are described by their attributes, and entities that share attributes are often semantically related. For example, if two books have "Natural Language Processing" as the value of their `title' attribute, we can expect that their `topic' attribute will also be equal, namely, "NLP". Humans tend to generalize such observations, and infer sufficient conditions under which the `topic' attribute of any entity is "NLP". If robots need to interact successfully with humans, they need to represent entities, attributes, and generalizations in a similar way. This ends in a contextualized cognitive agent that can adapt its understanding, where context provides sufficient conditions for a correct understanding. In this work, we address the problem of how to obtain these representations through human-robot interaction. We integrate visual perception and natural language input to incrementally build a semantic model of the world, and then use inductive reasoning to infer logical rules that capture generic semantic relations, true in this model. These relations can be used to enrich the human-robot interaction, to populate a knowledge base with inferred facts, or to remove uncertainty in the robot's sensory inputs.

READ FULL TEXT
research
07/08/2019

Augmenting Knowledge through Statistical, Goal-oriented Human-Robot Dialog

Some robots can interact with humans using natural language, and identif...
research
09/16/2019

Constructing Dynamic Knowledge Graph for Visual Semantic Understanding and Applications in Autonomous Robotics

Interpreting semantic knowledge describing entities, relations and attri...
research
06/13/2023

Ontological component-based description of robot capabilities

A key aspect of a robot's knowledge base is self-awareness about what it...
research
09/28/2015

A Preliminary Study on the Learning Informativeness of Data Subsets

Estimating the internal state of a robotic system is complex: this is pe...
research
04/22/2016

Exploiting Deep Semantics and Compositionality of Natural Language for Human-Robot-Interaction

We develop a natural language interface for human robot interaction that...
research
01/17/2023

Knowledge Acquisition and Completion for Long-Term Human-Robot Interactions using Knowledge Graph Embedding

In Human-Robot Interaction (HRI) systems, a challenging task is sharing ...
research
10/14/2014

Presence-absence reasoning for evolutionary phenotypes

Nearly invariably, phenotypes are reported in the scientific literature ...

Please sign up or login with your details

Forgot password? Click here to reset