Interactive and Incremental Learning of Spatial Object Relations from Human Demonstrations

05/16/2023
by   Rainer-Kartmann, et al.
0

Humans use semantic concepts such as spatial relations between objects to describe scenes and communicate tasks such as "Put the tea to the right of the cup" or "Move the plate between the fork and the spoon." Just as children, assistive robots must be able to learn the sub-symbolic meaning of such concepts from human demonstrations and instructions. We address the problem of incrementally learning geometric models of spatial relations from few demonstrations collected online during interaction with a human. Such models enable a robot to manipulate objects in order to fulfill desired spatial relations specified by verbal instructions. At the start, we assume the robot has no geometric model of spatial relations. Given a task as above, the robot requests the user to demonstrate the task once in order to create a model from a single demonstration, leveraging cylindrical probability distribution as generative representation of spatial relations. We show how this model can be updated incrementally with each new demonstration without access to past examples in a sample-efficient way using incremental maximum likelihood estimation, and demonstrate the approach on a real humanoid robot.

READ FULL TEXT

page 1

page 2

page 8

page 14

page 17

page 18

research
07/15/2020

Tell me what this is: Few-Shot Incremental Object Learning by a Robot

For many applications, robots will need to be incrementally trained to r...
research
04/14/2017

Incremental learning of high-level concepts by imitation

Nowadays, robots become a companion in everyday life. To be well-accepte...
research
09/13/2019

Where is My Stuff? An Interactive System for Spatial Relations

In this paper we present a system that detects and tracks objects and ag...
research
07/31/2019

Disentangled Relational Representations for Explaining and Learning from Demonstration

Learning from demonstration is an effective method for human users to in...
research
07/17/2020

Verbal Focus-of-Attention System for Learning-from-Demonstration

The Learning-from-Demonstration (LfD) framework aims to map human demons...
research
06/16/2021

Unsupervised Lexical Acquisition of Relative Spatial Concepts Using Spoken User Utterances

This paper proposes methods for unsupervised lexical acquisition for rel...
research
01/23/2020

Learning Object Placements For Relational Instructions by Hallucinating Scene Representations

Robots coexisting with humans in their environment and performing servic...

Please sign up or login with your details

Forgot password? Click here to reset