Learning Depth Vision-Based Personalized Robot Navigation From Dynamic Demonstrations in Virtual Reality

10/04/2022
by   Jorge de Heuvel, et al.
0

For the best human-robot interaction experience, the robot's navigation policy should take into account personal preferences of the user. In this paper, we present a learning framework complemented by a perception pipeline to train a depth vision-based, personalized navigation controller from user demonstrations. Our refined virtual reality interface enables the demonstration of robot navigation trajectories under motion of the user for dynamic interaction scenarios. In a detailed analysis, we evaluate different configurations of the perception pipeline. As the experiments demonstrate, our new pipeline compresses the perceived depth images to a latent state representation and, thus, enables efficient reasoning about the robot's dynamic environment to the learning. We discuss the robot's navigation performance in various virtual scenes by enrolling a variational autoencoder in combination with a motion predictor and demonstrate the first personalized robot navigation controller that solely relies on depth images.

READ FULL TEXT

page 1

page 2

page 3

page 5

research
03/28/2022

Learning Personalized Human-Aware Robot Navigation Using Virtual Reality Demonstrations from a User Study

For the most comfortable, human-aware robot navigation, subjective user ...
research
07/26/2021

Pluto: Motion Detection for Navigation in a VR Headset

Untethered, inside-out tracking is considered a new goalpost for virtual...
research
03/07/2021

Learning a State Representation and Navigation in Cluttered and Dynamic Environments

In this work, we present a learning-based pipeline to realise local navi...
research
07/28/2013

Knowledge Representation for Robots through Human-Robot Interaction

The representation of the knowledge needed by a robot to perform complex...
research
03/12/2016

From virtual demonstration to real-world manipulation using LSTM and MDN

Robots assisting the disabled or elderly must perform complex manipulati...
research
04/04/2015

Preprint Extending Touch-less Interaction on Vision Based Wearable Device

This is the preprint version of our paper on IEEE Virtual Reality Confer...
research
11/08/2017

A Multi-Robot Cooperation Framework for Sewing Personalized Stent Grafts

This paper presents a multi-robot system for manufacturing personalized ...

Please sign up or login with your details

Forgot password? Click here to reset