Human-Machine Interface for Remote Training of Robot Tasks

09/25/2018
by   Jordi Spranger, et al.
0

Regardless of their industrial or research application, the streamlining of robot operations is limited by the proximity of experienced users to the actual hardware. Be it massive open online robotics courses, crowd-sourcing of robot task training, or remote research on massive robot farms for machine learning, the need to create an apt remote Human-Machine Interface is quite prevalent. The paper at hand proposes a novel solution to the programming/training of remote robots employing an intuitive and accurate user-interface which offers all the benefits of working with real robots without imposing delays and inefficiency. The system includes: a vision-based 3D hand detection and gesture recognition subsystem, a simulated digital twin of a robot as visual feedback, and the "remote" robot learning/executing trajectories using dynamic motion primitives. Our results indicate that the system is a promising solution to the problem of remote training of robot tasks.

READ FULL TEXT

page 1

page 4

research
11/07/2020

ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

We present ZoomTouch - a breakthrough technology for multi-user control ...
research
07/02/2021

Prescient teleoperation of humanoid robots

Humanoid robots could be versatile and intuitive human avatars that oper...
research
12/19/2022

Learning-from-Observation System Considering Hardware-Level Reusability

Robot developers develop various types of robots for satisfying users' v...
research
03/24/2020

You Drive Me Crazy! Interactive QoE Assessment for Telepresence Robot Control

Telepresence robots (TPRs) are versatile, remotely controlled vehicles t...
research
08/03/2020

BenchBot: Evaluating Robotics Research in Photorealistic 3D Simulation and on Real Robots

We introduce BenchBot, a novel software suite for benchmarking the perfo...
research
03/21/2019

Long range teleoperation for fine manipulation tasks under time-delay network conditions

We present a coarse-to-fine approach based semi-autonomous teleoperation...
research
04/06/2020

Variable Autonomy of Whole-body Control for Inspection and Intervention in Industrial Environments using Legged Robots

The deployment of robots in industrial and civil scenarios is a viable s...

Please sign up or login with your details

Forgot password? Click here to reset