Learn and Transfer Knowledge of Preferred Assistance Strategies in Semi-autonomous Telemanipulation

03/07/2020
by   Lingfeng Tao, et al.
0

Increasing the autonomy level of a robot hand to accomplish remote object manipulation tasks faster and easier is a new and promising topic in teleoperation. Such semi-autonomous telemanipulation, however, is very challenging due to the physical discrepancy between the human hand and the robot hand, along with the fine motion constraints required for the manipulation task. To overcome these challenges, the robot needs to learn how to assist the human operator in a preferred/intuitive way, which must provide effective assistance that the operator needs yet still accommodate human inputs, so the operator feels in control of the system (i.e., not counter-intuitive to the operator). Toward this goal, we develop novel data-driven approaches to stably learn what assistance is preferred from high data variance caused by the ambiguous nature of human operators. To avoid an extensive robot-specific training process, methods to transfer this assistance knowledge between different robot hands are discussed. Experiments were conducted to telemanipulate a cup for three principal tasks: usage, move, and handover by remotely controlling a 3-finger gripper and 2-finger gripper. Results demonstrated that the proposed model effectively learned the knowledge of preferred assistance, and knowledge transfer between robots allows this semi-autonomous telemanipulation strategy to be scaled up with less training efforts.

READ FULL TEXT

page 2

page 4

page 6

page 10

research
03/07/2020

An Intent-based Task-aware Shared Control Framework for Intuitive Object Telemanipulation

Shared control in teleoperation for providing robot assistance to accomp...
research
10/04/2019

Reach Out and Help: Assisted Remote Collaboration through a Handheld Robot

We explore a remote collaboration setup, which involves three parties: a...
research
09/18/2018

Supervised Autonomous Locomotion and Manipulation for Disaster Response with a Centaur-like Robot

Mobile manipulation tasks are one of the key challenges in the field of ...
research
11/11/2021

Scalable Operator Allocation for Multi-Robot Assistance: A Restless Bandit Approach

In this paper, we consider the problem of allocating human operators in ...
research
10/10/2020

Human-Supervised Semi-Autonomous Mobile Manipulators for Safely and Efficiently Executing Machine Tending Tasks

Mobile manipulators can be used for machine tending and material handlin...
research
07/01/2022

Human-Assisted Robotic Detection of Foreign Object Debris Inside Confined Spaces of Marine Vessels Using Probabilistic Mapping

Many complex vehicular systems, such as large marine vessels, contain co...
research
09/07/2022

Scheduling Operator Assistance for Shared Autonomy in Multi-Robot Teams

In this paper, we consider the problem of allocating human operator assi...

Please sign up or login with your details

Forgot password? Click here to reset