Assisted Teleoperation in Changing Environments with a Mixture of Virtual Guides

08/12/2020
by   Marco Ewerton, et al.
0

Haptic guidance is a powerful technique to combine the strengths of humans and autonomous systems for teleoperation. The autonomous system can provide haptic cues to enable the operator to perform precise movements; the operator can interfere with the plan of the autonomous system leveraging his/her superior cognitive capabilities. However, providing haptic cues such that the individual strengths are not impaired is challenging because low forces provide little guidance, whereas strong forces can hinder the operator in realizing his/her plan. Based on variational inference, we learn a Gaussian mixture model (GMM) over trajectories to accomplish a given task. The learned GMM is used to construct a potential field which determines the haptic cues. The potential field smoothly changes during teleoperation based on our updated belief over the plans and their respective phases. Furthermore, new plans are learned online when the operator does not follow any of the proposed plans, or after changes in the environment. User studies confirm that our framework helps users perform teleoperation tasks more accurately than without haptic cues and, in some cases, faster. Moreover, we demonstrate the use of our framework to help a subject teleoperate a 7 DoF manipulator in a pick-and-place task.

READ FULL TEXT

page 2

page 13

page 15

page 16

research
03/07/2019

Holdable Haptic Device for 4-DOF Motion Guidance

Hand-held haptic devices can allow for greater freedom of motion and lar...
research
10/10/2020

Human-Supervised Semi-Autonomous Mobile Manipulators for Safely and Efficiently Executing Machine Tending Tasks

Mobile manipulators can be used for machine tending and material handlin...
research
10/04/2022

Long-Term Localization using Semantic Cues in Floor Plan Maps

Lifelong localization in a given map is an essential capability for auto...
research
06/05/2013

Inferring Robot Task Plans from Human Team Meetings: A Generative Modeling Approach with Logic-Based Prior

We aim to reduce the burden of programming and deploying autonomous syst...
research
09/01/2021

Balancing Performance and Human Autonomy with Implicit Guidance Agent

The human-agent team, which is a problem in which humans and autonomous ...
research
08/20/2019

Interactive Trajectory Adaptation through Force-guided Bayesian Optimization

Flexible manufacturing processes demand robots to easily adapt to change...

Please sign up or login with your details

Forgot password? Click here to reset