Bimanual Telemanipulation with Force and Haptic Feedback through an Anthropomorphic Avatar System

01/02/2023
by   Christian Lenz, et al.
0

Robotic teleoperation is a key technology for a wide variety of applications. It allows sending robots instead of humans in remote, possibly dangerous locations while still using the human brain with its enormous knowledge and creativity, especially for solving unexpected problems. A main challenge in teleoperation consists of providing enough feedback to the human operator for situation awareness and thus create full immersion, as well as offering the operator suitable control interfaces to achieve efficient and robust task fulfillment. We present a bimanual telemanipulation system consisting of an anthropomorphic avatar robot and an operator station providing force and haptic feedback to the human operator. The avatar arms are controlled in Cartesian space with a direct mapping of the operator movements. The measured forces and torques on the avatar side are haptically displayed to the operator. We developed a predictive avatar model for limit avoidance which runs on the operator side, ensuring low latency. The system was successfully evaluated during the ANA Avatar XPRIZE competition semifinals. In addition, we performed in lab experiments and carried out a small user study with mostly untrained operators.

READ FULL TEXT

page 2

page 4

page 5

page 6

page 10

page 11

page 12

research
09/27/2021

Bimanual Telemanipulation with Force and Haptic Feedback and Predictive Limit Avoidance

Robotic teleoperation is a key technology for a wide variety of applicat...
research
09/28/2021

NimbRo Avatar: Interactive Immersive Telepresence with Force-Feedback Telemanipulation

Robotic avatars promise immersive teleoperation with human-like manipula...
research
08/23/2023

NimbRo wins ANA Avatar XPRIZE Immersive Telepresence Competition: Human-Centric Evaluation and Lessons Learned

Robotic avatar systems can enable immersive telepresence with locomotion...
research
07/29/2021

Mapping Human Muscle Force to Supernumerary Robotics Device for Overhead Task Assistance

Supernumerary Robotics Device (SRD) is an ideal solution to provide robo...
research
03/06/2023

Robust Immersive Telepresence and Mobile Telemanipulation: NimbRo wins ANA Avatar XPRIZE Finals

Robotic avatar systems promise to bridge distances and reduce the need f...
research
12/16/2022

Attentiveness Map Estimation for Haptic Teleoperation of Mobile Robot Obstacle Avoidance and Approach

Haptic feedback can improve safety of teleoperated robots when situation...
research
08/24/2021

Long-Term, in-the-Wild Study of Feedback about Speech Intelligibility for K-12 Students Attending Class via a Telepresence Robot

Telepresence robots offer presence, embodiment, and mobility to remote u...

Please sign up or login with your details

Forgot password? Click here to reset