Augmented Reality Remote Operation of Dual Arm Manipulators in Hot Boxes

03/28/2023
by   Frank Regal, et al.
0

In nuclear isotope and chemistry laboratories, hot cells and gloveboxes provide scientists with a controlled and safe environment to perform experiments. Working on experiments in these isolated containment cells requires scientists to be physically present. For hot cell work today, scientists manipulate equipment and radioactive material inside through a bilateral mechanical control mechanism. Motions produced outside the cell with the master control levers are mechanically transferred to the internal grippers inside the shielded containment cell. There is a growing need to have the capability to conduct experiments within these cells remotely. A simple method to enable remote manipulations within hot cell and glovebox cells is to mount two robotic arms inside a box to mimic the motions of human hands. An AR application was built in this work to allow a user wearing a Microsoft HoloLens 2 headset to teleoperate dual arm manipulators by grasping robotic end-effector digital replicas in AR from a remote location. In addition to the real-time replica of the physical robotic arms in AR, the application enables users to view a live video stream attached to the robotic arms and parse a 3D point cloud of 3D objects in their remote AR environment for better situational awareness. This work also provides users with virtual fixture to assist in manipulation and other teleoperation tasks.

READ FULL TEXT

page 1

page 2

research
07/20/2022

A Shared Autonomy Reconfigurable Control Framework for Telemanipulation of Multi-arm Systems

Teleoperation is a widely adopted strategy to control robotic manipulato...
research
03/27/2023

Avatarm: an Avatar With Manipulation Capabilities for the Physical Metaverse

Metaverse is an immersive shared space that remote users can access thro...
research
11/07/2020

ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition

We present ZoomTouch - a breakthrough technology for multi-user control ...
research
07/23/2019

Reflective-AR Display: An Interaction Methodology for Virtual-Real Alignment in Medical Robotics

Robot-assisted minimally invasive surgery has shown to improve patient o...
research
09/08/2022

A Secure and Efficient Multi-Object Grasping Detection Approach for Robotic Arms

Robotic arms are widely used in automatic industries. However, with wide...
research
10/27/2020

A Neuro-Symbolic Humanlike Arm Controller for Sophia the Robot

We outline the design and construction of novel robotic arms using machi...
research
04/09/2022

Robotic Surgery Remote Mentoring via AR with 3D Scene Streaming and Hand Interaction

With the growing popularity of robotic surgery, education becomes increa...

Please sign up or login with your details

Forgot password? Click here to reset