WareVR: Virtual Reality Interface for Supervision of Autonomous Robotic System Aimed at Warehouse Stocktaking

10/21/2021
by   Ivan Kalinov, et al.
0

WareVR is a novel human-robot interface based on a virtual reality (VR) application to interact with a heterogeneous robotic system for automated inventory management. We have created an interface to supervise an autonomous robot remotely from a secluded workstation in a warehouse that could benefit during the current pandemic COVID-19 since the stocktaking is a necessary and regular process in warehouses, which involves a group of people. The proposed interface allows regular warehouse workers without experience in robotics to control the heterogeneous robotic system consisting of an unmanned ground vehicle (UGV) and unmanned aerial vehicle (UAV). WareVR provides visualization of the robotic system in a digital twin of the warehouse, which is accompanied by a real-time video stream from the real environment through an on-board UAV camera. Using the WareVR interface, the operator can conduct different levels of stocktaking, monitor the inventory process remotely, and teleoperate the drone for a more detailed inspection. Besides, the developed interface includes remote control of the UAV for intuitive and straightforward human interaction with the autonomous robot for stocktaking. The effectiveness of the VR-based interface was evaluated through the user study in a "visual inspection" scenario.

READ FULL TEXT

page 1

page 3

page 4

page 5

page 7

research
10/25/2019

AeroVR: Virtual Reality-based Teleoperation with Tactile Feedback for Aerial Manipulation

Drone application for aerial manipulation is tested in such areas as ind...
research
09/06/2021

A Virtual Reality-based Training and Assessment System for Bridge Inspectors with an Assistant Drone

Over 600,000 bridges in the U.S. must be inspected every two years to id...
research
02/13/2020

A New Exocentric Metaphor for Complex Path Following to Control a UAV Using Mixed Reality

Teleoperation of Unmanned Aerial Vehicles (UAVs) has recently become an ...
research
03/18/2021

Immersive Operation of a Semi-Autonomous Aerial Platform for Detecting and Mapping Radiation

Recent advancements in radiation detection and computer vision have enab...
research
09/13/2019

Enabling Humans to Plan Inspection Paths Using a Virtual Reality Interface

In this work, we investigate whether humans can manually generate high-q...
research
02/09/2023

A Vision-Based Algorithm for a Path Following Problem

A novel prize-winner algorithm designed for a path following problem wit...
research
11/09/2019

Dense 3D Reconstruction for Visual Tunnel Inspection using Unmanned Aerial Vehicle

Advances in Unmanned Aerial Vehicle (UAV) opens venues for application s...

Please sign up or login with your details

Forgot password? Click here to reset