AeroVR: Virtual Reality-based Teleoperation with Tactile Feedback for Aerial Manipulation

10/25/2019
by   Grigoriy A. Yashin, et al.
0

Drone application for aerial manipulation is tested in such areas as industrial maintenance, supporting the rescuers in emergencies, and e-commerce. Most of such applications require teleoperation. The operator receives visual feedback from the camera installed on a robot arm or drone. As aerial manipulation requires delicate and precise motion of robot arm, the camera data delay, narrow field of view, and blurred images caused by drone dynamics can lead the UAV to crash. The paper focuses on the development of a novel teleoperation system for aerial manipulation using Virtual Reality (VR). The controlled system consists of UAV with a 4-DoF robotic arm and embedded sensors. VR application presents the digital twin of drone and remote environment to the user through a head-mounted display (HMD). The operator controls the position of the robotic arm and gripper with VR trackers worn on the arm and tracking glove with vibrotactile feedback. Control data is translated directly from VR to the real robot in real-time. The experimental results showed a stable and robust teleoperation mediated by the VR scene. The proposed system can considerably improve the quality of aerial manipulations.

READ FULL TEXT

page 1

page 2

page 4

research
11/12/2019

SlingDrone: Mixed Reality System for Pointing and Interaction Using a Single Drone

We propose SlingDrone, a novel Mixed Reality interaction paradigm that u...
research
10/21/2021

WareVR: Virtual Reality Interface for Supervision of Autonomous Robotic System Aimed at Warehouse Stocktaking

WareVR is a novel human-robot interface based on a virtual reality (VR) ...
research
08/07/2019

DronePick: Object Picking and Delivery Teleoperation with the Drone Controlled by a Wearable Tactile Display

We report on the teleoperation system DronePick which provides remote ob...
research
07/29/2018

The Effects of Visual and Control Latency on Piloting a Quadcopter using a Head-Mounted Display

Recent research has proposed teleoperation of robotic and aerial vehicle...
research
10/24/2021

GraspLook: a VR-based Telemanipulation System with R-CNN-driven Augmentation of Virtual Environment

The teleoperation of robotic systems in medical applications requires st...
research
03/25/2020

Visual-Inertial Telepresence for Aerial Manipulation

This paper presents a novel telepresence system for enhancing aerial man...
research
10/18/2022

Virtual Reality via Object Poses and Active Learning: Realizing Telepresence Robots with Aerial Manipulation Capabilities

This article presents a novel telepresence system for advancing aerial m...

Please sign up or login with your details

Forgot password? Click here to reset