Teleoperated aerial manipulator and its avatar. Part 1: Communication, system's interconnection, control, and virtual world

10/19/2020
by   Rodolfo Verdín, et al.
0

The tasks that an aerial manipulator can perform are incredibly diverse. However, nowadays the technology is not completely developed to achieve complex tasks autonomously. That's why we propose a human-in-the-loop system that can control a semi-autonomous aerial manipulator to accomplish these kinds of tasks. Furthermore, motivated by the growing trend of virtual reality systems, together with teleoperation, we develop a system composed of: an aerial manipulator model programmed in PX4 and modeled in Gazebo, a virtual reality immersion with an interactive controller, and the interconnection between the aforementioned systems via the Internet. This research is the first part of a broader project. In this part, we present experiments in the software in the loop simulation. The code of this work is liberated on our GitHub page. Also, a video shows the conducted experiments.

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

research
01/08/2019

Interactive Narrative in Virtual Reality

Interactive fiction is a literary genre that is rapidly gaining populari...
research
10/08/2021

VIRUP : The Virtual Reality Universe Project

VIRUP is a new C++ open source software that provides an interactive vir...
research
09/06/2021

A Virtual Reality-based Training and Assessment System for Bridge Inspectors with an Assistant Drone

Over 600,000 bridges in the U.S. must be inspected every two years to id...
research
03/25/2020

Visual-Inertial Telepresence for Aerial Manipulation

This paper presents a novel telepresence system for enhancing aerial man...
research
03/18/2021

Immersive Operation of a Semi-Autonomous Aerial Platform for Detecting and Mapping Radiation

Recent advancements in radiation detection and computer vision have enab...
research
10/18/2022

Virtual Reality via Object Poses and Active Learning: Realizing Telepresence Robots with Aerial Manipulation Capabilities

This article presents a novel telepresence system for advancing aerial m...
research
06/12/2021

Metrics for 3D Object Pointing and Manipulation in Virtual Reality

Assessing the performance of human movements during teleoperation and vi...

Please sign up or login with your details

Forgot password? Click here to reset