Vision-based Safe Autonomous UAV Docking with Panoramic Sensors

05/25/2023
by   Phuoc Nguyen Thuan, et al.
0

The remarkable growth of unmanned aerial vehicles (UAVs) has also sparked concerns about safety measures during their missions. To advance towards safer autonomous aerial robots, this work presents a vision-based solution to ensuring safe autonomous UAV landings with minimal infrastructure. During docking maneuvers, UAVs pose a hazard to people in the vicinity. In this paper, we propose the use of a single omnidirectional panoramic camera pointing upwards from a landing pad to detect and estimate the position of people around the landing area. The images are processed in real-time in an embedded computer, which communicates with the onboard computer of approaching UAVs to transition between landing, hovering or emergency landing states. While landing, the ground camera also aids in finding an optimal position, which can be required in case of low-battery or when hovering is no longer possible. We use a YOLOv7-based object detection model and a XGBooxt model for localizing nearby people, and the open-source ROS and PX4 frameworks for communication, interfacing, and control of the UAV. We present both simulation and real-world indoor experimental results to show the efficiency of our methods.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/29/2022

Vision-based system for a real-time detection and following of UAV

In this paper a vision-based system for detection, motion tracking and f...
research
04/24/2020

Vision based hardware-software real-time control system for autonomous landing of an UAV

In this paper we present a vision based hardware-software control system...
research
10/18/2022

Vision-based GNSS-Free Localization for UAVs in the Wild

Considering the accelerated development of Unmanned Aerial Vehicles (UAV...
research
04/30/2023

Leveraging 5G private networks, UAVs and robots to detect and combat broad-leaved dock (Rumex obtusifolius) in feed production

In this paper an autonomous system to detect and combat Rumex obtusifoli...
research
08/25/2021

Vision-based Autonomous Disinfection of High Touch Surfaces in Indoor Environments

Autonomous systems have played an important role in response to the Covi...
research
06/04/2019

Vision-Based Autonomous UAV Navigation and Landing for Urban Search and Rescue

Unmanned Aerial Vehicles (UAVs) equipped with bioradars are a life-savin...
research
02/26/2021

On the Visual-based Safe Landing of UAVs in Populated Areas: a Crucial Aspect for Urban Deployment

Autonomous landing of Unmanned Aerial Vehicles (UAVs) in crowded scenari...

Please sign up or login with your details

Forgot password? Click here to reset