Lightweight Multi-Drone Detection and 3D-Localization via YOLO

02/18/2022
by   aryan-sharma, et al.
2

In this work, we present and evaluate a method to perform real-time multiple drone detection and three-dimensional localization using state-of-the-art tiny-YOLOv4 object detection algorithm and stereo triangulation. Our computer vision approach eliminates the need for computationally expensive stereo matching algorithms, thereby significantly reducing the memory footprint and making it deployable on embedded systems. Our drone detection system is highly modular (with support for various detection algorithms) and capable of identifying multiple drones in a system, with real-time detection accuracy of up to 77% with an average FPS of 332 (on Nvidia Titan Xp). We also test the complete pipeline in AirSim environment, detecting drones at a maximum distance of 8 meters, with a mean error of 23% of the distance. We also release the source code for the project, with pre-trained models and the curated synthetic stereo dataset.

READ FULL TEXT

page 6

page 7

page 10

page 11

research
03/17/2021

YOLOStereo3D: A Step Back to 2D for Efficient Stereo 3D Detection

Object detection in 3D with stereo cameras is an important problem in co...
research
04/14/2023

YOLO-Drone:Airborne real-time detection of dense small objects from high-altitude perspective

Unmanned Aerial Vehicles (UAVs), specifically drones equipped with remot...
research
09/18/2022

StereoVoxelNet: Real-Time Obstacle Detection Based on Occupancy Voxels from a Stereo Camera Using Deep Neural Networks

Obstacle detection is a safety-critical problem in robot navigation, whe...
research
08/06/2020

Image Generation for Efficient Neural Network Training in Autonomous Drone Racing

Drone racing is a recreational sport in which the goal is to pass throug...
research
05/26/2021

On the Advantages of Multiple Stereo Vision Camera Designs for Autonomous Drone Navigation

In this work we showcase the design and assessment of the performance of...
research
11/24/2021

Track Boosting and Synthetic Data Aided Drone Detection

As the usage of drones increases with lowered costs and improved drone t...
research
01/19/2023

Blind as a bat: audible echolocation on small robots

For safe and efficient operation, mobile robots need to perceive their e...

Please sign up or login with your details

Forgot password? Click here to reset