Drone Detection and Tracking in Real-Time by Fusion of Different Sensing Modalities

07/05/2022
by   Fredrik Svanstrom, et al.
0

Automatic detection of flying drones is a key issue where its presence, specially if unauthorized, can create risky situations or compromise security. Here, we design and evaluate a multi-sensor drone detection system. In conjunction with common video cameras and microphone sensors, we explore the use of thermal infrared cameras, pointed out as a feasible and promising solution that is scarcely addressed in the related literature. Our solution integrates a fish-eye camera as well to monitor a wider part of the sky and steer the other cameras towards objects of interest. The sensing solutions are complemented with an ADS-B receiver, a GPS receiver, and a radar module, although the latter has been not included in our final deployment due to its limited detection range. The thermal camera is shown to be a feasible solution as good as the video camera, even if the camera employed here has a lower resolution. Two other novelties of our work are the creation of a new public dataset of multi-sensor annotated data that expand the number of classes in comparison to existing ones, as well as the study of the detector performance as a function of the sensor-to-target distance. Sensor fusion is also explored, showing that the system can be made more robust in this way, mitigating false detections of the individual sensors

READ FULL TEXT

page 9

page 13

page 15

page 22

page 25

page 28

page 33

page 38

research
07/14/2020

Real-Time Drone Detection and Tracking With Visible, Thermal and Acoustic Sensors

This paper explores the process of designing an automatic multi-sensor d...
research
04/02/2021

An early warning AI-powered portable system to reduce workload and inspect environmental damage after natural disasters

1.3 million household fires, 3,400 civilian deaths, and 23 billion dolla...
research
11/02/2021

A dataset for multi-sensor drone detection

The use of small and remotely controlled unmanned aerial vehicles (UAVs)...
research
06/30/2022

HRFuser: A Multi-resolution Sensor Fusion Architecture for 2D Object Detection

Besides standard cameras, autonomous vehicles typically include multiple...
research
10/05/2016

Towards a Drone Cinematographer: Guiding Quadrotor Cameras using Visual Composition Principles

We present a system to capture video footage of human subjects in the re...
research
07/07/2023

Robust Human Detection under Visual Degradation via Thermal and mmWave Radar Fusion

The majority of human detection methods rely on the sensor using visible...
research
08/19/2021

Towards a Multispectral RGB-IR-UV-D Vision System – Seeing the Invisible in 3D

In this paper, we present the development of a sensing system with the c...

Please sign up or login with your details

Forgot password? Click here to reset