Deep Learning-based Human Detection for UAVs with Optical and Infrared Cameras: System and Experiments

08/10/2020
by   Timo Hinzmann, et al.
9

In this paper, we present our deep learning-based human detection system that uses optical (RGB) and long-wave infrared (LWIR) cameras to detect, track, localize, and re-identify humans from UAVs flying at high altitude. In each spectrum, a customized RetinaNet network with ResNet backbone provides human detections which are subsequently fused to minimize the overall false detection rate. We show that by optimizing the bounding box anchors and augmenting the image resolution the number of missed detections from high altitudes can be decreased by over 20 percent. Our proposed network is compared to different RetinaNet and YOLO variants, and to a classical optical-infrared human detection framework that uses hand-crafted features. Furthermore, along with the publication of this paper, we release a collection of annotated optical-infrared datasets recorded with different UAVs during search-and-rescue field tests and the source code of the implemented annotation tool.

READ FULL TEXT

page 2

page 5

page 6

page 7

page 9

page 11

page 16

page 17

research
09/06/2017

Detecting animals in African Savanna with UAVs and the crowds

Unmanned aerial vehicles (UAVs) offer new opportunities for wildlife mon...
research
11/29/2022

TF-Net: Deep Learning Empowered Tiny Feature Network for Night-time UAV Detection

Technological advancements have normalized the usage of unmanned aerial ...
research
04/04/2023

A real-time algorithm for human action recognition in RGB and thermal video

Monitoring the movement and actions of humans in video in real-time is a...
research
04/13/2018

Deep Motion Boundary Detection

Motion boundary detection is a crucial yet challenging problem. Prior me...
research
12/08/2020

Deep Learning based Multi-Modal Sensing for Tracking and State Extraction of Small Quadcopters

This paper proposes a multi-sensor based approach to detect, track, and ...
research
07/21/2023

BatMobility: Towards Flying Without Seeing for Autonomous Drones

Unmanned aerial vehicles (UAVs) rely on optical sensors such as cameras ...

Please sign up or login with your details

Forgot password? Click here to reset