A Comprehensive Approach for UAV Small Object Detection with Simulation-based Transfer Learning and Adaptive Fusion

09/04/2021
by   Chen Rui, et al.
19

Precisely detection of Unmanned Aerial Vehicles(UAVs) plays a critical role in UAV defense systems. Deep learning is widely adopted for UAV object detection whereas researches on this topic are limited by the amount of dataset and small scale of UAV. To tackle these problems, a novel comprehensive approach that combines transfer learning based on simulation data and adaptive fusion is proposed. Firstly, the open-source plugin AirSim proposed by Microsoft is used to generate mass realistic simulation data. Secondly, transfer learning is applied to obtain a pre-trained YOLOv5 model on the simulated dataset and fine-tuned model on the real-world dataset. Finally, an adaptive fusion mechanism is proposed to further improve small object detection performance. Experiment results demonstrate the effectiveness of simulation-based transfer learning which leads to a 2.7 on UAV object detection. Furthermore, with transfer learning and adaptive fusion mechanism, 7.1 model.

READ FULL TEXT

page 4

page 5

page 9

page 10

research
08/11/2019

Delving into Robust Object Detection from Unmanned Aerial Vehicles: A Deep Nuisance Disentanglement Approach

Object detection from images captured by Unmanned Aerial Vehicles (UAVs)...
research
01/29/2021

Gaining Scale Invariance in UAV Bird's Eye View Object Detection by Adaptive Resizing

In this work, we introduce a new preprocessing step applicable to UAV bi...
research
12/31/2022

An Integrated Visual System for Unmanned Aerial Vehicles Tracking and Landing on the Ground Vehicles

The vision of unmanned aerial vehicles is very significant for UAV-relat...
research
01/17/2022

Validation of object detection in UAV-based images using synthetic data

Object detection is increasingly used onboard Unmanned Aerial Vehicles (...
research
08/08/2021

Deep Transfer Learning for Identifications of Slope Surface Cracks

Geohazards such as landslides have caused great losses to the safety of ...
research
01/04/2021

SpotPatch: Parameter-Efficient Transfer Learning for Mobile Object Detection

Deep learning based object detectors are commonly deployed on mobile dev...
research
08/18/2023

Improving Buoy Detection with Deep Transfer Learning for Mussel Farm Automation

The aquaculture sector in New Zealand is experiencing rapid expansion, w...

Please sign up or login with your details

Forgot password? Click here to reset