Log In Sign Up

Distributed CNN Inference on Resource-Constrained UAVs for Surveillance Systems: Design and Optimization

by   Mohammed Jouhari, et al.

Unmanned Aerial Vehicles (UAVs) have attracted great interest in the last few years owing to their ability to cover large areas and access difficult and hazardous target zones, which is not the case of traditional systems relying on direct observations obtained from fixed cameras and sensors. Furthermore, thanks to the advancements in computer vision and machine learning, UAVs are being adopted for a broad range of solutions and applications. However, Deep Neural Networks (DNNs) are progressing toward deeper and complex models that prevent them from being executed on-board. In this paper, we propose a DNN distribution methodology within UAVs to enable data classification in resource-constrained devices and avoid extra delays introduced by the server-based solutions due to data communication over air-to-ground links. The proposed method is formulated as an optimization problem that aims to minimize the latency between data collection and decision-making while considering the mobility model and the resource constraints of the UAVs as part of the air-to-air communication. We also introduce the mobility prediction to adapt our system to the dynamics of UAVs and the network variation. The simulation conducted to evaluate the performance and benchmark the proposed methods, namely Optimal UAV-based Layer Distribution (OULD) and OULD with Mobility Prediction (OULD-MP), were run in an HPC cluster. The obtained results show that our optimization solution outperforms the existing and heuristic-based approaches.


page 1

page 3

page 9

page 11

page 12

page 15


Efficient Real-Time Image Recognition Using Collaborative Swarm of UAVs and Convolutional Networks

Unmanned Aerial Vehicles (UAVs) have recently attracted significant atte...

Multi-UAV Data Collection Framework for Wireless Sensor Networks

In this paper, we propose a framework design for wireless sensor network...

Unified Mobility Estimation Mode

In literature, scientists describe human mobility in a range of granular...

State-Aware Rate Adaptation for UAVs by Incorporating On-Board Sensors

Nowadays unmanned aerial vehicles (UAVs) are being widely applied to a w...

Zero Touch Coordinated UAV Network Formation for 360° Views of a Moving Ground Target in Remote VR Applications

Unmanned aerial vehicles (UAVs) with on-board cameras are widely used fo...

Spatio-Temporal Split Learning for Autonomous Aerial Surveillance using Urban Air Mobility (UAM) Networks

Autonomous surveillance unmanned aerial vehicles (UAVs) are deployed to ...