Topology-Aware Resilient Routing Protocol for FANETs: An Adaptive Q-Learning Approach

06/30/2023
by   Yanpeng Cui, et al.
0

Flying ad hoc networks (FANETs) play a crucial role in numerous military and civil applications since it shortens mission duration and enhances coverage significantly compared with a single unmanned aerial vehicle (UAV). Whereas, designing an energy-efficient FANET routing protocol with a high packet delivery rate (PDR) and low delay is challenging owing to the dynamic topology changes. In this article, we propose a topology-aware resilient routing strategy based on adaptive Q-learning (TARRAQ) to accurately capture topology changes with low overhead and make routing decisions in a distributed and autonomous way. First, we analyze the dynamic behavior of UAV nodes via the queuing theory, and then the closed-form solutions of neighbors' change rate (NCR) and neighbors' change interarrival time (NCIT) distribution are derived. Based on the real-time NCR and NCIT, a resilient sensing interval (SI) is determined by defining the expected sensing delay of network events. Besides, we also present an adaptive Q-learning approach that enables UAVs to make distributed, autonomous, and adaptive routing decisions, where the above SI ensures that the action space can be updated in time at a low cost. The simulation results verify the accuracy of the topology dynamic analysis model and also prove that our TARRAQ outperforms the Q-learning-based topology-aware routing (QTAR), mobility prediction-based virtual routing (MPVR), and greedy perimeter stateless routing based on energy-efficient hello (EE-Hello) in terms of 25.23 PDR, and 5.12

READ FULL TEXT

page 1

page 4

page 5

page 6

page 7

page 14

page 17

page 18

research
03/23/2021

Fully-echoed Q-routing with Simulated Annealing Inference for Flying Adhoc Networks

Current networking protocols deem inefficient in accommodating the two k...
research
10/28/2021

Deep Reinforcement Learning Aided Packet-Routing For Aeronautical Ad-Hoc Networks Formed by Passenger Planes

Data packet routing in aeronautical ad-hoc networks (AANETs) is challeng...
research
08/14/2023

Routing Recovery for UAV Networks with Deliberate Attacks: A Reinforcement Learning based Approach

The unmanned aerial vehicle (UAV) network is popular these years due to ...
research
04/03/2021

A Review of AI-enabled Routing Protocols for UAV Networks: Trends, Challenges, and Future Outlook

Unmanned Aerial Vehicles (UAVs), as a recently emerging technology, enab...
research
04/25/2022

Enhancing Marine Data Transmission with Socially-Aware Resilient Vessel Networks

With the multi-dimensional exploration towards oceans, enormous sensing ...
research
05/24/2022

Beam Aware Stochastic Multihop Routing for Flying Ad-hoc Networks

Routing is a crucial component in the design of Flying Ad-Hoc Networks (...
research
06/04/2018

On Greedy Routing in Dynamic UAV Networks

Unmanned aerial vehicles (UAVs), commonly known as drones, are becoming ...

Please sign up or login with your details

Forgot password? Click here to reset