Anypath Routing Protocol Design via Q-Learning for Underwater Sensor Networks

02/22/2020
by   Yuan Zhou, et al.
0

As a promising technology in the Internet of Underwater Things, underwater sensor networks have drawn a widespread attention from both academia and industry. However, designing a routing protocol for underwater sensor networks is a great challenge due to high energy consumption and large latency in the underwater environment. This paper proposes a Q-learning-based localization-free anypath routing (QLFR) protocol to prolong the lifetime as well as reduce the end-to-end delay for underwater sensor networks. Aiming at optimal routing policies, the Q-value is calculated by jointly considering the residual energy and depth information of sensor nodes throughout the routing process. More specifically, we define two reward functions (i.e., depth-related and energy-related rewards) for Q-learning with the objective of reducing latency and extending network lifetime. In addition, a new holding time mechanism for packet forwarding is designed according to the priority of forwarding candidate nodes. Furthermore, a mathematical analysis is presented to analyze the performance of the proposed routing protocol. Extensive simulation results demonstrate the superiority performance of the proposed routing protocol in terms of the end-to-end delay and the network lifetime.

READ FULL TEXT
research
11/13/2018

On Distributed Routing in Underwater Optical Wireless Sensor Networks

Underwater optical wireless communication (UOWC) is becoming an attracti...
research
07/24/2023

Expanding Boundaries: Cross-Media Routing for Seamless Underwater and Aerial Communication

The colossal evolution of wireless communication technologies over the p...
research
05/31/2018

Topology Control for Energy-Efficient Localization in Mobile Underwater Sensor Networks using Stackelberg Game

The characteristics of mobile Underwater Sensor Networks (UWSNs), such a...
research
03/04/2022

Fault-Tolerant Backup Clustering Algorithm for Smart Connected Underwater Sensor Networks

This paper addresses poor cluster formation and frequent Cluster Head (C...
research
12/12/2017

Coordinator Location Effects in AODV Routing Protocol in ZigBee Mesh Network

ZigBee mesh network is very important research field in computer network...
research
03/29/2018

Routing and Network Coding over a Cyclic Network for Online Video Gaming

Online video games are getting more popular, attracting a continuously g...
research
02/12/2020

Opportunistic Routing for Opto-Acoustic Internet of Underwater Things

Internet of underwater things (IoUT) is a technological revolution that ...

Please sign up or login with your details

Forgot password? Click here to reset