Deep Reinforcement Learning-Based Topology Optimization for Self-Organized Wireless Sensor Networks

10/31/2019
by   Xiangyue Meng, et al.
0

Wireless sensor networks (WSNs) are the foundation of the Internet of Things (IoT), and in the era of the fifth generation of wireless communication networks, they are envisioned to be truly ubiquitous, reliable, scalable, and energy efficient. To this end, topology control is an important mechanism to realize self-organized WSNs that are capable of adapting to the dynamics of the environment. Topology optimization is combinatorial in nature, and generally is NP-hard to solve. Most existing algorithms leverage heuristic rules to reduce the number of search candidates so as to obtain a suboptimal solution in a certain sense. In this paper, we propose a deep reinforcement learning-based topology optimization algorithm, a unified search framework, for self-organized energy-efficient WSNs. Specifically, the proposed algorithm uses a deep neural network to guide a Monte Carlo tree search to roll out simulations, and the results from the tree search reinforce the learning of the neural network. In addition, the proposed algorithm is an anytime algorithm that keeps improving the solution with an increasing amount of computing resources. Various simulations show that the proposed algorithm achieves better performance as compared to heuristic solutions, and is capable of adapting to environment and network changes without restarting the algorithm from scratch.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/16/2022

A Deep Reinforcement Learning-based Adaptive Charging Policy for Wireless Rechargeable Sensor Networks

Wireless sensor networks consist of randomly distributed sensor nodes fo...
research
07/23/2020

Deep Reinforcement Learning based Automatic Exploration for Navigation in Unknown Environment

This paper investigates the automatic exploration problem under the unkn...
research
05/07/2020

Energy-efficient topology to enhance the wireless sensor network lifetime using connectivity control

Wireless sensor networks have attracted much attention because of many a...
research
04/19/2022

Network Topology Optimization via Deep Reinforcement Learning

Topology impacts important network performance metrics, including link u...
research
01/07/2019

A* Tree Search for Portfolio Management

We propose a planning-based method to teach an agent to manage portfolio...
research
01/17/2022

An Improved Reinforcement Learning Algorithm for Learning to Branch

Most combinatorial optimization problems can be formulated as mixed inte...
research
06/01/2021

A Unified Cognitive Learning Framework for Adapting to Dynamic Environment and Tasks

Many machine learning frameworks have been proposed and used in wireless...

Please sign up or login with your details

Forgot password? Click here to reset