Bayesian Nonparametric Reinforcement Learning in LTE and Wi-Fi Coexistence

05/25/2021
by   Po-Kan Shih, et al.
0

With the formation of next generation wireless communication, a growing number of new applications like internet of things, autonomous car, and drone is crowding the unlicensed spectrum. Licensed network such as the long-term evolution (LTE) also comes to the unlicensed spectrum for better providing high-capacity contents with low cost. However, LTE was not designed for sharing spectrum with others. A cooperation center for these networks is costly because they possess heterogeneous properties and everyone can enter and leave the spectrum unrestrictedly, so the design will be challenging. Since it is infeasible to incorporate potentially infinite scenarios with one unified design, an alternative solution is to let each network learn its own coexistence policy. Previous solutions only work on fixed scenarios. In this work a reinforcement learning algorithm is presented to cope with the coexistence between Wi-Fi and LTE agents in 5 GHz unlicensed spectrum. The coexistence problem was modeled as a decentralized partially observable Markov decision process (Dec-POMDP) and Bayesian approach was adopted for policy learning with nonparametric prior to accommodate the uncertainty of policy for different agents. A fairness measure was introduced in the reward function to encourage fair sharing between agents. The reinforcement learning was turned into an optimization problem by transforming the value function as likelihood and variational inference for posterior approximation. Simulation results demonstrate that this algorithm can reach high value with compact policy representations, and stay computationally efficient when applying to agent set.

READ FULL TEXT

page 9

page 33

page 36

research
07/06/2021

Bayesian Nonparametric Modelling for Model-Free Reinforcement Learning in LTE-LAA and Wi-Fi Coexistence

With the arrival of next generation wireless communication, a growing nu...
research
10/05/2021

A Deep Reinforcement Learning Framework for Contention-Based Spectrum Sharing

The increasing number of wireless devices operating in unlicensed spectr...
research
11/16/2020

Scalable Reinforcement Learning Policies for Multi-Agent Control

This paper develops a stochastic Multi-Agent Reinforcement Learning (MAR...
research
09/01/2020

Distributed Cooperation Under Uncertainty in Drone-Based Wireless Networks: A Bayesian Coalitional Game

We study the resource sharing problem in a drone-based wireless network....
research
02/07/2014

Frequency-Based Patrolling with Heterogeneous Agents and Limited Communication

This paper investigates multi-agent frequencybased patrolling of interse...
research
09/08/2020

Bayesian Inverse Reinforcement Learning for Collective Animal Movement

Agent-based methods allow for defining simple rules that generate comple...
research
08/12/2019

A sub-modular receding horizon solution for mobile multi-agent persistent monitoring

We study the problem of persistent monitoring of finite number of inter-...

Please sign up or login with your details

Forgot password? Click here to reset