Distributed Learning in Ad-Hoc Networks: A Multi-player Multi-armed Bandit Framework

03/06/2020
by   Sumit J. Darak, et al.
0

Next-generation networks are expected to be ultra-dense with a very high peak rate but relatively lower expected traffic per user. For such scenario, existing central controller based resource allocation may incur substantial signaling (control communications) leading to a negative effect on the quality of service (e.g. drop calls), energy and spectrum efficiency. To overcome this problem, cognitive ad-hoc networks (CAHN) that share spectrum with other networks are being envisioned. They allow some users to identify and communicate in `free slots' thereby reducing signaling load and allowing the higher number of users per base stations (dense networks). Such networks open up many interesting challenges such as resource identification, coordination, dynamic and context-aware adaptation for which Machine Learning and Artificial Intelligence framework offers novel solutions. In this paper, we discuss state-of-the-art multi-armed multi-player bandit based distributed learning algorithms that allow users to adapt to the environment and coordinate with other players/users. We also discuss various open research problems for feasible realization of CAHN and interesting applications in other domains such as energy harvesting, Internet of Things, and Smart grids.

READ FULL TEXT
research
12/24/2018

Distributed Learning and Stable Orthogonalization in Ad-Hoc Networks with Heterogeneous Channels

Next generation networks are expected to be ultra dense and aim to explo...
research
03/25/2023

Intelligent Load Balancing and Resource Allocation in O-RAN: A Multi-Agent Multi-Armed Bandit Approach

The open radio access network (O-RAN) architecture offers a cost-effecti...
research
11/22/2022

Distributed Resource Allocation for URLLC in IIoT Scenarios: A Multi-Armed Bandit Approach

This paper addresses the problem of enabling inter-machine Ultra-Reliabl...
research
03/30/2020

Decentralized Learning for Channel Allocation in IoT Networks over Unlicensed Bandwidth as a Contextual Multi-player Multi-armed Bandit Game

We study a decentralized channel allocation problem in an ad-hoc Interne...
research
10/21/2019

Multi-player Multi-Armed Bandits with non-zero rewards on collisions for uncoordinated spectrum access

In this paper, we study the uncoordinated spectrum access problem using ...
research
01/22/2018

A Courteous Learning Rule for Ad-hoc Anti-coordination

In this paper, we investigate the problem of anti-coordination under rat...
research
06/03/2021

Cloud-Enabled High-Altitude Platform Systems: Challenges and Opportunities

Augmenting ground-level communications with flying networks, such as the...

Please sign up or login with your details

Forgot password? Click here to reset