Correlated Age-of-Information Bandits

11/10/2020
by   Ishank Juneja, et al.
0

We consider a system composed of a sensor node tracking a time varying quantity. In every discretized time slot, the node attempts to send an update to a central monitoring station through one of K communication channels. We consider the setting where channel realizations are correlated across channels. This is motivated by mmWave based 5G systems where line-of-sight which is critical for successful communication is common across all frequency channels while the effect of other factors like humidity is frequency dependent. The metric of interest is the Age-of-Information (AoI) which is a measure of the freshness of the data available at the monitoring station. In the setting where channel statistics are unknown but stationary across time and correlated across channels, the algorithmic challenge is to determine which channel to use in each time-slot for communication. We model the problem as a Multi-Armed bandit (MAB) with channels as arms. We characterize the fundamental limits on the performance of any policy. In addition, via analysis and simulations, we characterize the performance of variants of the UCB and Thompson Sampling policies that exploit correlation.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
09/27/2020

Decentralized Age-of-Information Bandits

Age-of-Information (AoI) is a performance metric for scheduling systems ...
research
12/16/2020

Aging Bandits: Regret Analysis and Order-Optimal Learning Algorithm for Wireless Networks with Stochastic Arrivals

We consider a single-hop wireless network with sources transmitting time...
research
10/06/2019

Optimizing Data Freshness in Time-Varying Wireless Networks with Imperfect Channel State

We consider a scenario where a base station (BS) attempts to collect fre...
research
12/06/2021

AoI-Constrained Bandit: Information Gathering over Unreliable Channels with Age Guarantees

Age-of-Information (AoI) is an application layer metric that has been wi...
research
11/15/2018

Minimizing the Age of Information from Sensors with Correlated Observations

The Age of Information (AoI) metric has recently received much attention...
research
11/02/2020

Freshness on Demand: Optimizing Age of Information for the Query Process

Age of Information (AoI) has become an important concept in communicatio...
research
08/19/2023

Learning and Communications Co-Design for Remote Inference Systems: Feature Length Selection and Transmission Scheduling

In this paper, we consider a remote inference system, where a neural net...

Please sign up or login with your details

Forgot password? Click here to reset