DeepAI AI Chat
Log In Sign Up

A Reinforcement Learning Approach to Age of Information in Multi-User Networks

06/01/2018
by   Elif Tuğçe Ceran, et al.
Imperial College London
2

Scheduling the transmission of time-sensitive data to multiple users over error-prone communication channels is studied with the goal of minimizing the long-term average age of information (AoI) at the users under a constraint on the average number of transmissions at the source node. After each transmission, the source receives an instantaneous ACK/NACK feedback from the intended receiver and decides on what time and to which user to transmit the next update. The optimal scheduling policy is first studied under different feedback mechanisms when the channel statistics are known; in particular, the standard automatic repeat request (ARQ) and hybrid ARQ (HARQ) protocols are considered. Then a reinforcement learning (RL) approach is introduced, which does not assume any a priori information on the random processes governing the channel states. Different RL methods are verified and compared through numerical simulations.

READ FULL TEXT

page 1

page 2

page 3

page 4

02/19/2021

A Reinforcement Learning Approach to Age of Information in Multi-User Networks with HARQ

Scheduling the transmission of time-sensitive information from a source ...
06/30/2021

Learning to Minimize Age of Information over an Unreliable Channel with Energy Harvesting

The time average expected age of information (AoI) is studied for status...
12/06/2021

AoI-Constrained Bandit: Information Gathering over Unreliable Channels with Age Guarantees

Age-of-Information (AoI) is an application layer metric that has been wi...
12/17/2020

Minimizing Age of Information via Scheduling over Heterogeneous Channels

In this paper, we investigate how to minimize the age of information whe...
11/17/2022

Learning to Communicate with Intent: An Introduction

We propose a novel framework to learn how to communicate with intent, i....
05/12/2020

Transmission Scheduling for Multi-loop Wireless Networked Control Based on LQ Cost Offset

In this paper, transmission scheduling for multiloop wireless networked ...