Learning to Minimize Age of Information over an Unreliable Channel with Energy Harvesting

06/30/2021
by   Elif Tuğçe Ceran, et al.
9

The time average expected age of information (AoI) is studied for status updates sent over an error-prone channel from an energy-harvesting transmitter with a finite-capacity battery. Energy cost of sensing new status updates is taken into account as well as the transmission energy cost better capturing practical systems. The optimal scheduling policy is first studied under the hybrid automatic repeat request (HARQ) protocol when the channel and energy harvesting statistics are known, and the existence of a threshold-based optimal policy is shown. For the case of unknown environments, average-cost reinforcement-learning algorithms are proposed that learn the system parameters and the status update policy in real-time. The effectiveness of the proposed methods is demonstrated through numerical results.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

01/24/2019

Reinforcement Learning to Minimize Age of Information with an Energy Harvesting Sensor with HARQ and Sensing Cost

The time average expected age of information (AoI) is studied for status...
02/13/2018

Achieving the Age-Energy Tradeoff with a Finite-Battery Energy Harvesting Source

We study the problem of minimizing the time-average expected Age of Info...
04/27/2020

Age-Aware Status Update Control for Energy Harvesting IoT Sensors via Reinforcement Learning

We consider an IoT sensing network with multiple users, multiple energy ...
02/19/2021

A Reinforcement Learning Approach to Age of Information in Multi-User Networks with HARQ

Scheduling the transmission of time-sensitive information from a source ...
06/01/2018

A Reinforcement Learning Approach to Age of Information in Multi-User Networks

Scheduling the transmission of time-sensitive data to multiple users ove...
02/12/2019

Communication over a time correlated channel with an energy harvesting transmitter

In this work, communication over a time-correlated point-to-point wirele...
07/17/2018

Information and Energy Transfer with Experimentally-Sampled Harvesting Functions

This paper considers the problem of simultaneous information and energy ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.