DeepAI AI Chat
Log In Sign Up

Age-Aware Status Update Control for Energy Harvesting IoT Sensors via Reinforcement Learning

by   Mohammad Hatami, et al.

We consider an IoT sensing network with multiple users, multiple energy harvesting sensors, and a wireless edge node acting as a gateway between the users and sensors. The users request for updates about the value of physical processes, each of which is measured by one sensor. The edge node has a cache storage that stores the most recently received measurements from each sensor. Upon receiving a request, the edge node can either command the corresponding sensor to send a status update, or use the data in the cache. We aim to find the best action of the edge node to minimize the average long-term cost which trade-offs between the age of information and energy consumption. We propose a practical reinforcement learning approach that finds an optimal policy without knowing the exact battery levels of the sensors.


page 1

page 2

page 3

page 4


Learning to Minimize Age of Information over an Unreliable Channel with Energy Harvesting

The time average expected age of information (AoI) is studied for status...

Age-Minimal Online Policies for Energy Harvesting Sensors with Random Battery Recharges

We consider an energy harvesting sensor that is sending measurement upda...

Optimal Status Update for Caching Enabled IoT Networks: A Dueling Deep R-Network Approach

In the Internet of Things (IoT) networks, caching is a promising techniq...

Analysis of Energy Consumption in a Precision Beekeeping System

Honey bees have been domesticated by humans for several thousand years a...

Design of Wireless Sensors for IoT with Energy Storage and Communication Channel Heterogeneity

Autonomous Wireless Sensors (AWSs) are at the core of every Wireless Sen...

Age-Energy Trade-off in Status Update System with Wake-up Control

In the status update system, the freshness of information is drawing mor...