Learning Aided Optimization for Energy Harvesting Devices with Outdated State Information

01/10/2018
by   Hao Yu, et al.
0

This paper considers utility optimal power control for energy harvesting wireless devices with a finite capacity battery. The distribution information of the underlying wireless environment and harvestable energy is unknown and only outdated system state information is known at the device controller. This scenario shares similarity with Lyapunov opportunistic optimization and online learning but is different from both. By a novel combination of Zinkevich's online gradient learning technique and the drift-plus-penalty technique from Lyapunov opportunistic optimization, this paper proposes a learning-aided algorithm that achieves utility within O(ϵ) of the optimal, for any desired ϵ>0, by using a battery with an O(1/ϵ) capacity. The proposed algorithm has low complexity and makes power investment decisions based on system history, without requiring knowledge of the system state or its probability distribution.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/18/2022

tinyMAN: Lightweight Energy Manager using Reinforcement Learning for Energy Harvesting Wearable IoT Devices

Advances in low-power electronics and machine learning techniques lead t...
research
06/06/2018

Optimization vs. Reinforcement Learning for Wirelessly Powered Sensor Networks

We consider a sensing application where the sensor nodes are wirelessly ...
research
02/13/2018

Achieving the Age-Energy Tradeoff with a Finite-Battery Energy Harvesting Source

We study the problem of minimizing the time-average expected Age of Info...
research
09/17/2019

On the Optimality of the Greedy Policy for Battery Limited Energy Harvesting Communications

Consider a battery limited energy harvesting communication system with o...
research
02/26/2021

ECO: Enabling Energy-Neutral IoT Devices through Runtime Allocation of Harvested Energy

Energy harvesting offers an attractive and promising mechanism to power ...
research
07/18/2020

Fast Learning for Renewal Optimization in Online Task Scheduling

This paper considers online optimization of a renewal-reward system. A c...
research
12/24/2021

DeepGANTT: A Scalable Deep Learning Scheduler for Backscatter Networks

Recent backscatter communication techniques enable ultra low power wirel...

Please sign up or login with your details

Forgot password? Click here to reset