Multi-Agent Meta-Reinforcement Learning for Self-Powered and Sustainable Edge Computing Systems

02/20/2020
by   Md. Shirajum Munir, et al.
20

The stringent requirements of mobile edge computing (MEC) applications and functions fathom the high capacity and dense deployment of MEC hosts to the upcoming wireless networks. However, operating such high capacity MEC hosts can significantly increase energy consumption. Thus, a BS unit can act as a self-powered BS. In this paper, an effective energy dispatch mechanism for self-powered wireless networks with edge computing capabilities is studied. First, a two-stage linear stochastic programming problem is formulated with the goal of minimizing the total energy consumption cost of the system while fulfilling the energy demand. Second, a semi-distributed data-driven solution is proposed by developing a novel multi-agent meta-reinforcement learning (MAMRL) framework to solve the formulated problem. In particular, each BS plays the role of a local agent that explores a Markovian behavior for both energy consumption and generation while each BS transfers time-varying features to a meta-agent. Sequentially, the meta-agent optimizes (i.e., exploits) the energy dispatch decision by accepting only the observations from each local agent with its own state information. Meanwhile, each BS agent estimates its own energy dispatch policy by applying the learned parameters from meta-agent. Finally, the proposed MAMRL framework is benchmarked by analyzing deterministic, asymmetric, and stochastic environments in terms of non-renewable energy usages, energy cost, and accuracy. Experimental results show that the proposed MAMRL model can reduce up to 11 energy cost (with 95.8 methods.

READ FULL TEXT

page 1

page 12

page 13

page 17

research
04/05/2020

Multi-agent Reinforcement Learning for Resource Allocation in IoT networks with Edge Computing

To support popular Internet of Things (IoT) applications such as virtual...
research
07/06/2018

Energy and Latency Control for Edge Computing in Dense V2X Networks

This study focuses on edge computing in dense millimeter wave vehicle-to...
research
07/17/2019

Optimal Energy Allocation and Task Offloading Policy for Wireless Powered Mobile Edge Computing Systems

This paper studies a wireless powered mobile edge computing (MEC) system...
research
08/07/2020

Distributed Deep Reinforcement Learning for Functional Split Control in Energy Harvesting Virtualized Small Cells

To meet the growing quest for enhanced network capacity, mobile network ...
research
07/24/2017

Stochastic Coalitional Games for Cooperative Random Access in M2M Communications

In this paper, the problem of random access contention between machine t...
research
12/22/2022

Energy-Efficient Baseband Function Deployments for Service-Oriented Open RAN

Recently open radio access network (Open RAN), which splits baseband fun...
research
05/31/2021

Energy-Efficient and Federated Meta-Learning via Projected Stochastic Gradient Ascent

In this paper, we propose an energy-efficient federated meta-learning fr...

Please sign up or login with your details

Forgot password? Click here to reset