Energy Efficient Edge Computing: When Lyapunov Meets Distributed Reinforcement Learning

by   Mohamed Sana, et al.

In this work, we study the problem of energy-efficient computation offloading enabled by edge computing. In the considered scenario, multiple users simultaneously compete for limited radio and edge computing resources to get offloaded tasks processed under a delay constraint, with the possibility of exploiting low power sleep modes at all network nodes. The radio resource allocation takes into account inter- and intra-cell interference, and the duty cycles of the radio and computing equipment have to be jointly optimized to minimize the overall energy consumption. To address this issue, we formulate the underlying problem as a dynamic long-term optimization. Then, based on Lyapunov stochastic optimization tools, we decouple the formulated problem into a CPU scheduling problem and a radio resource allocation problem to be solved in a per-slot basis. Whereas the first one can be optimally and efficiently solved using a fast iterative algorithm, the second one is solved using distributed multi-agent reinforcement learning due to its non-convexity and NP-hardness. The resulting framework achieves up to 96.5 optimal strategy based on exhaustive search, while drastically reducing complexity. The proposed solution also allows to increase the network's energy efficiency compared to a benchmark heuristic approach.



page 1


Multi-agent Reinforcement Learning for Resource Allocation in IoT networks with Edge Computing

To support popular Internet of Things (IoT) applications such as virtual...

Offloading Energy Efficiency with Delay Constraint for Cooperative Mobile Edge Computing Networks

We propose a novel edge computing network architecture that enables edge...

Energy-Efficient Task Offloading and Resource Allocation for Multiple Access Mobile Edge Computing

In this paper, the problem of joint radio and computation resource manag...

Task Offloading Optimization in NOMA-Enabled Multi-hop Mobile Edge Computing System Using Conflict Graph

Resource allocation is investigated for offloading computational-intensi...

Energy Efficient Resource Allocation Optimization in Fog Radio Access Networks with Outdated Channel Knowledge

Fog Radio Access Networks (F-RAN) are gaining worldwide interests for en...

Reconfigurable Intelligent Surface Aided Mobile Edge Computing over Intermittent mmWave Links

The advent of Reconfigurable Intelligent Surfaces (RISs) in wireless com...

Leveraging User-Diversity in Energy-Efficient Edge-Facilitated Wireless Collaborative-Computing

In this work, a heterogeneous set of wireless devices sharing a common a...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.