Decentralized Task Offloading in Edge Computing: A Multi-User Multi-Armed Bandit Approach

by   Xiong Wang, et al.

Mobile edge computing facilitates users to offload computation tasks to edge servers for meeting their stringent delay requirements. Previous works mainly explore task offloading when system-side information is given (e.g., server processing speed, cellular data rate), or centralized offloading under system uncertainty. But both generally fall short to handle task placement involving many coexisting users in a dynamic and uncertain environment. In this paper, we develop a multi-user offloading framework considering unknown yet stochastic system-side information to enable a decentralized user-initiated service placement. Specifically, we formulate the dynamic task placement as an online multi-user multi-armed bandit process, and propose a decentralized epoch based offloading (DEBO) to optimize user rewards which are subjected under network delay. We show that DEBO can deduce the optimal user-server assignment, thereby achieving a close-to-optimal service performance and tight O(log T) offloading regret. Moreover, we generalize DEBO to various common scenarios such as unknown reward gap, dynamic entering or leaving of clients, and fair reward distribution, while further exploring when users' offloaded tasks require heterogeneous computing resources. Particularly, we accomplish a sub-linear regret for each of these instances. Real measurements based evaluations corroborate the superiority of our offloading schemes over state-of-the-art approaches in optimizing delay-sensitive rewards.


page 3

page 4

page 5

page 6

page 7

page 8

page 10

page 12


Task Replication for Vehicular Edge Computing: A Combinatorial Multi-Armed Bandit based Approach

In vehicular edge computing (VEC) system, some vehicles with surplus com...

CoNet: Borderless and decentralized server cooperation in edge computing

In edge computing (EC), by offloading tasks to edge server or remote clo...

An Online Algorithm for Computation Offloading in Non-Stationary Environments

We consider the latency minimization problem in a task-offloading scenar...

A Multi-User Effective Computation Offloading Mechanism for MEC System: Batched Multi-Armed Bandits Approach

With the development of 5G technology, mobile edge computing (MEC) is be...

Cache Placement Optimization in Mobile Edge Computing Networks with Unaware Environment – An Extended Multi-armed Bandit Approach

Caching high-frequency reuse contents at the edge servers in the mobile ...

Joint D2D Collaboration and Task Offloading for Edge Computing: A Mean Field Graph Approach

Mobile edge computing (MEC) facilitates computation offloading to edge s...

Distributed Task Management in the Heterogeneous Fog: A Socially Concave Bandit Game

Fog computing has emerged as a potential solution to the explosive compu...

Please sign up or login with your details

Forgot password? Click here to reset