Online User Scheduling and Resource Allocation for Mobile-Edge Computing Systems

04/30/2019
by   Shanfeng Huang, et al.
0

In this paper, we investigate the multi-user mobile edge computing (MEC) system where the number of users in the system is varying. We formulate the multi-user scheduling problem as an infinite horizon Markov decision process (MDP) problem aiming at minimizing the weighted sum of energy consumption and latency of mobile users. For such a large MDP problem, traditional dynamic programming approaches such as value iteration and policy iteration will suffer from the curse of dimensionality. This motivates us to resort to approximate MDP where the key lies at value function approximation. We propose a novel value function approximation approach where the value function is approximated by running a well-designed heuristic baseline policy. Based on the approximated value function, one-step policy iteration is applied to jointly optimize the offloading decision, user selection and transmission power for the selected user. It is theoretically shown that our proposed algorithm has performance improvement compared with the baseline policy. Also, simulation results demonstrate our proposed scheme significantly outperforms the baseline policy and several other heuristic policies.

READ FULL TEXT
research
04/16/2020

Scheduling for Mobile Edge Computing with Random User Arrivals: An Approximate MDP and Reinforcement Learning Approach

In this paper, we investigate the scheduling design of a mobile edge com...
research
12/23/2019

Cooperative Job Dispatching in Edge Computing Network with Unpredictable Uploading Delay

In this paper, the cooperative jobs dispatching problem in an edge compu...
research
12/26/2020

Online Distributed Job Dispatching with Outdated and Partially-Observable Information

In this paper, we investigate online distributed job dispatching in an e...
research
06/19/2019

Multi-user Resource Control with Deep Reinforcement Learning in IoT Edge Computing

By leveraging the concept of mobile edge computing (MEC), massive amount...
research
04/30/2021

Optimal control policies for resource allocation in the Cloud: comparison between Markov decision process and heuristic approaches

We consider an auto-scaling technique in a cloud system where virtual ma...
research
02/24/2019

Joint Downlink Scheduling for File Placement and Delivery in Cache-Assisted Wireless Networks with Finite File Lifetime

In this paper, downlink transmission scheduling of popular files is opti...

Please sign up or login with your details

Forgot password? Click here to reset