Cost- and Energy-Aware Multi-Flow Mobile Data Offloading Using Markov Decision Process

by   Cheng Zhang, et al.

With the rapid increase in demand for mobile data, mobile network operators are trying to expand wireless network capacity by deploying wireless local area network (LAN) hotspots on which they can offload their mobile traffic. However, these network-centric methods usually do not fulfill the interests of mobile users (MUs). Taking into consideration many issues, MUs should be able to decide whether to offload their traffic to a complementary wireless LAN. Our previous work studied single-flow wireless LAN offloading from a MU's perspective by considering delay-tolerance of traffic, monetary cost and energy consumption. In this paper, we study the multi-flow mobile data offloading problem from a MU's perspective in which a MU has multiple applications to download data simultaneously from remote servers, and different applications' data have different deadlines. We formulate the wireless LAN offloading problem as a finite-horizon discrete-time Markov decision process (MDP) and establish an optimal policy by a dynamic programming based algorithm. Since the time complexity of the dynamic programming based offloading algorithm is still high, we propose a low time complexity heuristic offloading algorithm with performance sacrifice. Extensive simulations are conducted to validate our proposed offloading algorithms.


page 1

page 2

page 3

page 4


A Deep Reinforcement Learning Based Approach for Cost- and Energy-Aware Multi-Flow Mobile Data Offloading

With the rapid increase in demand for mobile data, mobile network operat...

Stochastic Control of Computation Offloading to a Helper with a Dynamically Loaded CPU

Due to densification of wireless networks, there exist abundance of idli...

Learning Based Task Offloading in Digital Twin Empowered Internet of Vehicles

Mobile edge computing has become an effective and fundamental paradigm f...

A Dynamic Partial Computation Offloading for the Metaverse in In-Network Computing

The In-Network Computing (COIN) paradigm is a promising solution that le...

WHO-IS: Wireless Hetnet Optimization using Impact Selection

We propose a method to first identify users who have the most negative i...

Joint Mobility Control and MEC Offloading for Hybrid Satellite-Terrestrial-Network-Enabled Robots

Benefiting from the fusion of communication and intelligent technologies...

Differentially Private Deep Q-Learning for Pattern Privacy Preservation in MEC Offloading

Mobile edge computing (MEC) is a promising paradigm to meet the quality ...

Please sign up or login with your details

Forgot password? Click here to reset