Computation Offloading and Resource Allocation in F-RANs: A Federated Deep Reinforcement Learning Approach

06/13/2022
by   Lingling Zhang, et al.
2

The fog radio access network (F-RAN) is a promising technology in which the user mobile devices (MDs) can offload computation tasks to the nearby fog access points (F-APs). Due to the limited resource of F-APs, it is important to design an efficient task offloading scheme. In this paper, by considering time-varying network environment, a dynamic computation offloading and resource allocation problem in F-RANs is formulated to minimize the task execution delay and energy consumption of MDs. To solve the problem, a federated deep reinforcement learning (DRL) based algorithm is proposed, where the deep deterministic policy gradient (DDPG) algorithm performs computation offloading and resource allocation in each F-AP. Federated learning is exploited to train the DDPG agents in order to decrease the computing complexity of training process and protect the user privacy. Simulation results show that the proposed federated DDPG algorithm can achieve lower task execution delay and energy consumption of MDs more quickly compared with the other existing strategies.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
11/17/2020

Edge Intelligence for Energy-efficient Computation Offloading and Resource Allocation in 5G Beyond

5G beyond is an end-edge-cloud orchestrated network that can exploit het...
research
04/02/2021

Federated Double Deep Q-learning for Joint Delay and Energy Minimization in IoT networks

In this paper, we propose a federated deep reinforcement learning framew...
research
08/02/2022

Federated Deep Reinforcement Learning for Resource Allocation in O-RAN Slicing

Recently, open radio access network (O-RAN) has become a promising techn...
research
05/20/2022

On Jointly Optimizing Partial Offloading and SFC Mapping: A Cooperative Dual-agent Deep Reinforcement Learning Approach

Multi-access edge computing (MEC) and network function virtualization (N...
research
11/17/2020

Deep Reinforcement Learning for Stochastic Computation Offloading in Digital Twin Networks

The rapid development of Industrial Internet of Things (IIoT) requires i...
research
11/09/2021

Reinforcement Learning for Security-Aware Computation Offloading in Satellite Networks

The rise of NewSpace provides a platform for small and medium businesses...

Please sign up or login with your details

Forgot password? Click here to reset