DRAG: Deep Reinforcement Learning Based Base Station Activation in Heterogeneous Networks

09/06/2018
by   Junhong Ye, et al.
0

Heterogeneous Network (HetNet), where Small cell Base Stations (SBSs) are densely deployed to offload traffic from macro Base Stations (BSs), is identified as a key solution to meet the unprecedented mobile traffic demand. The high density of SBSs are designed for peak traffic hours and consume an unnecessarily large amount of energy during off-peak time. In this paper, we propose a deep reinforcement-learning based SBS activation strategy that activates the optimal subset of SBSs to significantly lower the energy consumption without compromising the quality of service. In particular, we formulate the SBS on/off switching problem into a Markov Decision Process that can be solved by Actor Critic (AC) reinforcement learning methods. To avoid prohibitively high computational and storage costs of conventional tabular-based approaches, we propose to use deep neural networks to approximate the policy and value functions in the AC approach. Moreover, to expedite the training process, we adopt a Deep Deterministic Policy Gradient (DDPG) approach together with a novel action refinement scheme. Through extensive numerical simulations, we show that the proposed scheme greatly outperforms the existing methods in terms of both energy efficiency and computational efficiency. We also show that the proposed scheme can scale to large system with polynomial complexities in both storage and computation.

READ FULL TEXT
research
01/21/2021

Deep Reinforcement Learning with Spatio-temporal Traffic Forecasting for Data-Driven Base Station Sleep Control

To meet the ever increasing mobile traffic demand in 5G era, base statio...
research
11/28/2012

TACT: A Transfer Actor-Critic Learning Framework for Energy Saving in Cellular Radio Access Networks

Recent works have validated the possibility of improving energy efficien...
research
10/12/2021

Quality-Aware Deep Reinforcement Learning for Streaming in Infrastructure-Assisted Connected Vehicles

This paper proposes a deep reinforcement learning-based video streaming ...
research
06/08/2021

A Deep Value-network Based Approach for Multi-Driver Order Dispatching

Recent works on ride-sharing order dispatching have highlighted the impo...
research
09/24/2021

Distributed Deep Reinforcement Learning for Adaptive Medium Access and Modulation in Shared Spectrum

Spectrum scarcity has led to growth in the use of unlicensed spectrum fo...
research
12/25/2021

Energy-Efficient Ultra-Dense Network with Deep Reinforcement Learning

With the explosive growth in mobile data traffic, ultra-dense network (U...
research
02/21/2019

Learning Deterministic Policy with Target for Power Control in Wireless Networks

Inter-Cell Interference Coordination (ICIC) is a promising way to improv...

Please sign up or login with your details

Forgot password? Click here to reset