No Free Lunch: Balancing Learning and Exploitation at the Network Edge

11/23/2021
by   Federico Mason, et al.
0

Over the last few years, the DRL paradigm has been widely adopted for 5G and beyond network optimization because of its extreme adaptability to many different scenarios. However, collecting and processing learning data entail a significant cost in terms of communication and computational resources, which is often disregarded in the networking literature. In this work, we analyze the cost of learning in a resource-constrained system, defining an optimization problem in which training a DRL agent makes it possible to improve the resource allocation strategy but also reduces the number of available resources. Our simulation results show that the cost of learning can be critical when evaluating DRL schemes on the network edge and that assuming a cost-free learning model can lead to significantly overestimating performance.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
02/03/2022

Incorporating Distributed DRL into Storage Resource Optimization of Space-Air-Ground Integrated Wireless Communication Network

Space-air-ground integrated network (SAGIN) is a new type of wireless ne...
research
06/06/2023

Fast Context Adaptation in Cost-Aware Continual Learning

In the past few years, DRL has become a valuable solution to automatical...
research
02/03/2022

Network Resource Allocation Strategy Based on Deep Reinforcement Learning

The traditional Internet has encountered a bottleneck in allocating netw...
research
11/30/2022

The Cost of Learning: Efficiency vs. Efficacy of Learning-Based RRM for 6G

In the past few years, Deep Reinforcement Learning (DRL) has become a va...
research
07/19/2023

Joint Service Caching, Communication and Computing Resource Allocation in Collaborative MEC Systems: A DRL-based Two-timescale Approach

Meeting the strict Quality of Service (QoS) requirements of terminals ha...
research
08/18/2023

Adaptive Timers and Buffer Optimization for Layer-2 Protocols in 5G Non-Terrestrial Networks

Interest in the integration of Terrestrial Networks (TN) and Non-Terrest...

Please sign up or login with your details

Forgot password? Click here to reset