Reinforced Workload Distribution Fairness

10/29/2021
by   Zhiyuan Yao, et al.
0

Network load balancers are central components in data centers, that distributes workloads across multiple servers and thereby contribute to offering scalable services. However, when load balancers operate in dynamic environments with limited monitoring of application server loads, they rely on heuristic algorithms that require manual configurations for fairness and performance. To alleviate that, this paper proposes a distributed asynchronous reinforcement learning mechanism to-with no active load balancer state monitoring and limited network observations-improve the fairness of the workload distribution achieved by a load balancer. The performance of proposed mechanism is evaluated and compared with stateof-the-art load balancing algorithms in a simulator, under configurations with progressively increasing complexities. Preliminary results show promise in RLbased load balancing algorithms, and identify additional challenges and future research directions, including reward function design and model scalability.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
06/03/2022

Learning Distributed and Fair Policies for Network Load Balancing as Markov Potential Game

This paper investigates the network load balancing problem in data cente...
research
04/16/2019

Dynamic load balancing algorithm of distributed systems

The dynamic load balancing algorithm based on the monitoring server load...
research
10/18/2019

DLB: Deep Learning Based Load Balancing

Load balancing mechanisms have been widely adopted by distributed platfo...
research
09/11/2019

Addressing Algorithmic Bottlenecks in Elastic Machine Learning with Chicle

Distributed machine learning training is one of the most common and impo...
research
02/25/2020

Measuring Basic Load-Balancing and Fail-Over Setups for Email Delivery via DNS MX Records

The domain name system (DNS) has long provided means to assure basic loa...
research
11/30/2018

Dynamic Load Balancing Techniques for Particulate Flow Simulations

Parallel multiphysics simulations often suffer from load imbalances orig...
research
01/23/2023

Privacy-Aware Load Balancing in Fog Networks: A Reinforcement Learning Approach

In this paper, we propose a load balancing algorithm based on Reinforcem...

Please sign up or login with your details

Forgot password? Click here to reset