PASCAL: A Learning-aided Cooperative Bandwidth Control Policy for Hierarchical Storage Systems

02/06/2023
by   Xijun Li, et al.
0

Nowadays, the Hierarchical Storage System (HSS) is considered as an ideal model to meet the cost-performance demand. The data migration between storing tiers of HSS is the way to achieve the cost-performance goal. The bandwidth control is to limit the maximum amount of data migration. Most of previous research about HSS focus on studying the data migration policy instead of bandwidth control. However, the recent research about cache and networking optimization suggest that the bandwidth control has significant impact on the system performance. Few previous work achieves a satisfactory bandwidth control in HSS since it is hard to control bandwidth for so many data migration tasks simultaneously. In this paper, we first give a stochastic programming model to formalize the bandwidth control problem in HSS. Then we propose a learning-aided bandwidth control policy for HSS, named , which learns to control the bandwidth of different data migration task in an cooperative way. We implement on a commercial HSS and compare it with three strong baselines over a group of workloads. Our evaluation on the physical system shows that can effectively decrease 1.95X the tail latency and greatly improve throughput stability (2X ↓ throughput jitter), and meanwhile keep the throughput at a relatively high level.

READ FULL TEXT
research
03/21/2022

LQoCo: Learning to Optimize Cache Capacity Overloading in Storage Systems

Cache plays an important role to maintain high and stable performance (i...
research
11/11/2022

Lamda: The Last Mile of the Datacenter Network Does matter

In this paper, we conduct systematic measurement studies to show that th...
research
11/23/2017

EASM: Efficiency-Aware Switch Migration for Balancing Controller Loads in Software-Defined Networking

Distributed multi-controller deployment is a promising method to achieve...
research
06/18/2019

Evaluation Pattern on Refugee Crisis

For nowadays severe refugee issue, we primarily set up an evaluation pat...
research
03/07/2022

To Migrate or not to Migrate: An Analysis of Operator Migration in Distributed Stream Processing

One of the most important issues in data stream processing systems is to...
research
05/05/2018

AutoTiering: Automatic Data Placement Manager in Multi-Tier All-Flash Datacenter

In the year of 2017, the capital expenditure of Flash-based Solid State ...
research
09/10/2023

Learning-based Incentive Mechanism for Task Freshness-aware Vehicular Twin Migration

Vehicular metaverses are an emerging paradigm that integrates extended r...

Please sign up or login with your details

Forgot password? Click here to reset