LQoCo: Learning to Optimize Cache Capacity Overloading in Storage Systems

03/21/2022
by   Ji Zhang, et al.
0

Cache plays an important role to maintain high and stable performance (i.e. high throughput, low tail latency and throughput jitter) in storage systems. Existing rule-based cache management methods, coupled with engineers' manual configurations, cannot meet ever-growing requirements of both time-varying workloads and complex storage systems, leading to frequent cache overloading. In this paper, we for the first time propose a light-weight learning-based cache bandwidth control technique, called which can adaptively control the cache bandwidth so as to effectively prevent cache overloading in storage systems. Extensive experiments with various workloads on real systems show that LQoCo, with its strong adaptability and fast learning ability, can adapt to various workloads to effectively control cache bandwidth, thereby significantly improving the storage performance (e.g. increasing the throughput by 10%-20% and reducing the throughput jitter and tail latency by 2X-6X and 1.5X-4X, respectively, compared with two representative rule-based methods).

READ FULL TEXT
research
02/06/2023

PASCAL: A Learning-aided Cooperative Bandwidth Control Policy for Hierarchical Storage Systems

Nowadays, the Hierarchical Storage System (HSS) is considered as an idea...
research
11/11/2022

Lamda: The Last Mile of the Datacenter Network Does matter

In this paper, we conduct systematic measurement studies to show that th...
research
11/05/2021

RC-RNN: Reconfigurable Cache Architecture for Storage Systems Using Recurrent Neural Networks

Solid-State Drives (SSDs) have significant performance advantages over t...
research
01/24/2021

A Survey of Novel Cache Hierarchy Designs for High Workloads

Traditional on-die, three-level cache hierarchy design is very commonly ...
research
11/22/2021

KML: Using Machine Learning to Improve Storage Systems

Operating systems include many heuristic algorithms designed to improve ...
research
07/19/2021

Limited Associativity Makes Concurrent Software Caches a Breeze

Software caches optimize the performance of diverse storage systems, dat...
research
05/21/2017

MITHRIL: Mining Sporadic Associations for Cache Prefetching

The growing pressure on cloud application scalability has accentuated st...

Please sign up or login with your details

Forgot password? Click here to reset