A Hybrid Cache Architecture for Meeting Per-Tenant Performance Goals in a Private Cloud

06/04/2019
by   Taejoon Kim, et al.
0

The in-memory cache system is an important component in a cloud for the data access performance. As the tenants may have different performance goals for data access depending on the nature of their tasks, effectively managing the memory cache is a crucial concern in such a shared computing environment. Two extreme methods for managing the memory cache are unlimited sharing and complete isolation, both of which would be inefficient with the expensive storage complexity to meet the per-tenant performance requirement. In this paper, we present a new cache model that incorporates global caching (based on unlimited sharing) and static caching (offering complete isolation) for a private cloud, in which it is critical to offer the guaranteed performance while minimizing the operating cost. This paper also presents a cache insertion algorithm tailored to the proposed cache model. From an extensive set of experiments conducted on the simulation and emulation settings, the results confirm the validity of the presented cache architecture and insertion algorithm showing the optimized use of the cache space for meeting the per-tenant performance requirement.

READ FULL TEXT

page 1

page 2

research
02/02/2019

Learning-based Dynamic Cache Management in a Cloud

Caches are an important component of modern computing systems given thei...
research
06/29/2023

AdaCache: A Disaggregated Cache System with Adaptive Block Size for Cloud Block Storage

NVMe SSD caching has demonstrated impressive capabilities in solving clo...
research
05/18/2019

A caching system with object sharing

We consider a public content caching system that is shared by a number o...
research
06/14/2021

ETICA: Efficient Two-Level I/O Caching Architecture for Virtualized Platforms

In this paper, we propose an Efficient Two-Level I/O Caching Architectur...
research
04/28/2021

FaaT: A Transparent Auto-Scaling Cache for Serverless Applications

Function-as-a-Service (FaaS) has become an increasingly popular way for ...
research
07/13/2022

Caching with Reserves

Caching is a crucial component of many computer systems, so naturally it...
research
06/27/2022

Multilevel Bidirectional Cache Filter

Modern caches are often required to handle a massive amount of data, whi...

Please sign up or login with your details

Forgot password? Click here to reset