Consideration for effectively handling parallel workloads on public cloud system

08/14/2020
by   Kazuichi Oe, et al.
0

We retrieved and analyzed parallel storage workloads of the FUJITSU K5 cloud service to clarify how to build cost-effective hybrid storage systems. A hybrid storage system consists of fast but low-capacity tier (first tier) and slow but high-capacity tier (second tier). And, it typically consists of either SSDs and HDDs or NVMs and SSDs. As a result, we found that 1) regions for first tier should be assigned only if a workload includes large number of IO accesses for a whole day, 2) the regions that include a large number of IO accesses should be dynamically chosen and moved from second tier to first tier for a short interval, and 3) if a cache hit ratio is regularly low, use of the cache for the workload should be cancelled, and the whole workload region should be assigned to the region for first tier. These workloads already have been released from the SNIA web site.

READ FULL TEXT

page 1

page 2

page 3

page 4

page 5

page 6

research
05/03/2018

ReCA: an Efficient Reconfigurable Cache Architecture for Storage Systems with Online Workload Characterization

In recent years, SSDs have gained tremendous attention in computing and ...
research
12/16/2017

StackInsights: Cognitive Learning for Hybrid Cloud Readiness

Hybrid cloud is an integrated cloud computing environment utilizing a mi...
research
10/26/2021

Endure: A Robust Tuning Paradigm for LSM Trees Under Workload Uncertainty

Log-Structured Merge trees (LSM trees) are increasingly used as the stor...
research
12/15/2017

A Workload-Specific Memory Capacity Configuration Approach for In-Memory Data Analytic Platforms

We propose WSMC, a workload-specific memory capacity configuration appro...
research
12/27/2019

URSA: Precise Capacity Planning and Contention-aware Scheduling for Public Clouds

Database platform-as-a-service (dbPaaS) is developing rapidly and a larg...
research
11/27/2020

Introducing the Task-Aware Storage I/O (TASIO) Library

Task-based programming models are excellent tools to parallelize and sea...
research
06/10/2023

Quantifying the Benefits of Carbon-Aware Temporal and Spatial Workload Shifting in the Cloud

To mitigate climate change, there has been a recent focus on reducing co...

Please sign up or login with your details

Forgot password? Click here to reset