Comprehensive and Efficient Workload Compression

11/11/2020
by   Shaleen Deep, et al.
0

This work studies the problem of constructing a representative workload from a given input analytical query workload where the former serves as an approximation with guarantees of the latter. We discuss our work in the context of workload analysis and monitoring. As an example, evolving system usage patterns in a database system can cause load imbalance and performance regressions which can be controlled by monitoring system usage patterns, i.e., a representative workload, over time. To construct such a workload in a principled manner, we formalize the notions of workload representativity and coverage. These metrics capture the intuition that the distribution of features in a compressed workload should match a target distribution, increasing representativity, and include common queries as well as outliers, increasing coverage. We show that solving this problem optimally is NP-hard and present a novel greedy algorithm that provides approximation guarantees. We compare our techniques to established algorithms in this problem space such as sampling and clustering, and demonstrate advantages and key trade-offs of our techniques.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/25/2018

Database-Agnostic Workload Management

We present a system to support generalized SQL workload analysis and man...
research
09/02/2018

Query Log Compression for Workload Analytics

Analyzing database access logs is a key part of performance tuning, intr...
research
11/01/2019

A Framework to Explore Workload-Specific Performance and Lifetime Trade-offs in Neuromorphic Computing

Neuromorphic hardware with non-volatile memory (NVM) can implement machi...
research
12/01/2016

Characterising radio telescope software with the Workload Characterisation Framework

We present a modular framework, the Workload Characterisation Framework ...
research
06/28/2023

The LDBC Financial Benchmark

The Linked Data Benchmark Council's Financial Benchmark (LDBC FinBench) ...
research
01/16/2023

KEWS: A Evaluation Method of Workload Simulation based on KPIs

For end-to-end performance testing, workload simulation is an important ...
research
02/22/2022

Queue input estimation from discrete workload observations

This note considers the problem of statistical inference of the paramete...

Please sign up or login with your details

Forgot password? Click here to reset