IWEK: An Interpretable What-If Estimator for Database Knobs

07/30/2023
by   Yu Yan, et al.
0

The knobs of modern database management systems have significant impact on the performance of the systems. With the development of cloud databases, an estimation service for knobs is urgently needed to improve the performance of database. Unfortunately, few attentions have been paid to estimate the performance of certain knob configurations. To fill this gap, we propose IWEK, an interpretable transferable what-if estimator for database knobs. To achieve interpretable estimation, we propose linear estimator based on the random forest for database knobs for the explicit and trustable evaluation results. Due to its interpretability, our estimator capture the direct relationships between knob configuration and its performance, to guarantee the high availability of database. We design a two-stage transfer algorithm to leverage historical experiences to efficiently build the knob estimator for new scenarios. Due to its lightweight design, our method can largely reduce the overhead of collecting training data and could achieve cold start knob estimation for new scenarios. Extensive experiments on YCSB and TPCC show that our method performs well in interpretable and transferable knob estimation with limited training data. Further, our method could achieve efficient estimator transfer with only 10 samples in TPCC and YSCB.

READ FULL TEXT

page 9

page 10

research
12/23/2022

NoSQL Database Tuning through Machine Learning

NoSQL databases have become an important component of many big data and ...
research
06/29/2022

AAE: An Active Auto-Estimator for Improving Graph Storage

Nowadays, graph becomes an increasingly popular model in many real appli...
research
02/06/2022

Learning to be a Statistician: Learned Estimator for Number of Distinct Values

Estimating the number of distinct values (NDV) in a column is useful for...
research
03/20/2023

Less is More: Towards Lightweight Cost Estimator for Database Systems

We present FasCo, a simple yet effective learning-based estimator for th...
research
11/21/2021

Experience-Enhanced Learning: One Size Still does not Fit All in Automatic Database

Recent years, the database committee has attempted to develop automatic ...
research
11/19/2019

On Performance Estimation in Automatic Algorithm Configuration

Over the last decade, research on automated parameter tuning, often refe...
research
08/28/2018

Full Speed Ahead: 3D Spatial Database Acceleration with GPUs

Many industries rely on visual insights to support decision- making proc...

Please sign up or login with your details

Forgot password? Click here to reset