Learning How To Learn Within An LSM-based Key-Value Store

05/28/2020
by   Yifan Dai, et al.
0

We introduce BOURBON, a log-structured merge (LSM) tree that utilizes machine learning to provide fast lookups. We base the design and implementation of BOURBON on empirically grounded principles that we derive through careful analysis of LSM design. BOURBON employs greedy piecewise linear regression to learn key distributions, enabling fast lookup with minimal computation, and applies a cost-benefit strategy to decide when learning will be worthwhile. Through a series of experiments on both synthetic and real-world datasets, we show that BOURBON improves lookup performance by 1.23x-1.78x as compared to state-of-the-art production LSMs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
08/05/2020

PrismDB: Read-aware Log-structured Merge Trees for Heterogeneous Storage

In recent years, emerging hardware storage technologies have focused on ...
research
05/08/2023

Autumn: A Scalable Read Optimized LSM-tree based Key-Value Stores with Fast Point and Range Read Speed

The Log Structured Merge Trees (LSM-tree) based key-value stores are wid...
research
07/06/2022

Careful seeding for the k-medoids algorithm with incremental k++ cluster construction

The k-medoids algorithm is a popular variant of the k-means algorithm an...
research
03/10/2021

Piecewise linear regression and classification

This paper proposes a method for solving multivariate regression and cla...
research
07/15/2016

Learning from Conditional Distributions via Dual Embeddings

Many machine learning tasks, such as learning with invariance and policy...
research
05/18/2023

Engineering an algorithm for constructing low-stretch geometric graphs with near-greedy average-degrees

We design and engineer Fast-Sparse-Spanner, a simple and practical (fast...
research
02/06/2023

A Scalable and Efficient Iterative Method for Copying Machine Learning Classifiers

Differential replication through copying refers to the process of replic...

Please sign up or login with your details

Forgot password? Click here to reset