Automatic Clustering in Hyrise

03/29/2021
by   Alexander Löser, et al.
0

Physical data layout is an important performance factor for modern databases. Clustering, i.e., storing similar values in proximity, can lead to performance gains in several ways. We present an automated model to determine beneficial clustering columns and a clustering algorithm for the column-oriented, memory-resident database Hyrise. To automatically select clustering columns, the model analyzes the database's workload and provides estimates by how much certain clustering columns would impact the workload's latency. We evaluate the precision of the model's estimates, as well as the overall quality of its clustering suggestions. To apply a determined clustering configuration, we developed an online clustering algorithm. The clustering algorithm supports an arbitrary number of clustering dimensions. We show that the algorithm is robust against concurrently running data modifying queries. We obtain a 5 reduction for the TPC-H benchmark when clustering the lineitem table and a 4 latency reduction for the TPC-DS benchmark when clustering the store_sales table.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 11

page 14

page 27

page 28

page 29

page 30

page 36

page 41

06/01/2016

Short Communication on QUIST: A Quick Clustering Algorithm

In this short communication we introduce the quick clustering algorithm ...
07/11/2021

Hybrid Ant Swarm-Based Data Clustering

Biologically inspired computing techniques are very effective and useful...
03/20/2019

Column2Vec: Structural Understanding via Distributed Representations of Database Schemas

We present Column2Vec, a distributed representation of database columns ...
09/09/2020

Biclustering with Alternating K-Means

Biclustering is the task of simultaneously clustering the rows and colum...
12/01/2020

Farthest sampling segmentation of triangulated surfaces

In this paper we introduce Farthest Sampling Segmentation (FSS), a new m...
11/12/2021

An Enhanced Adaptive Bi-clustering Algorithm through Building a Shielding Complex Sub-Matrix

Bi-clustering refers to the task of finding sub-matrices (indexed by a g...
05/15/2019

EasiCS: the objective and fine-grained classification method of cervical spondylosis dysfunction

The precise diagnosis is of great significance in developing precise tre...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.