Automatic Clustering in Hyrise

by   Alexander Löser, et al.

Physical data layout is an important performance factor for modern databases. Clustering, i.e., storing similar values in proximity, can lead to performance gains in several ways. We present an automated model to determine beneficial clustering columns and a clustering algorithm for the column-oriented, memory-resident database Hyrise. To automatically select clustering columns, the model analyzes the database's workload and provides estimates by how much certain clustering columns would impact the workload's latency. We evaluate the precision of the model's estimates, as well as the overall quality of its clustering suggestions. To apply a determined clustering configuration, we developed an online clustering algorithm. The clustering algorithm supports an arbitrary number of clustering dimensions. We show that the algorithm is robust against concurrently running data modifying queries. We obtain a 5 reduction for the TPC-H benchmark when clustering the lineitem table and a 4 latency reduction for the TPC-DS benchmark when clustering the store_sales table.



There are no comments yet.


page 11

page 14

page 27

page 28

page 29

page 30

page 36

page 41


Short Communication on QUIST: A Quick Clustering Algorithm

In this short communication we introduce the quick clustering algorithm ...

Hybrid Ant Swarm-Based Data Clustering

Biologically inspired computing techniques are very effective and useful...

Column2Vec: Structural Understanding via Distributed Representations of Database Schemas

We present Column2Vec, a distributed representation of database columns ...

Biclustering with Alternating K-Means

Biclustering is the task of simultaneously clustering the rows and colum...

Farthest sampling segmentation of triangulated surfaces

In this paper we introduce Farthest Sampling Segmentation (FSS), a new m...

An Enhanced Adaptive Bi-clustering Algorithm through Building a Shielding Complex Sub-Matrix

Bi-clustering refers to the task of finding sub-matrices (indexed by a g...

EasiCS: the objective and fine-grained classification method of cervical spondylosis dysfunction

The precise diagnosis is of great significance in developing precise tre...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.