Compressed Key Sort and Fast Index Reconstruction

09/24/2020
by   Yongsik Kwon, et al.
0

In this paper we propose an index key compression scheme based on the notion of distinction bits by proving that the distinction bits of index keys are sufficient information to determine the sorted order of the index keys correctly. While the actual compression ratio may vary depending on the characteristics of datasets (an average of 2.76 to one compression ratio was observed in our experiments), the index key compression scheme leads to significant performance improvements during the reconstruction of large-scale indexes. Our index key compression can be effectively used in database replication and index recovery of modern main-memory database systems.

READ FULL TEXT
POST COMMENT

Comments

There are no comments yet.

Authors

page 1

page 2

page 3

page 4

08/28/2019

Techniques for Inverted Index Compression

The data structure at the core of large-scale search engines is the inve...
12/08/2021

FastSGD: A Fast Compressed SGD Framework for Distributed Machine Learning

With the rapid increase of big data, distributed Machine Learning (ML) h...
05/11/2017

ROCKER: A Refinement Operator for Key Discovery

The Linked Data principles provide a decentral approach for publishing s...
09/16/2021

SEACOW: Synopsis Embedded Array Compression using Wavelet Transform

Recently, multidimensional data is produced in various domains; because ...
10/07/2019

ER-index: a referential index for encrypted genomic databases

Huge DBMSs storing genomic information are being created and engineerize...
06/12/2020

Indexing Data on the Web: A Comparison of Schema-level Indices for Data Search – Extended Technical Report

Indexing the Web of Data offers many opportunities, in particular, to fi...
03/05/2020

Order-Preserving Key Compression for In-Memory Search Trees

We present the High-speed Order-Preserving Encoder (HOPE) for in-memory ...
This week in AI

Get the week's most popular data science and artificial intelligence research sent straight to your inbox every Saturday.