LSI: A Learned Secondary Index Structure

05/11/2022
by   Andreas Kipf, et al.
0

Learned index structures have been shown to achieve favorable lookup performance and space consumption compared to their traditional counterparts such as B-trees. However, most learned index studies have focused on the primary indexing setting, where the base data is sorted. In this work, we investigate whether learned indexes sustain their advantage in the secondary indexing setting. We introduce Learned Secondary Index (LSI), a first attempt to use learned indexes for indexing unsorted data. LSI works by building a learned index over a permutation vector, which allows binary search to performed on the unsorted base data using random access. We additionally augment LSI with a fingerprint vector to accelerate equality lookups. We show that LSI achieves comparable lookup performance to state-of-the-art secondary indexes while being up to 6x more space efficient.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/29/2021

Bounding the Last Mile: Efficient Learned String Indexing

We introduce the RadixStringSpline (RSS) learned index structure for eff...
research
09/16/2019

Learning Index Selection with Structured Action Spaces

Configuration spaces for computer systems can be challenging for traditi...
research
03/27/2019

Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations (Extended Version)

Database administrators construct secondary indexes on data tables to ac...
research
03/27/2019

Designing Succinct Secondary Indexing Mechanism by Exploiting Column Correlations

Database administrators construct secondary indexes on data tables to ac...
research
06/05/2023

A Simple Yet High-Performing On-disk Learned Index: Can We Have Our Cake and Eat it Too?

While in-memory learned indexes have shown promising performance as comp...
research
11/16/2018

The Potential of Learned Index Structures for Index Compression

Inverted indexes are vital in providing fast key-word-based search. For ...
research
09/22/2020

There is No Such Thing as an "Index"! or: The next 500 Indexing Papers

Index structures are a building block of query processing and computer s...

Please sign up or login with your details

Forgot password? Click here to reset