Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices

02/06/2023

∙

Efficiently querying data on embedded sensor and IoT devices is challenging given the very limited memory and CPU resources. With the increasing volumes of collected data, it is critical to process, filter, and manipulate data on the edge devices where it is collected to improve efficiency and reduce network transmissions. Existing embedded index structures do not adapt to the data distribution and characteristics. This paper demonstrates how applying learned indexes that develop space efficient summaries of the data can dramatically improve the query performance and predictability. Learned indexes based on linear approximations can reduce the query I/O by 50 to 90 throughput by a factor of 2 to 5, while only requiring a few kilobytes of RAM. Experimental results on a variety of time series data sets demonstrate the advantages of learned indexes that considerably improve over the state-of-the-art index algorithms.

READ FULL TEXT

Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices

A Scalable Learned Index Scheme in Storage Systems

DOMINO: Domain-invariant Hyperdimensional Classification for Multi-Sensor Time Series Data

KV-match: An Efficient Subsequence Matching Approach for Large Scale Time Series

Leveraging Soft Functional Dependencies for Indexing Multi-dimensional Data

Learnability and Robustness of Shallow Neural Networks Learned With a Performance-Driven BP and a Variant PSO For Edge Decision-Making

On Distribution Dependent Sub-Logarithmic Query Time of Learned Indexing

Knowledge Extracted from Recurrent Deep Belief Network for Real Time Deterministic Control

Using Learned Indexes to Improve Time Series Indexing Performance on Embedded Sensor Devices

Related Research

A Scalable Learned Index Scheme in Storage Systems

DOMINO: Domain-invariant Hyperdimensional Classification for Multi-Sensor Time Series Data

KV-match: An Efficient Subsequence Matching Approach for Large Scale Time Series

Leveraging Soft Functional Dependencies for Indexing Multi-dimensional Data

Learnability and Robustness of Shallow Neural Networks Learned With a Performance-Driven BP and a Variant PSO For Edge Decision-Making

On Distribution Dependent Sub-Logarithmic Query Time of Learned Indexing

Knowledge Extracted from Recurrent Deep Belief Network for Real Time Deterministic Control