TritanDB: Time-series Rapid Internet of Things Analytics

01/24/2018
by   Eugene Siow, et al.
0

The efficient management of data is an important prerequisite for realising the potential of the Internet of Things (IoT). Two issues given the large volume of structured time-series IoT data are, addressing the difficulties of data integration between heterogeneous Things and improving ingestion and query performance across databases on both resource-constrained Things and in the cloud. In this paper, we examine the structure of public IoT data and discover that the majority exhibit unique flat, wide and numerical characteristics with a mix of evenly and unevenly-spaced time-series. We investigate the advances in time-series databases for telemetry data and combine these findings with microbenchmarks to determine the best compression techniques and storage data structures to inform the design of a novel solution optimised for IoT data. A query translation method with low overhead even on resource-constrained Things allows us to utilise rich data models like the Resource Description Framework (RDF) for interoperability and data integration on top of the optimised storage. Our solution, TritanDB, shows an order of magnitude performance improvement across both Things and cloud hardware on many state-of-the-art databases within IoT scenarios. Finally, we describe how TritanDB supports various analyses of IoT time-series data like forecasting.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/20/2022

SciTS: A Benchmark for Time-Series Databases in Scientific Experiments and Industrial Internet of Things

Time-series data has an increasingly growing usage in Industrial Interne...
research
08/29/2019

Machine Learning and the Internet of Things Enable Steam Flood Optimization for Improved Oil Production

Recently developed machine learning techniques, in association with the ...
research
02/25/2023

TS-Cabinet: Hierarchical Storage for Cloud-Edge-End Time-series Database

Hierarchical data storage is crucial for cloud-edge-end time-series data...
research
01/21/2021

Time series compression: a survey

The presence of smart objects is increasingly widespread and their ecosy...
research
10/03/2017

Time Series Management Systems: A Survey

The collection of time series data increases as more monitoring and auto...
research
01/24/2019

Benchmark Time Series Database with IoTDB-Benchmark for IoT Scenarios

With the wide application of time series databases (TSDB) in big data fi...
research
09/28/2022

Near Lossless Time Series Data Compression Methods using Statistics and Deviation

The last two decades have seen tremendous growth in data collections bec...

Please sign up or login with your details

Forgot password? Click here to reset