Towards application-specific query processing systems

09/21/2020
by   Dimitrios Vasilas, et al.
0

Database systems use query processing subsystems for enabling efficient query-based data retrieval. An essential aspect of designing any query-intensive application is tuning the query system to fit the application's requirements and workload characteristics. However, the configuration parameters provided by traditional database systems do not cover the design decisions and trade-offs that arise from the geo-distribution of users and data. In this paper, we present a vision towards a new type of query system architecture that addresses this challenge by enabling query systems to be designed and deployed in a per use case basis. We propose a distributed abstraction called Query Processing Unit that encapsulates primitive query processing tasks, and show how it can be used as a building block for assembling query systems. Using this approach, application architects can construct query systems specialized to their use cases, by controlling the query system's architecture and the placement of its state. We demonstrate the expressiveness of this approach by applying it to the design of a query system that can flexibly place its state in the data center or at the edge, and show that state placement decisions affect the trade-off between query response time and query result freshness.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/12/2018

A Modular Design for Geo-Distributed Querying

Most distributed storage systems provide limited abilities for querying ...
research
03/11/2021

ESPBench: The Enterprise Stream Processing Benchmark

Growing data volumes and velocities in fields such as Industry 4.0 or th...
research
09/04/2020

AnyDB: An Architecture-less DBMS for Any Workload

In this paper, we propose a radical new approach for scale-out distribut...
research
12/10/2019

Ledgerdata Refiner: A Powerful Ledger Data Query Platform for Hyperledger Fabric

Blockchain is one of the most popular distributed ledger technologies. I...
research
01/14/2023

Desbordante: from benchmarking suite to high-performance science-intensive data profiler (preprint)

Pioneering data profiling systems such as Metanome and OpenClean brought...
research
04/10/2020

Cheetah: Accelerating Database Queries with Switch Pruning

Modern database systems are growing increasingly distributed and struggl...
research
04/11/2020

Optimizing Cursor Loops in Relational Databases

Loops that iterate over SQL query results are quite common, both in appl...

Please sign up or login with your details

Forgot password? Click here to reset