Change Propagation Without Joins

01/10/2023
by   Qichen Wang, et al.
0

We revisit the classical change propagation framework for query evaluation under updates. The standard framework takes a query plan and materializes the intermediate views, which incurs high polynomial costs in both space and time, with the join operator being the culprit. In this paper, we propose a new change propagation framework without joins, thus naturally avoiding this polynomial blowup. Meanwhile, we show that the new framework still supports constant-delay enumeration of both the deltas and the full query results, the same as in the standard framework. Furthermore, we provide a quantitative analysis of its update cost, which not only recovers many recent theoretical results on the problem, but also yields an effective approach to optimizing the query plan. The new framework is also easy to be integrated into an existing streaming database system. Experimental results show that our system prototype, implemented using Flink DataStream API, significantly outperforms other systems in terms of space, time, and latency.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
01/25/2023

Free Join: Unifying Worst-Case Optimal and Traditional Joins

Over the last decade, worst-case optimal join (WCOJ) algorithms have eme...
research
07/20/2018

gSMat: A Scalable Sparse Matrix-based Join for SPARQL Query Processing

Resource Description Framework (RDF) has been widely used to represent i...
research
12/11/2022

FactorJoin: A New Cardinality Estimation Framework for Join Queries

Cardinality estimation is one of the most fundamental and challenging pr...
research
03/09/2020

A Note On Operator-Level Query Execution Cost Modeling

External query execution cost modeling using query execution feedback ha...
research
02/25/2022

Break Up the Pipeline Structure to Reach a Nearly Optimal End-to-End Latency

Query optimization is still problematic in the commercial database syste...
research
03/24/2021

A Multi-Tenant Framework for Cloud Container Services

Container technologies have been evolving rapidly in the cloud-native er...
research
10/07/2019

Field-based Coordination with the Share Operator

Field-based coordination has been proposed as a model for coordinating c...

Please sign up or login with your details

Forgot password? Click here to reset