Instance Optimal Join Size Estimation

12/15/2020
by   Mahmoud Abo Khamis, et al.
0

We consider the problem of efficiently estimating the size of the inner join of a collection of preprocessed relational tables from the perspective of instance optimality analysis. The run time of instance optimal algorithms is comparable to the minimum time needed to verify the correctness of a solution. Previously instance optimal algorithms were only known when the size of the join was small (as one component of their run time that was linear in the join size). We give an instance optimal algorithm for estimating the join size for all instances, including when the join size is large, by removing the dependency on the join size. As a byproduct, we show how to sample rows from the join uniformly at random in a comparable amount of time.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
03/22/2019

Instance and Output Optimal Parallel Algorithms for Acyclic Joins

Massively parallel join algorithms have received much attention in recen...
research
04/01/2022

Givens QR Decomposition over Relational Databases

This paper introduces Figaro, an algorithm for computing the upper-trian...
research
07/27/2017

Approximations and Bounds for (n, k) Fork-Join Queues: A Linear Transformation Approach

Compared to basic fork-join queues, a job in (n, k) fork-join queues onl...
research
06/08/2017

Optimal parameters for bloom-filtered joins in Spark

In this paper, we present an algorithm that joins relational database ta...
research
08/28/2018

Cost-efficient Data Acquisition on Online Data Marketplaces for Correlation Analysis

Incentivized by the enormous economic profits, the data marketplace plat...
research
07/02/2018

Distributed Statistical Estimation of Matrix Products with Applications

We consider statistical estimations of a matrix product over the integer...
research
04/03/2023

Guaranteeing the Õ(AGM/OUT) Runtime for Uniform Sampling and OUT Size Estimation over Joins

We propose a new method for estimating the number of answers OUT of a sm...

Please sign up or login with your details

Forgot password? Click here to reset