A Survey on Advancing the DBMS Query Optimizer: Cardinality Estimation, Cost Model, and Plan Enumeration

01/05/2021
by   Hai Lan, et al.
0

Query optimizer is at the heart of the database systems. Cost-based optimizer studied in this paper is adopted in almost all current database systems. A cost-based optimizer introduces a plan enumeration algorithm to find a (sub)plan, and then uses a cost model to obtain the cost of that plan, and selects the plan with the lowest cost. In the cost model, cardinality, the number of tuples through an operator, plays a crucial role. Due to the inaccuracy in cardinality estimation, errors in cost model, and the huge plan space, the optimizer cannot find the optimal execution plan for a complex query in a reasonable time. In this paper, we first deeply study the causes behind the limitations above. Next, we review the techniques used to improve the quality of the three key components in the cost-based optimizer, cardinality estimation, cost model, and plan enumeration. We also provide our insights on the future directions for each of the above aspects.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
11/22/2017

Adaptive Cardinality Estimation

In this paper we address cardinality estimation problem which is an impo...
research
06/11/2023

Kepler: Robust Learning for Faster Parametric Query Optimization

Most existing parametric query optimization (PQO) techniques rely on tra...
research
09/28/2020

Tempura: A General Cost Based Optimizer Framework for Incremental Data Processing (Extended Version)

Incremental processing is widely-adopted in many applications, ranging f...
research
06/06/2019

An End-to-End Learning-based Cost Estimator

Cost and cardinality estimation is vital to query optimizer, which can g...
research
03/09/2020

A Note On Operator-Level Query Execution Cost Modeling

External query execution cost modeling using query execution feedback ha...
research
06/15/2022

Selectivity Estimation of Inequality Joins In Databases

Selectivity estimation refers to the ability of the SQL query optimizer ...
research
01/13/2021

Flow-Loss: Learning Cardinality Estimates That Matter

Previous approaches to learned cardinality estimation have focused on im...

Please sign up or login with your details

Forgot password? Click here to reset