Plan-Structured Deep Neural Network Models for Query Performance Prediction

by   Ryan Marcus, et al.

Query performance prediction, the task of predicting the latency of a query, is one of the most challenging problem in database management systems. Existing approaches rely on features and performance models engineered by human experts, but often fail to capture the complex interactions between query operators and input relations, and generally do not adapt naturally to workload characteristics and patterns in query execution plans. In this paper, we argue that deep learning can be applied to the query performance prediction problem, and we introduce a novel neural network architecture for the task: a plan-structured neural network. Our approach eliminates the need for human-crafted feature selection and automatically discovers complex performance models both at the operator and query plan level. Our novel neural network architecture can match the structure of any optimizer-selected query execution plan and predict its latency with high accuracy. We also propose a number of optimizations that reduce training overhead without sacrificing effectiveness. We evaluated our techniques on various workloads and we demonstrate that our plan-structured neural network can outperform the state-of-the-art in query performance prediction.


Kepler: Robust Learning for Faster Parametric Query Optimization

Most existing parametric query optimization (PQO) techniques rely on tra...

Guided Automated Learning for query workload re-Optimization

Query optimization is a hallmark of database systems enabling complex SQ...

Flexible Operator Embeddings via Deep Learning

Integrating machine learning into the internals of database management s...

Database Workload Characterization with Query Plan Encoders

Smart databases are adopting artificial intelligence (AI) technologies t...

A Note On Operator-Level Query Execution Cost Modeling

External query execution cost modeling using query execution feedback ha...

DeepBase: Deep Inspection of Neural Networks

Although deep learning models perform remarkably across a range of tasks...

Break Up the Pipeline Structure to Reach a Nearly Optimal End-to-End Latency

Query optimization is still problematic in the commercial database syste...

Please sign up or login with your details

Forgot password? Click here to reset