Towards a Hands-Free Query Optimizer through Deep Learning

09/26/2018
by   Ryan Marcus, et al.
0

Query optimization remains one of the most important and well-studied problems in database systems. However, traditional query optimizers are complex heuristically-driven systems, requiring large amounts of time to tune for a particular database and requiring even more time to develop and maintain in the first place. In this vision paper, we argue that a new type of query optimizer, based on deep reinforcement learning, can drastically improve on the state-of-the-art. We identify potential complications for future research that integrates deep learning with query optimization and describe three novel deep learning based approaches that can lead the way to end-to-end learning-based query optimizers.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
04/07/2019

Neo: A Learned Query Optimizer

Query optimization is one of the most challenging problems in database s...
research
05/28/2022

Multi-agent Databases via Independent Learning

Machine learning is rapidly being used in database research to improve t...
research
11/26/2019

Join Query Optimization with Deep Reinforcement Learning Algorithms

Join query optimization is a complex task and is central to the performa...
research
01/05/2022

Balsa: Learning a Query Optimizer Without Expert Demonstrations

Query optimizers are a performance-critical component in every database ...
research
04/08/2020

Bao: Learning to Steer Query Optimizers

Query optimization remains one of the most challenging problems in data ...
research
02/25/2022

Break Up the Pipeline Structure to Reach a Nearly Optimal End-to-End Latency

Query optimization is still problematic in the commercial database syste...
research
02/03/2022

Multi-Objective Optimization, different approach to query a database

The datasets available nowadays are very rich and complex, but how do we...

Please sign up or login with your details

Forgot password? Click here to reset