Polyjuice: High-Performance Transactions via Learned Concurrency Control

05/21/2021
by   Jiachen Wang, et al.
0

Concurrency control algorithms are key determinants of the performance of in-memory databases. Existing algorithms are designed to work well for certain workloads. For example, optimistic concurrency control (OCC) is better than two-phase-locking (2PL) under low contention, while the converse is true under high contention. To adapt to different workloads, prior works mix or switch between a few known algorithms using manual insights or simple heuristics. We propose a learning-based framework that instead explicitly optimizes concurrency control via offline training to maximize performance. Instead of choosing among a small number of known algorithms, our approach searches in a "policy space" of fine-grained actions, resulting in novel algorithms that can outperform existing algorithms by specializing to a given workload. We build Polyjuice based on our learning framework and evaluate it against several existing algorithms. Under different configurations of TPC-C and TPC-E, Polyjuice can achieve throughput numbers higher than the best of existing algorithms by 15

READ FULL TEXT

page 1

page 4

page 7

page 11

page 15

page 16

page 17

page 19

research
11/12/2018

The Impact of Timestamp Granularity in Optimistic Concurrency Control

Optimistic concurrency control (OCC) can exploit the strengths of parall...
research
10/03/2018

Improving High Contention OLTP Performance via Transaction Scheduling

Research in transaction processing has made significant progress in impr...
research
10/17/2021

A Learning-based Approach Towards Automated Tuning of SSD Configurations

Thanks to the mature manufacturing techniques, solid-state drives (SSDs)...
research
01/08/2020

HyperSched: Dynamic Resource Reallocation for Model Development on a Deadline

Prior research in resource scheduling for machine learning training work...
research
07/04/2023

Beyond Conservatism: Diffusion Policies in Offline Multi-agent Reinforcement Learning

We present a novel Diffusion Offline Multi-agent Model (DOM2) for offlin...
research
11/03/2022

AdaChain: A Learned Adaptive Blockchain

This paper presents AdaChain, a learning-based blockchain framework that...
research
05/17/2020

A Practical Algorithm for the Computation of the Genus

We describe a practical algorithm to compute the (oriented) genus of a g...

Please sign up or login with your details

Forgot password? Click here to reset