Multi-Tier Buffer Management and Storage System Design for Non-Volatile Memory

01/30/2019
by   Joy Arulraj, et al.
0

The design of the buffer manager in database management systems (DBMSs) is influenced by the performance characteristics of volatile memory (DRAM) and non-volatile storage (e.g., SSD). The key design assumptions have been that the data must be migrated to DRAM for the DBMS to operate on it and that storage is orders of magnitude slower than DRAM. But the arrival of new non-volatile memory (NVM) technologies that are nearly as fast as DRAM invalidates these previous assumptions. This paper presents techniques for managing and designing a multi-tier storage hierarchy comprising of DRAM, NVM, and SSD. Our main technical contributions are a multi-tier buffer manager and a storage system designer that leverage the characteristics of NVM. We propose a set of optimizations for maximizing the utility of data migration between different devices in the storage hierarchy. We demonstrate that these optimizations have to be tailored based on device and workload characteristics. Given this, we present a technique for adapting these optimizations to achieve a near-optimal buffer management policy for an arbitrary workload and storage hierarchy without requiring any manual tuning. We finally present a recommendation system for designing a multi-tier storage hierarchy for a target workload and system cost budget. Our results show that the NVM-aware buffer manager and storage system designer improve throughput and reduce system cost across different transaction and analytical processing workloads.

READ FULL TEXT
research
05/15/2020

Lessons learned from the early performance evaluation of Intel Optane DC Persistent Memory in DBMS

Non-volatile memory (NVM) is an emerging technology, which has the persi...
research
08/20/2019

On the Diversity of Memory and Storage Technologies

The last decade has seen tremendous developments in memory and storage t...
research
07/22/2017

Optimizations of Management Algorithms for Multi-Level Memory Hierarchy

In the near future the SCM is predicted to modify the form of new progra...
research
02/27/2022

CoPA: Cold Page Awakening to Overcome Retention Failures in STT-MRAM Based I/O Buffers

Performance and reliability are two prominent factors in the design of d...
research
05/16/2019

Persistent Buffer Management with Optimistic Consistency

Finding the best way to leverage non-volatile memory (NVM) on modern dat...
research
09/16/2018

I/O Workload Management for All-Flash Datacenter Storage Systems Based on Total Cost of Ownership

Recently, the capital expenditure of flash-based Solid State Driver (SSD...
research
06/26/2020

The TRaCaR Ratio: Selecting the Right Storage Technology for Active Dataset-Serving Databases

Main memory database systems aim to provide users with low latency and h...

Please sign up or login with your details

Forgot password? Click here to reset