Lessons learned from the early performance evaluation of Intel Optane DC Persistent Memory in DBMS

05/15/2020
by   Yinjun Wu, et al.
0

Non-volatile memory (NVM) is an emerging technology, which has the persistence characteristics of large capacity storage devices(e.g., HDDs and SSDs), while providing the low access latency and byte-addressablity of traditional DRAM memory. This unique combination of features open up several new design considerations when building database management systems (DBMSs), such as replacing DRAM (as the main working space memory) or block devices (as the persistent storage), or complementing both at the same time for several DBMS components (such as access methods,storage engine, buffer management, logging/recovery, etc). However, interacting with NVM requires changes to application software to best use the device (e.g. mmap and clflush of small cache lines instead of write and fsync of large page buffers). Before introducing (potentially major) code changes to the DBMS for NVM, developers need a clear understanding of NVM performance in various conditions to help make better design choices. In this paper, we provide extensive performance evaluations conducted with a recently released NVM device, Intel Optane DC Persistent Memory (PMem), under different configurations with several micro-benchmark tools. Further, we evaluate OLTP and OLAP database workloads (i.e., TPC-C and TPC-H) with Microsoft SQL Server 2019 when using the NVM device as an in-memory buffer pool or persistent storage. From the lessons learned we share some recommendations for future DBMS design with PMem, e.g.simple hardware or software changes are not enough for the best use of PMem in DBMSs.

READ FULL TEXT

page 1

page 2

page 3

page 4

research
07/11/2018

Using Intel Optane Devices for In-situ Data Staging in HPC Workflows

Emerging non-volatile memory technologies (NVRAM) offer alternatives to ...
research
05/24/2022

Writes Hurt: Lessons in Cache Design for Optane NVRAM

Intel OptaneTM DC Persistent Memory resides on the memory bus and approa...
research
05/16/2019

Persistent Buffer Management with Optimistic Consistency

Finding the best way to leverage non-volatile memory (NVM) on modern dat...
research
12/26/2020

Persistence and Synchronization: Friends or Foes?

Emerging non-volatile memory (NVM) technologies promise memory speed byt...
research
01/30/2019

Multi-Tier Buffer Management and Storage System Design for Non-Volatile Memory

The design of the buffer manager in database management systems (DBMSs) ...
research
05/03/2021

APEX: A High-Performance Learned Index on Persistent Memory

The recently released persistent memory (PM) has been gaining popularity...
research
08/09/2019

An Empirical Guide to the Behavior and Use of Scalable Persistent Memory

After nearly a decade of anticipation, scalable nonvolatile memory DIMMs...

Please sign up or login with your details

Forgot password? Click here to reset