Large-scale in-memory analytics on Intel ® Optane™ DC persistent memory
Author(s)Shanbhag, Anil Atmanand; Tatbul Bitim, Emine Nesime; Cohen, David; Madden, Samuel R
MetadataShow full item record
New data storage technologies such as the recently introduced Intel® Optane™ DC Persistent Memory Module (PMM) offer exciting opportunities for optimizing the query processing performance of database workloads. In particular, the unique combination of low latency, byte-addressability, persistence, and large capacity make persistent memory (PMem) an attractive alternative along with DRAM and SSDs. Exploring the performance characteristics of this new medium is the first critical step in understanding how it will impact the design and performance of database systems. In this paper, we present one of the first experimental studies on characterizing Intel® Optane™ DC PMM's performance behavior in the context of analytical database workloads. First, we analyze basic access patterns common in such workloads, such as sequential, selective, and random reads as well as the complete Star Schema Benchmark, comparing standalone DRAM- and PMem-based implementations. Then we extend our analysis to join algorithms over larger datasets, which require using DRAM and PMem in a hybrid fashion while paying special attention to the read-write asymmetry of PMem. Our study reveals interesting performance tradeoffs that can help guide the design of next-generation OLAP systems in presence of persistent memory in the storage hierarchy.
DepartmentMassachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
DaMoN '20: Proceedings of the 16th International Workshop on Data Management on New Hardware
Association for Computing Machinery (ACM)
Shanbhag, Anil et al. "Large-scale in-memory analytics on Intel ® Optane™ DC persistent memory." DaMoN '20: Proceedings of the 16th International Workshop on Data Management on New Hardware, June 2020, Portland, Oregon, Association for Computing Machinery, June 2020.
Author's final manuscript