Practical DB-OS Co-Design with Privileged Kernel Bypass
Author(s)
Zhou, Xinjing
Leis, Viktor
Hu, Jinming
Yu, Xiangyao
Stonebraker, Michael
Date Issued
February 11, 2025
Journal
Proceedings of the ACM on Management of Data
Publisher
ACM
Citation
Zhou, Xinjing, Leis, Viktor, Hu, Jinming, Yu, Xiangyao and Stonebraker, Michael. 2025. "Practical DB-OS Co-Design with Privileged Kernel Bypass." Proceedings of the ACM on Management of Data, 3 (1).
Version
Final published version
Abstract
This paper revisits the longstanding challenge of coordinating database systems with general-purpose OS interfaces, such as POSIX, which often lack tailored support for DB requirements. Existing approaches to this DB-OS co-design struggle with limited design space, security risks, and compatibility issues. To overcome these hurdles, we propose a new co-design approach leveraging virtualization to elevate the privilege level of DB processes. Our method enables database systems to fully exploit hardware capabilities via virtualization, while minimizing the need for extensive modifications to the host OS kernel, thereby maintaining compatibility. We demonstrate the effectiveness of our approach through two novel virtual memory mechanisms tailored for database workloads: (1) an efficient snapshotting mechanism that captures memory snapshots at millisecond intervals for in-memory databases and HTAP workloads, and (2) a streamlined in-kernel buffer pool design. We introduce Libdbos, a lightweight guest kernel implementing these mechanisms. Our evaluations highlight significant improvements in latency and efficiency compared to existing snapshotting and buffer pool designs, underscoring the potential of the approach.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Creative Commons Attribution-NonCommercial-NoDerivatives
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3709714
