Chiller: Contention-centric Transaction Execution and Data Partitioning for Modern Networks
Name
3318464.3389724.pdf
Size
1.41 MB
Format
Adobe PDF
Checksum (MD5)
1e1287a5839fd93991cdd54032e7877d
Author(s)
Zamanian, Erfan
Shun, Julian
Binnig, Carsten
Kraska, Tim
Date Issued
2020
Journal
Proceedings of the ACM SIGMOD International Conference on Management of Data
Publisher
ACM
Citation
Zamanian, Erfan, Shun, Julian, Binnig, Carsten and Kraska, Tim. 2020. "Chiller: Contention-centric Transaction Execution and Data Partitioning for Modern Networks." Proceedings of the ACM SIGMOD International Conference on Management of Data, 50 (1).
Version
Final published version
Abstract
© 2020 Association for Computing Machinery. Distributed transactions on high-overhead TCP/IP-based networks were conventionally considered to be prohibitively expensive and thus were avoided at all costs. To that end, the primary goal of almost any existing partitioning scheme is to minimize the number of cross-partition transactions. However, with the new generation of fast RDMA-enabled networks, this assumption is no longer valid. In fact, recent work has shown that distributed databases can scale even when the majority of transactions are cross-partition. In this paper, we first make the case that the new bottleneck which hinders truly scalable transaction processing in modern RDMA-enabled databases is data contention, and that optimizing for data contention leads to different partitioning layouts than optimizing for the number of distributed transactions. We then present Chiller, a new approach to data partitioning and transaction execution, which aims to minimize data contention for both local and distributed transactions. Finally, we evaluate Chiller using various workloads, and show that our partitioning and execution strategy outperforms traditional partitioning techniques which try to avoid distributed transactions, by up to a factor of 2.
MIT Department
Massachusetts Institute of Technology. Computer Science and Artificial Intelligence Laboratory
Terms of Use
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Persistent DSpace Link
DOI of Published Version
https://doi.org/10.1145/3318464.3389724
