Histogram-based global load balancing in structured peer-to-peer systems
Author(s)Vu, Quang Hieu; Ooi, Beng Chin; Rinard, Martin C.; Tan, Kian-Lee
MetadataShow full item record
Over the past few years, peer-to-peer (P2P) systems have rapidly grown in popularity and have become a dominant means for sharing resources. In these systems, load balancing is a key challenge because nodes are often heterogeneous. While several load-balancing schemes have been proposed in the literature, these solutions are typically ad hoc, heuristic based, and localized. In this paper, we present a general framework, HiGLOB, for global load balancing in structured P2P systems. Each node in HiGLOB has two key components: 1) a histogram manager maintains a histogram that reflects a global view of the distribution of the load in the system, and 2) a load-balancing manager that redistributes the load whenever the node becomes overloaded or underloaded. We exploit the routing metadata to partition the P2P network into nonoverlapping regions corresponding to the histogram buckets. We propose mechanisms to keep the cost of constructing and maintaining the histograms low. We further show that our scheme can control and bound the amount of load imbalance across the system. Finally, we demonstrate the effectiveness of HiGLOB by instantiating it over three existing structured P2P systems: Skip Graph, BATON, and Chord. Our experimental results indicate that our approach works well in practice.
DepartmentMassachusetts Institute of Technology. Department of Electrical Engineering and Computer Science
IEEE Transactions on Knowledge and Data Engineering
Institute of Electrical and Electronics Engineers
Histogram-Based Global Load Balancing in Structured Peer-to-Peer Systems Quang Hieu Vu; Beng Chin Ooi; Rinard, M.; Kian-Lee Tan; Knowledge and Data Engineering, IEEE Transactions on Volume 21, Issue 4, April 2009 Page(s):595 - 608. (C)2009 Institute of Electrical and Electronics Engineers.
Final published version