Histogram-based global load balancing in structured peer-to-peer systems
Author(s)
Vu, Quang Hieu; Ooi, Beng Chin; Rinard, Martin C.; Tan, Kian-Lee
Download0108821Bd01.pdf (2.396Mb)
PUBLISHER_POLICY
Publisher Policy
Article is made available in accordance with the publisher's policy and may be subject to US copyright law. Please refer to the publisher's site for terms of use.
Terms of use
Metadata
Show full item recordAbstract
Over the past few years, peer-to-peer (P2P) systems have rapidly grown in popularity and have become a dominant means for sharing resources. In these systems, load balancing is a key challenge because nodes are often heterogeneous. While several load-balancing schemes have been proposed in the literature, these solutions are typically ad hoc, heuristic based, and localized. In this paper, we present a general framework, HiGLOB, for global load balancing in structured P2P systems. Each node in HiGLOB has two key components: 1) a histogram manager maintains a histogram that reflects a global view of the distribution of the load in the system, and 2) a load-balancing manager that redistributes the load whenever the node becomes overloaded or underloaded. We exploit the routing metadata to partition the P2P network into nonoverlapping regions corresponding to the histogram buckets. We propose mechanisms to keep the cost of constructing and maintaining the histograms low. We further show that our scheme can control and bound the amount of load imbalance across the system. Finally, we demonstrate the effectiveness of HiGLOB by instantiating it over three existing structured P2P systems: Skip Graph, BATON, and Chord. Our experimental results indicate that our approach works well in practice.
Date issued
2009-04Department
Massachusetts Institute of Technology. Department of Electrical Engineering and Computer ScienceJournal
IEEE Transactions on Knowledge and Data Engineering
Publisher
Institute of Electrical and Electronics Engineers
Citation
Histogram-Based Global Load Balancing in Structured Peer-to-Peer Systems
Quang Hieu Vu; Beng Chin Ooi; Rinard, M.; Kian-Lee Tan;
Knowledge and Data Engineering, IEEE Transactions on
Volume 21, Issue 4, April 2009 Page(s):595 - 608. (C)2009 Institute of Electrical and Electronics Engineers.
Version: Final published version
ISSN
1041-4347