Achieving performance consistency in heterogeneous clusters

IEEE International Symposium on High Performance Distributed Computing, Proceedings

Volumn , Issue , 2004, Pages 140-149

  Wu, Changxun ^a   Burns, Randal ^a  

^a JOHNS HOPKINS UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED SYSTEMS; HASH-BASED RANDOMIZATION; LOAD MANAGEMENT; VIRTUAL PROCESSORS;

ALGORITHMS; DISTRIBUTED COMPUTER SYSTEMS; MICROPROCESSOR CHIPS; SERVERS; VIRTUAL REALITY;

TELECOMMUNICATION SYSTEMS;

EID: 4944231414     PISSN: 10828907     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (44)

1. K. Amiri, D. Petrou, G. R. Ganger, and G. A. Gibson. Dynamic function placement for data-intensive cluster computing. In Proceedings of the 2000 USENIX Annual Technical Conference, 2000.
2. D. Anderson, J. Chase, and A. Vahdat Interposed request routing for scalable network storage. In Proceedings of the Symposium on Operating Systems Design and Implementation. 2000.
3. L. Aversa and A. Bestavros. Load balancing a cluster of web servers using distributed packet rewriting. In Proceedings of the IEEE International Performance, Computing, and Communications Conference, 2000.
4. A. Barak, G. Shai, and R. G. Wheeler. The MOSIX Distributed Operating System: Load Balancing for UNIX. Springer Verlag, 1993.
5. A. Brinkmann, K. Salzwedel, and C. Scheideier. Compact, adaptive placement strategies for non-uniform capacities. In Proceedings of Symposium on Parallel Algorithms and Architectures, 2002.
6. V. Cardellini, M. Colajanni, and P. Yu. Geographic load balancing for scalable distributed web systems. In Proceedings of the International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems, 2000.
7. J. Chase, L. Grit, D. Irwin, J. Moore, and S. Sprenkle. Dynamic virtual clusters in a grid site manager. In Proceedings of the International Symposium on High-Performance Distributed Computing, 2003.
8. K. CzajkowsK, I. Foster, C. Kesselman, V. Sander, and S. Tuecke. Snap: A protocol for negotiating service level agreements and coordinating resource management in distributed systems, 2002.
9. F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, and I. Stoica. Wide-area cooperative storage with CFS. In Proceedings of the 18th ACM Symposium on. Operating Systems Principles, 2001.
10. D. L. Eager, E. D. Lazowska, and J. Zahorjan. Adaptive load sharing in homogeneous distributed systems. IEEE Transactions on Software Engineering, 12(5), 1986.
11. W. Feng, M. Warren, and E. Weigle. Honey, I Shrunk the Beowulf! In Proceedings of the International Conference on Parallel Processing, 2002.
12. G. R. Ganger, J. D. Strunk, and A. J. Kiosterman. Self-* storage: Brick-based storage with automated administration. Technical Report CMU-CS-03-178, Carnegie Mellon University, 2003.
13. G. R. Ganger, B. L. Worthington, R. Y. Hou, and Y. N. Patt. Disk subsystem load balancing: Disk striping vs. conventional data placement. In Proceedings of the International Conference on System Sciences, 1993.
14. M. Harchol-Balter and A. Downey. Exploiting process lifetime distributions for dynamic load balancing. ACM Transactions on Computer Systems, 15(3), 1997.
15. J. H. Howard, M. L. Kazar, S. G. Menees, D. A. Nichols, M. Satyanarayanan, R. N. Sidebotham, and M. J. West. Scale and performance in a distributed file system. ACM Transactions on Computer Systems, 6(1), 1988.
16. IBM. Total Storage SAN File System, 2003. http://www.storage.ibm.com/ software/virtualization/sfs/.
17. L. V. Kale, M. Bhandarkar, and R. Brunner. Run-time support for adaptive load balancing. In Proceedings of the 4th Workshop on Runtime Systems for Parallel Programming, 2000.
18. E. D. Katz, M. Butler, and R. McGrath. A scalable HTTP server: The NCSA prototype. Computer Networks and ISDN Systems, 27(2), 1994.
19. J. O. Kephart and D. M. Chess. The vision of autonomic computing. Computer, 36(1):41-50, 2003.
20. W. Litwin, M. Neimat, and D. A. Schneider. LH* - a scalable, distributed data structure. ACM Transactions on Database Systems, 21(4), 1996.
21. C. Lu and S. Lau. An adaptive load balancing algorithm for heterogeneous distributed systems with multiple task classes. In Proceedings of the International Conference on Distributed Computing Systems, 1996.
22. Lustre: A scalable, High-Performance file system. Technical Report available at - http://www.lustre.org/docs/whitepaper.pdf, Cluster File Systems, 2002.
23. J. Menon, D. A. Pease, R. Rees, L. Duyanovich, and B. Hillsberg. IBM storage tank: A heterogeneous scalable SAN file system. IBM Systems Journal, 42(2), 2003.
24. M. Mitzenmacher. On the analysis of randomized load balancing schemes. In the ACM Symposium on Parallel Algorithms and Architectures, 1997.
25. M. Mitzenmacher. How useful is old information? IEEE Transactions on Parallel and Distributed Systems, 11(1), 2000.
26. M. Mitzenmacher. The power of two choices in randomized load balancing. IEEE Transactions on Parallel and Distributed Systems, 12(10), 2001.
27. L. Mummert and M. Satyanarayanan. Long term distributed file reference tracing: Implementation and experience. Software - Practice and Experience, 26(6), 1996.
28. N. Nedeljkovic and M. J. Quinn. Data-parallel programming on a network of heterogeneous workstations. In Proceedings of the First International Symposium on High Performance Distributed Computing, 1992.
29. Panasas. Shared Storage Cluster Computing, Oct 19 2003.
30. S. Petri and H. Langendorfer. Load balancing and fault tolerance in workstation clusters migrating groups of communicating processes. ACM SIGOPS Operating Systems Review, 29(4), 1995.
31. A. Rao, K. Lakshminarayanan, S. Surana, R. Karp, and I. Stoica. Load balancing in structured P2P systems. In Proceedings of the 2nd International Workshop on Peer-to-Peer Systems, 2003.
32. S. Ratnasamy, P. Francis, M. Handley, R. Karp, and S. Shenker. A scalable content addressable network. In Proceedings of ACM SIGCOMM 2001, 2001.
33. A. Rowstron and P. Druschel. Pastry: Scalable, distributed object location and routing for large-scale peer-to-peer systems. In Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms, 2001.
34. P. Shenoy and H. Vin. Efficient striping techniques for multimedia file servers. In Proceedings of the International Workshop on Network and Operating System Support for Digital Audio and Video, 1997.
35. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan. Chord: A scalable peer-to-peer lookup service for Internet applications. In Proceedings of ACM SIGCOMM, 2001.
36. J. Watts, M. Rieffel, and S. Taylor. Dynamic management of heterogenous resources. In Proceeding of the High Performance Computing Conference: Grand Challenges in Computer Simulation, 1998.
37. J. Watts and S. Taylor. A practical approach to dynamic load balancing. IEEE Transactions on Parallel and Distributed Systems, 9(3), 1998.
38. J. Wilkes. Data services - from data to containers, 2003. Keynote at the Usenix Conference for File and Storage Technologies.
39. M. Willebeek-LeMair and A. P. Reeves. Strategies for dynamic load balancing on highly parallel computers. IEEE Transactions on Parallel and Distributed Systems, 4(9), 1993.
40. C. Wu and R. Burns. Handling heterogeneity in shared-disk file systems. In Proceedings of the International Conference for High Performance Computing and Communications, 2003.
41. C. Wu and F. Lau. Load Balancing in Parallel Computers: Theory and Practice. Kluwer Academic Publishers, Boston, Mass, 1997.
42. S. Zhou. A trace-driven simulation study of dynamic load balancing. IEEE Transactions on Software Engineering, 14(9), 1988.
43. S. Zhou, J. Wang, X. Zheng, and P. Delisle. Utopia: A load-sharing facility for large heterogeneous distributed computing systems. Software - Practice and Experience, 23(12), 1993.
44. H. Zhu, T. Yang, Q. Zheng, D. Watson, O. H. Ibarra, and T. R. Smith. Adaptive load sharing for clustered digital library servers. International Journal on Digital Libraries, 2(4), 2000.