Improving effective bandwidth of networks on clusters using load balancing for communication-intensive applications

Conference Proceedings of the IEEE International Performance, Computing, and Communications Conference

Volumn , Issue , 2005, Pages 27-34

  Qin, Xiao ^a   Jiang, Hong ^b  

^a NEW MEXICO INSTITUTE OF MINING AND TECHNOLOGY   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER ENVIRONMENTS; LOAD-BALANCING SCHEME;

BANDWIDTH; COMPUTER SIMULATION; COST EFFECTIVENESS; INTERCONNECTION NETWORKS;

TELECOMMUNICATION NETWORKS;

EID: 28444464816     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. A. Acharya and S. Setia, "Availability and Utility of Idle Memory in Workstation Clusters," Proc. ACM SIGMETRICS Conf. Measuring and Modeling of Computer Systems, May 1999.
2. N.J. Boden, D. Cohen, and W.K. Su., "Myrinet: A Gigabit-per-second Local Area Network," IEEE Micro, Vo. 15, No. 1, February 1995.
3. R. Brightwell, R. Riesen, "Portals 3.0: Protocol Building Blocks for Low Overhead Communication," Proc. Int'l Parallel and Distributed Processing Symp. Workshops, April, 2002, Florida.
4. D. Buntinas, D. K. Panda and R. Brightwell, "Application-Bypass Broadcast in MPICH over GM," Proc. Int'l Symp. Cluster Computing and the Grid, May 2003.
5. W. Cirne, F. Berman, "When the herd is smart Aggregate behavior in the selection of job request," IEEE Trans. Parallel and Distributed Systems, No.2, Feb. 2003.
6. J. Cruz and Kihong Park, "Towards Communication-Sensitive Load Balancing," Proc. the 21st Int'l Conf. Distributed Computing Systems, Apr. 2001.
7. R. Cypher, A. Ho, S. Konstantinidou, and P. Messina, "Architectural Requirements of Parallel Scientific Applications With Explicit Communication," Proc. the 20th Int'l Symp. on Computer Architecture, 1993.
8. W. Feng, G. Hurwitz, et al., "Optimizing 10-Gigabit Ethernet for Networks of Workstations, Clusters and Grids: A Case Study," Proc. SC 2003: High-Performance Networking and Computing Conf., 2003.
9. P. Geoffray, "OPIOM: Off-Processor I/O with Myrinet", Future Generation Computer Systems, 2002(19).
10. M. Harchol-Balter and A. Downey, "Exploiting Process Lifetime Distributions for Load Balacing," ACM Trans. Computer Systems, vol. 3, no. 31, 1997.
11. C.-Y.H. Hsu and J.W.-S. Liu, "Dynamic Load Balancing Algorithms in Homogeneous Distributed Systems," IEEE Proc. 6th Int'l Conf. Distributed Computing Systems, pp.216-223, 1986.
12. R. Lavi and A. Barak, "The Home Model and Competitive Algorithm for Load Balancing in a Computing Cluster," Proc. the 21st Int'l Conf. Distributed Computing Systems, Apr. 2001.
13. P. Li and D. Curkendall, "Parallel 3-D perspective rendering," Proceedings of the 1st International Delta Applications Workshop, Technical Report CCSF-14-92, California Institute of Technology, pp.52-58, 1992.
14. J.M. Orduña, V. Arnau, A. Ruiz, R. Valero, "On the Design of Communication-Aware Task Scheduling Strategies for Heterogeneous Systems," Proc. Int'l Conf. Parallel Processing, 2000.
15. X. Qin, "Improving Network Performance through Task Duplication for Parallel Applications on Clusters," Proc. the 24th IEEE Int'l Performance, Computing, and Communications Conference (IPCCC 2005), Phoenix, Arizona, April, 2005.
16. X. Qin, H. Jiang, Y. Zhu, and D. Swanson, "Dynamic Load Balancing for I/O-Intensive Tasks on Heterogeneous Clusters," Proc. the 10th Int'l Conf. on High Performance Computing (HiPC 2003), pp. 300-309, Dec., 2003.
17. X. Qin, H. Jiang, Y. Zhu, and D. Swanson, "Towards Load Balancing Support for I/O-Intensive Parallel Jobs in a Cluster of Workstations," Proc. the 5th IEEE Int'l Conf. Cluster Computing (Cluster 2003), pp.100-107, Dec. 2003.
18. X. Qin, H. Jiang, Y. Zhu, and D. R. Swanson, "Dynamic Load balancing for I/O- and Memory-Intensive workload in Clusters using a Feedback Control Mechanism," Proc. the 9th Int'l Euro-Par Conf. Parallel Processing (Euro-Par 2003), pp. 224-229, Klagenfurt, Austria, Aug. 2003.
19. N. T. Spring, R. Wolski, "Application Level Scheduling of Gene Sequence Comparison on Metacomputers," Proc. Int'l Conf. Supercomputing, pp. 141-148, 1998.
20. J.A. Stankovic, "Simulation of Three Adaptive, Decentralized Controlled, Job Scheduling Algorithms," Computer Networks, Vol.8, pp.199-217, 1984.
21. M. Surdeanu, D. Modovan, and S. Harabagiu, "Performance Analysis of a Distributed Question/ Answering System," IEEE Trans. Parallel and Distributed Systems, Vol.13, No.6, pp.579-596, 2002.
22. J. Wu, P. Wyckoff, and D. K. Panda, "High Performance Implementation of MPI Datatype Communication over InfiniBand," Proc. Int'l Parallel and Distributed Processing Symp., April, 2004.
23. X. Zhang, Y. Qu, and L. Xiao, "Improving Distributed Workload Performance by Sharing both CPU and Memory Resources," Proc. the 20th Int'l Conf. on Distributed Computing Systems, Apr. 2000.