Communication-aware load balancing for parallel applications on clusters

IEEE Transactions on Computers

Volumn 59, Issue 1, 2010, Pages 42-52

  Qin, Xiao ^a   Jiang, Hong ^b   Manzanares, Adam ^a   Ruan, Xiaojun ^a   Yin, Shu ^a  

^a AUBURN UNIVERSITY   (United States)

^b UNIVERSITY OF NEBRASKA LINCOLN   (United States)

Author keywords

Cluster; Communication aware computing; Load balancing; Parallel computing

Indexed keywords

BEHAVIOR MODEL; CLUSTER COMMUNICATION; CLUSTER ENVIRONMENTS; COMPUTING LOAD; DISK I/O; EFFECTIVE BANDWIDTH; LOAD BALANCER; LOAD-BALANCING; LOAD-BALANCING SCHEMES; NETWORK RESOURCE; PARALLEL APPLICATION; PARALLEL COMPUTING; SIMULATION RESULT;

CLUSTER COMPUTING; COMPUTER SCIENCE; DISKS (STRUCTURAL COMPONENTS); PARALLEL ARCHITECTURES; SIMULATORS;

COMMUNICATION;

EID: 72949084406     PISSN: 00189340     EISSN: None     Source Type: Journal    
DOI: 10.1109/TC.2009.108     Document Type: Article

References (31)

1. A. Acharya and S. Setia, "Availability and Utility of Idle Memory in Workstation Clusters," Proc. ACM SIGMETRICS, pp. 35-46, 1999.
2. N.J. Boden, D. Cohen, R.E. Felderman, A.E. Kulawik, C.L. Seitz, J.N. Seizovic, and W.-K. Su, "Myrinet: A Gigabit-Per-Second Local Area Network," IEEE Micro, vol.15, no.1, pp. 29-36, Feb. 1995.
3. R. Brightwell, B. Lawry, A.B. MacCabe, and R. Riesen, "Portals 3.0: Protocol Building Blocks for Low Overhead Communication," Proc. 16th Int'l Parallel and Distributed Processing Symp. (IPDPS '02), pp. 164-173, 2002.
4. D. Buntinas, D.K. Panda, and R. Brightwell, "Application-Bypas Broadcast in MPICH over GM," Proc. Third Int'l Symp. Cluster Computing and the Grid (CCGRID '03), pp. 2-9, 2003.
5. W. Cirne and F. Berman, "When the Herd Is Smart: Aggregate Behavior in the Selection of Job Request," IEEE Trans. Parallel and Distributed Systems, vol.14, no.2, pp. 181-192, Feb. 2003.
6. J. Cohen, E. Jeannot, N. Padoy, and F. Wagner, "Messages Scheduling for Parallel Data Redistribution between Clusters," IEEE Trans. Parallel and Distributed Systems, vol.17, no.10, pp. 1163-1175, Oct. 2006.
7. J. Cruz and K. Park, "Towards Communication-Sensitive Load Balancing," Proc. 21st Int'l Conf. Distributed Computing Systems, pp. 731-734, Apr. 2001.
8. R. Cypher, A. Ho, S. Konstantinidou, and P. Messina, "Architectural Requirements of Parallel Scientific Applications with Explicit Communication," Proc. 20th Ann. Int'l Symp. Computer Architecture (ISCA '93), pp. 2-13, 1993.
9. A.C. Dusseau, R.H. Arpaci, and D.E. Culler, "Effective Distributed Scheduling of Parallel Workloads," Proc. ACM SIGMETRICS, pp. 25-36, 1996.
10. W.-C. Feng, J. (Gus) Hurwitz, H. Newman, S. Ravot, R.L. Cottrell, O. Martin, F. Coccetti, C. Jin, X. (David) Wei, and S. Low, "Optimizing 10-Gigabit Ethernet for Networks of Workstations, Clusters, and Grids: A Case Study," Proc. 2003 ACM / IEEE Conf. Supercomputing (SC '03), p. 50, 2003.
11. P. Geoffray, "OPIOM: Off-Processor I/O with Myrinet," Future Generation Computer Systems, vol.18, no.4, pp. 491-499, 2002.
12. W. Grop and E. Lusk, "The Message Passing Interface(MPI) Standard," Argonne Nat'l Lab, 2001.
13. M. Harchol-Balter and A.B. Downey, "Exploiting Process Lifetime Distributions for Dynamic Load Balancing," ACM Trans. Computer Systems, vol.15, no.3, pp. 253-285, 1997.
14. C.H. Hsu and J.W. Liu, "Dynamic Load Balancing Algorithms in Homogeneous Distributed Systems," Proc. Sixth Int'l Conf. Distributed Computing Systems, pp. 216-223, May 1986.
15. R. Lavi and A. Barak, "The Home Model and Competitive Algorithms for Load Balancing in a Computing Cluster," Proc. 21st Int'l Conf. Distributed Computing Systems (ICDCS '01), pp. 127-134, 2001.
16. P. Li and D. Curkendall, "Parallel 3-D Perspective Rendering," Proc. First Int'l Delta Applications Workshop, pp. 52-58, 1992.
17. J.M. Orduna, V. Arnau, A. Ruiz, R. Valero, and J. Duato, "On the Design of Communication-Aware Task Scheduling Strategies for Heterogeneous Systems," Proc. 2000 Int'l Conf. Parallel Processing (ICPP '00), pp. 391-398, 2000.
18. X. Qin, "Design and Analysis of a Load Balancing Strategy in Data Grids," Future Generation Computer Systems, vol.23, no.1, pp. 132-137, 2007.
19. X. Qin, "Performance Comparisons of Load Balancing Algorithms for I/O-Intensive Workloads on Clusters," J. Network Computer Application, vol.31, no.1, pp. 32-46, 2008.
20. X. Qin, H. Jiang, Y. Zhu, and D. Swanson, "Towards Load Balancing Support for I/O-Intensive Parallel Jobs in a Cluster of Workstations," Proc. IEEE Int'l Conf. Cluster Computing, Dec. 2003.
21. X. Qin, Y. Jiang, H. Zhu, and D. Swanson, "Dynamic Load Balancing for I/O-Intensive Tasks on Heterogeneous Clusters," Proc. 10th Int'l Conf. High Performance Computing (HiPC '03), Dec. 2003.
22. K.D. Ryu and J.K. Hollingsworth, "Exploiting Fine-Grained Idle Periods in Networks of Workstations," IEEE Trans. Parallel and Distributed Systems, vol.11, no.7, pp. 683-698, July 2000.
23. L. Schaelicke and A.L. Davis, "Design Trade Offs for User-Level I/O Architectures," IEEE Trans. Computers, vol.55, no.8, pp. 962-973, Aug. 2006.
24. K.G. Shin and Y.-C. Chang, "Load Sharing in Distributed Real-Time Systems with State-Change Broadcasts," IEEE Trans. Computers, vol.38, no.8, pp. 1124-1142, Aug. 1989.
25. J.A. Stankovic, "Simulations of Three Adaptive, Decentralized Controlled, Job Scheduling Algorithms," Computer Networks and ISDN Systems, vol.8, no.3, pp. 199-217, 1984.
26. M. Surdeanu, D.I. Moldovan, and S.M. Harabagiu, "Performance Analysis of a Distributed Question/Answering System," IEEE Trans. Parallel and Distributed Systems, vol.13, no.6, pp. 579-596, June 2002. (Pubitemid 34835457)
27. L.G. Valiant, "A Bridging Model for Parallel Computation," Comm. ACM, vol.33, no.8, pp. 103-111, 1990.
28. J.S. Vetter and F. Mueller, "Communication Characteristics of Large-Scale Scientific Applications for Contemporary Cluster Architectures," J. Parallel and Distributed Computing, vol.63, no.9, pp. 853-865, 2003.
29. J.S. Vetter and F. Mueller, "High Performance Implementation of MPI Datatype Communication over Infiniband," Proc. Int'l Parallel and Distributed Processing Symp., Apr. 2004.
30. J.S. Vetter and A. Yoo, "An Empirical Performance Evaluation of Scalable Scientific Applications," Proc. 2002 ACM / IEEE Conf. Supercomputing (SC '02), pp 1-18, 2002.
31. X.-D. Zhang, L. Xiao, and Y.-X. Qu, "Improving Distributed Workload Performance by Sharing Both CPU and Memory Resources," Proc. 20th Int'l Conf. Distributed Computing Systems (ICDCS '00), pp. 233-241, 2000.