Speedup and scalability analysis of Master-Slave applications on large heterogeneous clusters

Journal of Parallel and Distributed Computing

Volumn 67, Issue 11, 2007, Pages 1155-1167

  Huerta Yero, Eduardo Javier ^a   Amaral Henriques, Marco Aurélio ^a  

^a UNIVERSITY OF CAMPINAS   (Brazil)

Author keywords

Distributed systems; Modeling and prediction; Parallel systems

Indexed keywords

COMPUTATIONAL METHODS; COMPUTER NETWORKS; MATHEMATICAL MODELS; PROGRAM PROCESSORS; STATISTICAL METHODS;

COMPUTING POWER; HETEROGENEOUS CLUSTERS; PARALLEL SYSTEMS;

PARALLEL PROCESSING SYSTEMS;

EID: 34548838245     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2007.04.015     Document Type: Article

References (31)

1. G. Amdahl, Validity of the single-processor approach to achieving large scale computing capabilities, in: AFIPS Conference, 1967, pp. 483-485.
2. Anderson D.P., Cobb J., Korpela E., Lebofsky M., and Werthimer D. Seti@home: an experiment in public-resource computing. Comm. ACM 45 11 (2002) 56-61
3. O. Beaumont, V. Boudet, F. Rastello, Y. Robert, Matrix multiplications on heterogeneous platforms, IEEE Trans. Parallel and Distributed Systems 12 (10) (2001).
4. Colombet L., and Desbat L. Speedup and efficiency of large-size applications on heterogeneous networks. Theoret. Comput. Sci. 196 (1998) 31-44
5. Cremonesi P., Rosti E., Serazzi G., and Smirni E. Performance evaluation of parallel systems. Parallel Comput. 25 (1999) 1677-1698
6. Donaldson V., Berman F., and Paturi R. Program speedup in a heterogeneous computing network. J. Parallel and Distributed Comput. 21 (1994) 316-322
7. D.L. Eager, J. Zahorjan, E.D. Lazowska, Speedup versus efficiency in parallel systems, IEEE Trans. Comput. 38 (3) (1989).
8. S.M. Figueira, F. Berman, A slowdown model for applications executing on time-shared clusters of workstations, IEEE Trans. Parallel and Distributed Systems 12 (6) (2001).
9. In: Foster I., and Kesselman C. (Eds). The Grid: Blueprint for a New Computing Infrastructure. first ed. (1999), Morgan Kaufmann, Los Altos, CA
10. D. Ghose, T. Robertazzi (Eds.), Special Issue on Divisible Load Scheduling. Cluster Computing, vol. 6(1), Springer, Netherlands, 2003.
11. L. Gong, X.-H. Sun, E.F. Watson, Performance modeling and prediction of nondedicated network computing, IEEE Trans. Comput. 51 (9) (2002).
12. Gustafson J. Reevaluating Amdahl's law. Comm. ACM 31 (1988) 532-533
13. E.J. Huerta Yero, M.A. Amaral Henriques, A method to solve the scalability problem in massively parallel processing on the Internet, in: 7th Euromicro Workshop on Parallel and Distributed Processing, IEEE Computer Press, University of Madeira, Funchal, Portugal, 1999.
14. P. Jogalekar, M. Woodside, Evaluating the scalability of distributed systems, IEEE Trans. Parallel and Distributed Systems 11 (6) (2000).
15. V. Kumar, V.N. Rao, Parallel depth-first ii. Analysis, Internat. J. Parallel Programming 16 (1987).
16. Lewis M., and Grimshaw A. The core Legion object model. Proceedings of the 5th IEEE International Symposium on High Performance Distributed Computing (1996), IEEE Computer Society Press, Los Alamitos, CA
17. Li K. Scalable parallel matrix multiplication on distributed memory parallel computers. J. Parallel and Distributed Comput. 61 (2001) 1709-1731
18. Müller-Wichards D., and Rönsch W. Scalability of algorithms: an analytic approach. Parallel Comput. 21 (1995) 937-952
19. Ramos-Hernández D.N., and Tokhi M.O. Performance evaluation of heterogeneous systems. Microprocessors and Microsystems 25 (2001) 203-212
20. T. Robertazzi, Ten reasons to use divisible load theory, Computer 36 (5) (2003).
21. S. Sahni, V. Thanvantri, Performance metrics: keeping the focus in runtime, IEEE Parallel and Distributed Technol. (Spring) (1996) 43-56.
22. G. Shao, F. Berman, R. Wolski, Master/slave computing on the grid, in: 9th Heterogeneous Computing Workshop, 2000.
23. L. Snyder, T. Sterling, Panel: "What are the top ten most influential parallel and distributed processing concepts of the last millennium?", J. Parallel and Distributed Comput. 61 (2000) (panel held at IPDPS 2000).
24. Sun X.-H. Scalability versus execution time in scalable systems. J. Parallel and Distributed Comput. 62 (2002) 173-192
25. X.-H. Sun, J. Gustafson, Toward a better parallel performance metric, Parallel Comput. 17 (1991).
26. Sun X.-H., and Ni L. Scalable problems and memory bounded speedup. J. Parallel and Distributed Comput. 19 1 (1993) 27-37
27. X.-H. Sun, D.T. Rover, Scalability of parallel algorithm-machine combinations, IEEE Trans. Parallel and Distributed Systems 5 (6) (1994).
28. Tanenbaum A.S. Computer Networks. third ed. (1996), Prentice-Hall, Englewood Cliffs, NJ
29. Wu X., and Li W. Performance models for scalable cluster computing. J. Systems Architecture 44 (1998) 189-205
30. Yan Y., Zhang X., and Song Y. An effective and practical performance prediction model for parallel computing on nondedicated heterogeneous now. J. Parallel and Distributed Comput. 38 1 (1996) 63-80
31. Yu D., and Robertazzi T. Divisible load scheduling for grid computing. Parallel and Distributed Computing and Systems (2003), ACTA Press, Marina del Rey, USA