Algorithm-system scalability of heterogeneous computing

Journal of Parallel and Distributed Computing

Volumn 68, Issue 11, 2008, Pages 1403-1412

  Chen, Yong ^a   Sun, Xian He ^a   Wu, Ming ^a  

^a Illinois Institute of Technology   (United States)

Author keywords

Heterogeneous computing; Parallel computing; Performance evaluation; Scalability

Indexed keywords

ELECTRIC NETWORK ANALYSIS; MACHINE DESIGN; PARALLEL ALGORITHMS; SCALABILITY;

ANALYTICAL RESULTS; DISTRIBUTED SYSTEMS; HETEROGENEOUS COMPUTING; HETEROGENEOUS COMPUTING SYSTEMS; HETEROGENEOUS ENVIRONMENTS; HETEROGENEOUS SYSTEMS; KEY FACTORS; PARALLEL COMPUTING; PARALLEL PROCESSING; PERFORMANCE EVALUATION; SYSTEM SCALABILITY;

COMPUTER SYSTEMS;

EID: 52949107193     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2008.06.007     Document Type: Article

References (25)

1. Beaumont O., Boudet V., Rastello F., and Robert Y. Matrix multiplication on heterogeneous platforms. IEEE Transaction on Parallel and Distributed Systems 12 10 (2001) 1033-1051
2. J.L. Bosque, L. Pastor, Theoretical scalability analysis for heterogeneous clusters, in: Proceedings of the 4th IEEE/ACM International Symposium on Cluster Computing and the Grid, 2004
3. Y. Chen, X.H. Sun, STAS: A Scalability testing and analysis system, in: Proceedings of 2006 IEEE International Conference on Cluster Computing, 2006
4. CLUMPs, http://now.cs.berkeley.edu/clumps/
5. Culler D., Singh J., and Gupta A. Parallel Computer Architecture: A Hardware/Software Approach (1999), Morgan Kaufmann Publishers
6. Foster I., and Kesselman C. The Grid: Blueprint for a New Computing Infrastructure. 2nd Edition (2004)
7. A. Gupta, V. Kumar, Scalability of parallel algorithms for matrix multiplication, in: Proceedings of the 1993 International Conference on Parallel Processing, 1993
8. Hwang K., and Xu Z. Scalable Parallel Computing (1998), McGraw-Hill
9. Jogalekar P.P., and Woodside C.M. Evaluating the scalability of distributed systems. IEEE Transaction on Parallel and Distributed Systems 11 6 (2000) 589-603
10. Kalinov A., and Lastovetsky A. Heterogeneous distribution of computations while solving linear algebra problems on networks of heterogeneous computers. Journal of Parallel and Distributed Computing 61 4 (2001) 520-535
11. Kumar V., Grama A., Gupta A., and Karypis G. Introduction to Parallel Computing: Design and Analysis of Parallel Algorithms (1994)
12. Li K. Average-case scalability analysis of parallel computations. Annual Review of Scalable Computing, World Scientific 4 (2002) 51-95
13. LINPACK http://www.netlib.org/linpack/
14. NAS Parallel Benchmarks http://www.nas.nasa.gov/Software/NPB/
15. L. Pastor, J.L. Bosque, An efficiency and scalability model for heterogeneous clusters, in: Proceedings of IEEE International Conference on Cluster Computing, 2001
16. Prefect Bechmarks http://www.csrd.uiuc.edu/benchmark/benchmark.html
17. Sarukkai S.R., Mehta P., and Block R.J. Automated scalability analysis of message-passing parallel programs. IEEE Parallel and Distributed Technology 3 4 (1995) 21-32
18. ScaLAPACK, http://www.netlib.org/scalapack/scalapack_home.html
19. Sun X.H. Scalability versus execution time in scalable systems. Journal of Parallel and Distributed Computing 62 2 (2002) 173-192
20. X.H. Sun, Y. Chen, M. Wu, Scalability of heterogeneous computing, in: Proceedings of the 34th International Conference on Parallel Processing, 2005
21. Sun X.H., and Ni L.M. Scalable problems and memory-bounded speedup. Journal of Parallel and Distributed Computing 19 (1993) 27-37
22. Sun X.H., and Rover D. Scalability of parallel algorithm-machine combinations. IEEE Transaction on Parallel Distributed Systems 5 (1994) 599-613
23. Sun X.H., and Zhu J. Performance considerations: A case study using a scalable shared-virtual-memory machines. IEEE Parallel and Distributed Technology 4 (1996) 36-49
24. Zhang X., Yan Y., and He K. Latency metric: An experimental method for measuring and evaluating parallel program and architecture scalability. Journal of Parallel and Distributed Computing 22 (1994) 392-410
25. X. Zhang, Y. Yan, Modeling and characterizing parallel computing performance on heterogeneous networks of workstations, in: Proceedings of the 7th IEEE Symposium on Parallel and Distributed Processing, 1995