Program scalability analysis for HPC cloud: Applying amdahl's law to NAS benchmarks

Proceedings - 2012 SC Companion: High Performance Computing, Networking Storage and Analysis, SCC 2012

Volumn , Issue , 2012, Pages 1215-1225

  Shi, Justin Y ^a   Taifi, Moussa ^a   Pradeep, Aakash ^a   Khreishah, Abdallah ^a   Antony, Vivek ^a  

^a Temple University   (United States)

Author keywords

Amdahls Law; Gustafsons Law; HPC Cloud Computing; Optimal Parallel Processing; Program Instrumentation Assisted Complexity Analysis; Timing Models

Indexed keywords

AMDAHLS LAWS; COMPLEXITY ANALYSIS; GUSTAFSONS LAW; PARALLEL PROCESSING; TIMING MODELS;

INSTRUMENTS; OPTIMIZATION; PARALLEL ARCHITECTURES; PROGRAM PROCESSORS; SCALABILITY; SEPARATION;

APPLICATION PROGRAMS;

EID: 84876573250     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.Companion.2012.147     Document Type: Conference Paper

References (41)

1. D. Kerbyson, H. Alme, A. Hoisie, F. Petrini, H. Wasserman, and M. Gittings, "Predictive performance and scalability modeling of a largescale application," Supercomputing 2001 Conference, 2001.
2. D. J. Kerbyson, A. Hoisie, and H. J. Wasserman, "A comparison between the earth simulator and alphaserver system using predictive application performance models," IPDPS 2003, 2003.
3. K. J. Barker, K. Davis, A. Hoisie, D. J. Kerbyson, M. Lang, S. Pakin, and J. C. Sancho, "Entering the petaflop era: The architecture and performance of roadrunner," Supercomputing 2008 Conference, 2008.
4. A. Snavely, L. Carrington, N. Wolter, J. Labarta, R. Badia, and A. Purkayastha, "A framework for performance modeling and prediction," 2002.
5. G. Amdahl, "Validity of the single processor approach to achieving large scale computing capabilities," in Proceedings of the April 18-20, 1967, spring joint computer conference. ACM, 1967, pp. 483-485.
6. Wikipedia, "Amdahl's law," 2004, [Online: accessed 22-July-2004]. [Online]. Available: http://en.wikipedia.org/wiki/Amdahlslaw
7. J. Gustafson, "Reevaluating amdahl's law," Communications of the ACM, vol. 31, no. 5, pp. 532-533, 1988.
8. Y. Shi, "Revaluating amdahls law and gustafsons law," Temple University, Tech. Rep., 1996. [Online]. Available: http://bit.ly/IW5m4F
9. J. Dennis, "Data flow supercomputers," Computer, vol. 13, no. 11, pp. 48-56, 1980.
10. Amazon, Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ ec2/: Amazon, 2008. [Online]. Available: http://aws.amazon.com/ec2/
11. J. Crowcroft, S. Hand, T. Harris, A. Herbert, M. Parker, and I. Pratt, "Futuregrid: A program for long-term research into grid systems architecture," 2008.
12. F. Bachmann, I. Foster, A. Grimshaw, D. Lifka, M. Riedel, and S. Tuecke, "Xsede architecture," 2012.
13. Y. Shi, "A distributed programming model and its applications to computation intensive problems for heterogeneous environments," in AIP Conference Proceedings, vol. 283, 1993, p. 827.
14. R. Blumofe and C. Leiserson, "Scheduling multithreaded computations by work stealing," in Foundations of Computer Science, 1994 Proceedings., 35th Annual Symposium on. IEEE, 1994, pp. 356-368.
15. R. Blumofe, C. Joerg, B. Kuszmaul, C. Leiserson, K. Randall, and Y. Zhou, Cilk: An efficient multithreaded runtime system. ACM, 1995, vol. 30, no. 8.
16. J. Y. Shi. Synergy-parallel processing systems. [Online]. Available: http://spartan.cis.temple.edu/synergy
17. T. White, Hadoop: The definitive guide. Yahoo Press, 2010.
18. Y. Gu and R. Grossman, "Sector and sphere: the design and implementation of a high-performance data cloud," Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences, vol. 367, no. 1897, pp. 2429-2445, 2009.
19. J. Ekanayake, H. Li, B. Zhang, T. Gunarathne, S. Bae, J. Qiu, and G. Fox, "Twister: a runtime for iterative mapreduce," in Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing. ACM, 2010, pp. 810-818.
20. M. Flynn, "Very high-speed computing systems," Proceedings of the IEEE, vol. 54, no. 12, pp. 1901-1909, 1966.
21. K. Hwang, Advanced computer architecture: parallelism, scalability, programmability. McGraw-Hill Singapore, 1993, vol. 199, no. 3.
22. D. Nussbaum and A. Agarwal, "Scalability of parallel machines," Communications of the ACM, vol. 34, no. 3, pp. 57-61, 1991.
23. R. Karp, "A survey of parallel algorithms for shared-memory machines," 1988.
24. R. Lee, "Empirical results on the speed, efficiency, redundancy and quality of parallel computations," in Proceedings of the 1980 International Conference on Parallel Processing, 1980, pp. 91-100.
25. D. Culler, R. Karp, D. Patterson, A. Sahay, K. Schauser, E. Santos, R. Subramonian, and T. Von Eicken, LogP: Towards a realistic model of parallel computation. ACM, 1993, vol. 28, no. 7.
26. T. Cormen, Introduction to algorithms. The MIT press, 2001.
27. T. Lewis, Foundations of parallel programming: a machine-indepedent approach. IEEE Computer Society Press, 1997.
28. L. Kronsjo, "Computational complexity of sequential and parallel algorithms," 1986.
29. L. Kronsjo and D. Shumsheruddin, Advances in parallel algorithms. John Wiley & Sons, Inc., 1992.
30. G. Almasi and A. Gottlieb, "Highly parallel computing," 1988.
31. L. Valiant, "A bridging model for parallel computation," Communications of the ACM, vol. 33, no. 8, pp. 103-111, 1990.
32. V. Kumar and A. Gupta, "Analysis of scalability of parallel algorithms and architectures: a survey," in Proceedings of the 5th international conference on Supercomputing. ACM, 1991, pp. 396-405.
33. Y. Shi, "Program scalability analysis," in International Conference on Distributed and Parallel Processing, Geogetown University, Washington DC, 1997.
34. E. Jeannot and L. Steffenel, "Fast and efficient total exchange on two clusters," Euro-Par 2007 Parallel Processing, pp. 848-857, 2007.
35. Temple-University. (2012) Owlsnest hpc cluster. http://www.temple.edu/ cst/icms/. [Online]. Available: http://www.temple.edu/cst/icms/
36. M. Taifi and J. Shi. (2012) Tcloud, hpcaas private cloud. https://sites.google.com/a/temple.edu/tcloud/home. [Online]. Available: https://sites.google.com/a/temple.edu/tcloud/home
37. K. Blathras, D. Szyld, and Y. Shi, "Timing models and local stopping criteria for asynchronous iterative algorithms," Journal of Parallel and Distributed Computing, vol. 58, no. 3, pp. 446-465, 1999.
38. C. Polychronopoulos and D. Kuck, "Guided self-scheduling: A practical scheduling scheme for parallel supercomputers," Computers, IEEE Transactions on, vol. 100, no. 12, pp. 1425-1439, 1987.
39. J. Y. Shi, M. Taifi, A. Khreishah, and J. Wu, "Tuple switching network: when slower may be better," Journal of Parallel and Distributed Computing, 2012. [Online]. Available: http://www.sciencedirect.com/science/ article/pii/S0743731512000263
40. M. Taifi, A. Khreishah, and J. Y. Shi, "Budget-driven sustainability for hpc applications," CIS Department, Temple University, Tech. Rep., 2012.
41. M. Taifi, J. Shi, and A. Khreishah, "Spotmpi: a framework for auctionbased hpc computing using amazon spot instances," Algorithms and Architectures for Parallel Processing, pp. 109-120, 2011.