A comparative study of high-performance computing on the cloud

HPDC 2013 - Proceedings of the 22nd ACM International Symposium on High-Performance Parallel and Distributed Computing

Volumn , Issue , 2013, Pages 239-250

  Marathe, Aniruddha ^a   Harris, Rachel ^a   Lowenthal, David K ^a   De Supinski, Bronis R ^b   Rountree, Barry ^b   Schulz, Martin ^b   Yuan, Xin ^c  

^a University of Arizona   (United States)

^b LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^c Florida State University   (United States)

Author keywords

cloud; cost; high performance computing; turnaround time

Indexed keywords

CLOUDS; COST BENEFIT ANALYSIS; COST EFFECTIVENESS; TURNAROUND TIME;

COMMUNICATION OVERHEADS; COMPARATIVE STUDIES; HIGH PERFORMANCE CLUSTER; HIGH PERFORMANCE COMPUTING; HIGH PERFORMANCE COMPUTING (HPC); LAWRENCE LIVERMORE NATIONAL LABORATORIES; NATIONAL LABORATORY; PERFORMANCE AND APPLICATIONS;

COSTS;

EID: 84880064788     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2462902.2462919     Document Type: Conference Paper

References (36)

1. ASC purple benchmarks. https://asc. llnl.gov/computing-resources/purple/ archive/benchmarks/.
2. Futuregrid project. https://portal.futuregrid.org/.
3. Parallel workloads archive. http://www.cs.h- uji.ac.il/labs/parallel/ workload/.
4. Simple linux utility for resource management, faq. https://computing. llnl.gov/linux/slurm/faq. html#backfill.
5. ASC sequoia benchmarks. http://asc.llnl.gov/sequoia/benchmarks/, 2009.
6. Amazon. Amazon web service elastic compute cloud (EC2). http://aws.amazon.com/ec2.
7. D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, L. Dagum, R. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. Schreiber, H. D. Simon, V. Venkatakrishnan, and S. Weeratunga. The NAS parallel benchmarks-summary and preliminary results. In Supercomputing, Nov. 1991.
8. J. Brodkin. $1,279-per-hour, 30,000 core cluster built on Amazon EC2 cloud. http://arstechnica.com/business/news/2011/09/30000-core-cluster- built-on-amazon-ec2- cloud.ars, 2011.
9. R. Campbell, I. Gupta, M. Heath, S. Y. Ko, M. Kozuch, M. Kunze, T. Kwan, K. Lai, H. Y. Lee, M. Lyons, D. Milojicic, D. O'Hallaron, and Y. C. Soh. Open cirrus cloud computing testbed: federated data centers for open source systems and services research. In Hot Topics in Cloud Computing, 2009.
10. A. G. Carlyle, S. L. Harrell, and P. M. Smith. Cost-effective HPC: The community or the cloud? In IEEE International Conference on Cloud Computing Technology and Science, 2010.
11. J. Ekanayake and G. Fox. High performance parallel computing with clouds and cloud technologies. In Cloud Computing, pages 20-38. 2010.
12. Y. El-Khamra, H. Kim, S. Jha, and M. Parashar. Exploring the performance fluctuations of HPC workloads on clouds. In IEEE CloudCom, Nov. 2010.
13. R. R. Expósito, G. L. Taboada, S. Ramos, J. Touriño, and R. Doallo. Performance analysis of HPC applications in the cloud. Future Generation Computer Systems, pages 218-229, 2013.
14. M. Fenn, J. Holmes, and J. Nucciarone. A performance and cost analysis of the Amazon elastic compute cluster compute instance. http://rcc.its.psu.edu/ education/white-papers/cloud-report.pdf, 2011.
15. Y. Gong, B. He, and J. Zhong. An overview of CMPI: network performance aware MPI in the cloud. In ACM PPOPP, Feb 2012.
16. Q. He, S. Zhou, B. Kobler, D. Duffy, and T. McGlynn. Case study for running HPC applications in public clouds. In ACM HPDC, 2010.
17. Z. Hill and M. Humphrey. A quantitative analysis of high performance computing with Amazon's EC2 infrastructure: the death of the local cluster? In International Conf. on Grid Computing, Oct. 2009.
18. K. Z. Ibrahim, S. Hofmeyr, and C. Iancu. Characterizing the performance of parallel applications on multi-socket virtual machines. In IEEE/ACM CCGrid, 2011.
19. K. R. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. J. Wasserman, and N. J. Wright. Performance analysis of high performance computing applications on the Amazon web services cloud. In IEEE CloudCom, Nov. 2010.
20. G. A. Jehle and P. J. Reny. Advanced Microeconomic Theory. Prentice Hall, 2000.
21. D. Klusáček and H. Rudová. Alea 2 - job scheduling simulator. In SIMUTools, 2010.
22. S. H. Langer, B. Still, P.-T. Bremer, D. Hinkel, B. Langdon, J. Leviney, and E. Williams. Cielo full-system simulations of multi-beam laser-plasma interaction in NIF experiments. In Cray Users Group Meeting, May 2011.
23. A. Li, X. Yang, S. Kandula, and M. Zhang. CloudCmp: comparing public cloud providers. In IEEE Conference on Internet Measurement, 2010.
24. J. D. McCalpin. The STREAM benchmark. http://www.cs.virginia.edu/ ∼mccalpin/STREAM-Benchmark-2005-01- 25.pdf.
25. P. Mehrotra, J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff, S. Saini, and R. Biswas. Performance evaluation of Amazon EC2 for NASA HPC applications. In Workshop on Scientific Cloud Computing, 2012.
26. D. Nurmi, J. Brevik, and R. Wolski. Qbets: Queue bounds estimation from time series. In Wkshp on Job Scheduling Strategies for Parallel Processing, Jun 2007.
27. F. Petrini, D. J. Kerbyson, and S. Pakin. The case of the missing supercomputer performance: Achieving optimal performance on the 8,192 processors of ASCI Q. In Supercomputing, 2003.
28. F. Schatz, S. Koschnicke, N. Paulsen, C. Starke, and M. Schimmler. MPI performance analysis of Amazon EC2 cloud services for high performance computing. In Advances in Computing and Communications, pages 371-381. 2011.
29. D. Singh. personal communication, Mar. 2012.
30. K. E. Train. Discrete Choice Methods with Simulation. Cambridge University Press, 2009.
31. E. Walker. The real cost of a CPU hour. Computer, 42(4):35-41, 2009.
32. Wikipedia. Cloud computing. http://en.wikipedia.org/wiki/Cloud- computing.
33. Windows Azure Big Compute. http://www.windowsazure.com/en-us/home/ features/big- compute/.
34. K. Yelick, S. Coghlan, B. Draney, and R. S. Canon. The magellan report on cloud computing for science. science.energy.gov/∼/media/ascr/pdf/ programdocuments/docs/Magellan-Final-Report.pdf, December 2011.
35. L. Youseff, R. Wolski, B. Gorda, and C. Krintz. Evaluating the performance impact of Xen on MPI and process execution for HPC systems. In International Workshop on Virtualization Technology in Distributed Computing, 2006.
36. Y. Zhai, M. Liu, J. Zhai, X. Ma, andW. Chen. Cloud versus in-house cluster: evaluating amazon cluster compute instances for running MPI applications. In Supercomputing, Nov. 2011.