The who, what, why and how of high performance computing applications in the cloud

HP Laboratories Technical Report

Volumn , Issue 49, 2013, Pages

  Gupta, Abhishek ^a   Kale, Laxmikant V ^a   Gioachin, Filippo ^b   March, Verdi ^b   Suen, Chun Hui ^b   Lee, Bu Sung ^b   Faraboschi, Paolo ^b   Kaufmann, Richard ^b   Milojicic, Dejan ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Applications; Cloud; Economics; High performance computing; Performance evaluation; Supercomputers

Indexed keywords

CLOUD DEPLOYMENTS; COMMODITY CLUSTERS; COMPREHENSIVE PERFORMANCE EVALUATION; HETEROGENEOUS RESOURCES; HIGH PERFORMANCE COMPUTING; HIGH-PERFORMANCE COMPUTING APPLICATIONS; PERFORMANCE BOTTLENECKS; PERFORMANCE EVALUATION;

APPLICATIONS; CLOUDS; ECONOMICS; SUPERCOMPUTERS; VIRTUAL REALITY;

BENCHMARKING;

EID: 84881092160     PISSN: None     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (36)

1. "Magellan Final Report," U.S. Department of Energy (DOE), Tech. Rep., 2011.
2. E. Walker, "Benchmarking Amazon EC2 for high-performance scientific computing," LOGIN, pp. 18-23, 2008.
3. P. Mehrotra, J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff, S. Saini, and R. Biswas, "Performance Evaluation of Amazon EC2 for NASA HPC applications," in Proceedings of the 3rd workshop on Scientific Cloud Computing, ser. ScienceCloud '12. New York, NY, USA: ACM, 2012, pp. 41-50.
4. K. R. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. J. Wasserman, and N. J. Wright, "Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud," in CloudCom'10, 2010.
5. "MagellanArgonne's DoE Cloud Computing," http://magellan.alcf. anl. gov.
6. "High Performance Computing (HPC) on AWS," http://aws.amazon. com/hpc-Applications.
7. C. Evangelinos and C. N. Hill, "Cloud Computing for parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere-Ocean Climate Models on Amazon's EC2." Cloud Computing and Its Applications, Oct. 2008.
8. A. Iosup, S. Ostermann, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, "Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing," IEEE Trans. Parallel Distrib. Syst., vol. 22, pp. 931-945, June 2011.
9. J. Napper and P. Bientinesi, "Can Cloud Computing reach the Top500?" ser. UCHPC-MAW '09. ACM, 2009.
10. A. Gupta and D. Milojicic, "Evaluation of HPC Applications on Cloud," in Open Cirrus Summit (Best Student Paper), Atlanta, GA, Oct. 2011, pp. 2226. [Online]. Available: http://dx.doi.org/10.1109/OCS.2011.10
11. "Amazon Elastic Compute Cloud (Amazon EC2)," http://aws.amazon.com/ec2.
12. Q. He, S. Zhou, B. Kobler, D. Duffy, and T. McGlynn, "Case Study for Running HPC Applications in Public Clouds," ser. HPDC '10. ACM, 2010.
13. J. Ekanayake, X. Qiu, T. Gunarathne, S. Beason, and G. C. Fox, High Performance Parallel Computing with Clouds and Cloud Technologies, 07/2010 2010.
14. H. Kim, Y. el Khamra, I. Rodero, S. Jha, and M. Parashar, "Autonomic Management of Application Workflows on Hybrid Computing Infrastructure," Scientific Programming, vol. 19, no. 2, pp. 75-89, Jan. 2011.
15. "Ranger User Guide," http://services.tacc.utexas.edu/index.php/ ranger-user-guide.
16. Infiniband Trade Association, "Infiniband Architecture Specification, Release 1.0," Tech. Rep. RC23077, October (2004
17. A. I. Avetisyan et al., "Open Cirrus: A Global Cloud Computing Testbed," Computer, vol. 43, pp. 35-43, April 2010.
18. D. Nurmi et al., "The Eucalyptus Open-source Cloud-computing System," in Proceedings of Cloud Computing and Its Applications, Oct. 2008.
19. "KVMKernel-based Virtual Machine," Redhat, Inc., Tech. Rep., 2009.
20. A. J. Younge, R. Henschel, J. T. Brown, G. von Laszewski, J. Qiu, and G. C. Fox, "Analysis of Virtualization Technologies for High Performance Computing Environments," Cloud Computing, IEEE International Conference on, vol. 0, pp. 9-16, 2011.
21. D. Schauer et al., "Linux containers version 0.7.0," June 2010, http://lxc.sourceforge.net/.
22. "Intel(r) Virtualization Technology for Directed I/O," Intel Corporation, Tech. Rep., Feb 2011, http://download.intel.com/technology/ computing/vptech/Intel(r) VT for Direct IO.pdf.
23. "MPI: A Message Passing Interface Standard," in M. P. I. Forum, 1994.
24. L. Kale and S. Krishnan, "Charm++: A portable concurrent object oriented system based on C++," in Proceedings of the Conference on Object Oriented Programming Systems, Languages and Applications, September 1993.
25. "NPB," http://www.nas.nasa.gov/Resources/Software/npb.html.
26. A. Bhatele et al., "Overcoming Scaling Challenges in Biomolecular Simulations across Multiple Platforms," in IPDPS 2008.
27. P. Jetley, F. Gioachin, C. Mendes, L. V. Kale, and T. R. Quinn, "Massively Parallel Cosmological Simulations with ChaNGa," in IPDPS 2008, 2008, pp. 1-12.
28. "The ASCII Sweep3D code," http://wwwc3.lanl.gov/pal/software/ sweep3d.
29. Y. Yoon, J. C. Browne, M. Crocker, S. Jain, and N. Mahmood, "Productivity and Performance through Components: the ASCI Sweep3D Application: Research Articles," Concurrency and Computation: Practice and Experience, vol. 19, no. 5, pp. 721-742, 2007.
30. M. Koop, T. Jones, and D. Panda, "MVAPICH-Aptus: Scalable highperformance multi-Transport MPI over InfiniBand," in Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, april 2008, pp. 112.
31. E. Gabriel et al., "Open MPI: Goals, Concept, and Design of a Next Generation MPI Implementation," in Proc. of 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, 2004.
32. L. Kaĺe and A. Sinha, "Projections : A Scalable Performance Tool," in Parallel Systems Fair, International Parallel Processing Sympos ium, Apr. 1993, pp. 108-114.
33. The CONVERSE programming language manual, Department of Computer Science,University of Illinois at Urbana-Champaign, Urbana, IL, 2006.
34. T. Hoefler, T. Mehlan, A. Lumsdaine, and W. Rehm, "Netgauge: A Network Performance Measurement Framework," in Proceedings of High Performance Computing and Communications, HPCC'07.
35. T. Hoefler, T. Schneider, and A. Lumsdaine, "Characterizing the Influence of System Noise on Large-Scale Applications by Simulation," in Supercomputing 10, Nov. 2010.
36. C. Bischof, D. anMey, and C. Iwainsky, "Brainware for Green HPC," Computer ScienceResearch and Development, pp. 1-7, 2011. [Online]. Available: http://dx.doi.org/10.1007/s00450-011-0198-5