The who, what, why, and how of high performance computing in the cloud

Proceedings of the International Conference on Cloud Computing Technology and Science, CloudCom

Volumn 1, Issue , 2013, Pages 306-314

  Gupta, Abhishek ^a   Kale, Laxmikant V ^a   Gioachin, Filippo ^b   March, Verdi ^b   Suen, Chun Hui ^b   Lee, Bu Sung ^b   Faraboschi, Paolo ^b   Kaufmann, Richard ^b   Milojicic, Dejan ^b  

^a UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^b HEWLETT PACKARD LABORATORIES   (United States)

Author keywords

Cloud; Economics; HPC; Performance Analysis

Indexed keywords

CLOUD COMPUTING; CLOUDS; ECONOMICS; SUPERCOMPUTERS; VIRTUAL REALITY;

BUSINESS MODELS; COMPREHENSIVE PERFORMANCE EVALUATION; ECONOMIC ASPECTS; HETEROGENEOUS RESOURCES; HIGH-PERFORMANCE COMPUTING; HPC; PERFORMANCE ANALYSIS; VIRTUALIZATIONS;

BENCHMARKING;

EID: 84899744782     PISSN: 23302194     EISSN: 23302186     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2013.47     Document Type: Conference Paper

References (40)

1. "Magellan Final Report," U.S. Department of Energy (DOE), Tech. Rep., 2011.
2. E. Walker, "Benchmarking Amazon EC2 for high-performance scientific computing," LOGIN, pp. 18-23, 2008.
3. P. Mehrotra, J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Lazanoff, S. Saini, and R. Biswas, "Performance Evaluation of Amazon EC2 for NASA HPC applications," in Proceedings of the 3rd workshop on Scientific Cloud Computing, ser. ScienceCloud '12. New York, NY, USA: ACM, 2012, pp. 41-50.
4. K. R. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. J. Wasserman, and N. J. Wright, "Performance Analysis of High Performance Computing Applications on the Amazon Web Services Cloud," in CloudCom'10, 2010.
5. "High Performance Computing (HPC) on AWS," http://aws.amazon. com/hpc-applications.
6. C. Evangelinos and C. N. Hill, "Cloud Computing for parallel Scientific HPC Applications: Feasibility of Running Coupled Atmosphere-Ocean Climate Models on Amazon's EC2." Cloud Computing and Its Applications, Oct. 2008.
7. A. Iosup, S. Ostermann, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, "Performance Analysis of Cloud Computing Services for Many-Tasks Scientific Computing," IEEE Trans. Parallel Distrib. Syst., vol. 22, pp. 931-945, June 2011.
8. J. Napper and P. Bientinesi, "Can Cloud Computing reach the Top500" ser. UCHPC-MAW '09. ACM, 2009.
9. A. Gupta and D. Milojicic, "Evaluation of HPC Applications on Cloud," in Open Cirrus Summit (Best Student Paper), Atlanta, GA, Oct. 2011, pp. 22-26. [Online]. Available: http://dx.doi.org/10.1109/OCS.2011.10
10. "Ranger User Guide," http://services.tacc.utexas.edu/index.php/ ranger-user-guide.
11. A. I. Avetisyan et al., "Open Cirrus: A Global Cloud Computing Testbed," Computer, vol. 43, pp. 35-43, April 2010.
12. D. Nurmi et al., "The Eucalyptus Open-source Cloud-computing System," in Proceedings of Cloud Computing and Its Applications, Oct. 2008.
13. "KVM-Kernel-based Virtual Machine," Redhat, Inc., Tech. Rep., 2009.
14. A. J. Younge, R. Henschel, J. T. Brown, G. von Laszewski, J. Qiu, and G. C. Fox, "Analysis of Virtualization Technologies for High Performance Computing Environments," Cloud Computing, IEEE International Conference on, vol. 0, pp. 9-16, 2011.
15. D. Schauer et al., "Linux containers version 0.7.0," June 2010, http://lxc.sourceforge.net/.
16. "Intel(r) Virtualization Technology for Directed I/O," Intel Corporation, Tech. Rep., Feb 2011, http://download.intel.com/technology/ computing/vptech/Intel(r) VT for Direct IO.pdf.
17. "MPI: A Message Passing Interface Standard," in M. P. I. Forum, 1994.
18. L. Kale and S. Krishnan, "Charm++: A portable concurrent object oriented system based on C++," in Proceedings of the Conference on Object Oriented Programming Systems, Languages and Applications, September 1993.
19. "NPB," http://www.nas.nasa.gov/Resources/Software/npb.html.
20. A. Bhatele et al., "Overcoming Scaling Challenges in Biomolecular Simulations across Multiple Platforms," in IPDPS 2008.
21. P. Jetley, F. Gioachin, C. Mendes, L. V. Kale, and T. R. Quinn, "Massively Parallel Cosmological Simulations with ChaNGa," in IPDPS 2008, 2008, pp. 1-12.
22. "The ASCII Sweep3D code," http://wwwc3.lanl.gov/pal/software/ sweep3d.
23. M. Koop, T. Jones, and D. Panda, "MVAPICH-Aptus: Scalable highperformance multi-transport MPI over InfiniBand," in Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, april 2008, pp. 1-12.
24. E. Gabriel et al., "Open MPI: Goals, Concept, and Design of a Next Generation MPI Implementation," in Proc. of 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, 2004.
25. L. Kaĺe and A. Sinha, "Projections : A Scalable Performance Tool," in Parallel Systems Fair, International Parallel Processing Sympos ium, Apr. 1993, pp. 108-114.
26. The CONVERSE programming language manual, Department of Computer Science,University of Illinois at Urbana-Champaign, Urbana, IL, 2006.
27. T. Hoefler, T. Mehlan, A. Lumsdaine, and W. Rehm, "Netgauge: A Network Performance Measurement Framework," in Proceedings of High Performance Computing and Communications, HPCC'07.
28. T. Hoefler, T. Schneider, and A. Lumsdaine, "Characterizing the Influence of System Noise on Large-Scale Applications by Simulation," in Supercomputing 10, Nov. 2010.
29. J. Lange, K. Pedretti, T. Hudson, P. Dinda, Z. Cui, L. Xia, P. Bridges, A. Gocke, S. Jaconette, M. Levenhagen, and R. Brightwell, "Palacios and Kitten: New High Performance Operating Systems for Scalable Virtualized and Native Supercomputing," ser. IPDPS '10, pp. 1-12.
30. B. Kocoloski, J. Ouyang, and J. Lange, "A case for dual stack virtualization: consolidating HPC and commodity applications in the cloud," ser. SoCC '12, New York, NY, USA, 2012, pp. 23:1-23:7.
31. C. Bischof, D. anMey, and C. Iwainsky, "Brainware for Green HPC," Computer Science-Research and Development, pp. 1-7, 2011. [Online]. Available: http://dx.doi.org/10.1007/s00450-011-0198-5
32. A. Gupta et al., "Exploring the Performance and Mapping of HPC Applications to Platforms in the cloud," in HPDC '12. New York, NY, USA: ACM, 2012, pp. 121-122.
33. A. Gupta et al, "The Who, What, Why and How of High Performance Computing Applications in the Cloud," HP Labs, Tech. Rep., 2013. [Online]. Available: http://www.hpl.hp.com/techreports/2013/HPL-2013-49.html
34. "Amazon Elastic Compute Cloud (Amazon EC2)," http://aws.amazon.com/ec2.
35. Q. He, S. Zhou, B. Kobler, D. Duffy, and T. McGlynn, "Case Study for Running HPC Applications in Public Clouds," ser. HPDC '10. ACM, 2010.
36. J. Ekanayake, X. Qiu, T. Gunarathne, S. Beason, and G. C. Fox, High Performance Parallel Computing with Clouds and Cloud Technologies, 07/2010 2010.
37. A. Kudryavtsev, V. Koshelev, B. Pavlovic, and A. Avetisyan, "Virtualizing HPC Applications using Modern Hypervisors," in Proceedings of the 2012 workshop on Cloud services, federation, and the 8th open cirrus summit, ser. FederatedClouds '12. New York, NY, USA: ACM, 2012, pp. 7-12. [Online]. Available: http://doi.acm.org/10.1145/2378975.2378978
38. H. Kim, Y. el Khamra, I. Rodero, S. Jha, and M. Parashar, "Autonomic Management of Application Workflows on Hybrid Computing Infrastructure," Scientific Programming, vol. 19, no. 2, pp. 75-89, Jan. 2011.
39. E. Roloff, M. Diener, A. Carissimi, and P. Navaux, "High Performance Computing in the Cloud: Deployment, Performance and Cost Efficiency," in CloudCom 2012, 2012, pp. 371-378.
40. A. Marathe, R. Harris, D. K. Lowenthal, B. R. de Supinski, B. Rountree, M. Schulz, and X. Yuan, "A Comparative Study of High-performance Computing on the Cloud," ser. HPDC '13. New York, NY, USA: ACM, 2013, pp. 239-250.