Performance analysis of high performance computing applications on the Amazon Web Services cloud

Proceedings - 2nd IEEE International Conference on Cloud Computing Technology and Science, CloudCom 2010

Volumn , Issue , 2010, Pages 159-168

  Jackson, Keith R ^a   Ramakrishnan, Lavanya ^a   Muriki, Krishna ^a   Canon, Shane ^a   Cholia, Shreyas ^a   Shalf, John ^a   Wasserman, Harvey J ^a   Wright, Nicholas J ^a  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

AMAZON EC2; AMAZON WEB SERVICES; COMPREHENSIVE EVALUATION; COMPUTE RESOURCES; COST-EFFECTIVE MEANS; HIGH-PERFORMANCE COMPUTING APPLICATIONS; LINUX CLUSTERS; PAY-AS-YOU-GO; PERFORMANCE ANALYSIS; REAL APPLICATIONS; SCIENTIFIC COMPUTING; SUPERCOMPUTING CENTERS; WEB APPLICATION;

COMPUTATION THEORY; COMPUTER OPERATING SYSTEMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; COMPUTER SYSTEMS; WEB SERVICES;

CLOUD COMPUTING;

EID: 79952426001     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CloudCom.2010.69     Document Type: Conference Paper

References (33)

1. S. Hazelhurst, "Scientific computing using virtual high-performance computing: a case study using the Amazon elastic computing cloud," in Proceedings of the 2008 annual research conference of the South African Institute of Computer Scientists and Information Technologists on IT research in developing countries: riding the wave of technology. ACM, 2008, pp. 94-103.
2. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good, "The cost of doing science on the cloud: the montage example," in Proceedings of the 2008 ACM/IEEE conference on Supercomputing. IEEE Press, 2008, pp. 1-12.
3. K. Keahey, R. Figueiredo, J. Fortes, T. Freeman, and M. Tsugawa, "Science clouds: Early experiences in cloud computing for scientific applications," Cloud Computing and Applications, vol. 2008, 2008.
4. K. Keahey, "Cloud Computing for Science," in Proceedings of the 21st International Conference on Scientific and Statistical Database Management. Springer-Verlag, 2009, p. 478.
5. J. Napper and P. Bientinesi, "Can cloud computing reach the top500?" in Proceedings of the combined workshops on UnConventional high performance computing workshop plus memory access workshop. ACM, 2009, pp. 17-20.
6. C. Evangelinos and C. Hill, "Cloud Computing for parallel Scientific HPC Applications: Feasibility of running Coupled Atmosphere-Ocean Climate Models on Amazons EC2." ratio, vol. 2, no. 2.40, pp. 2-34, 2008.
7. R. Masud, "High Performance Computing with Clouds."
8. S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, "An early performance analysis of cloud computing services for scientific computing," Delft University of Technology, Tech. Rep, 2008.
9. E. Walker, "Benchmarking amazon EC2 for high-performance scientific computing," USENIX Login, vol. 33, no. 5, pp. 18-23, 2008.
10. G. Wang and T. E. Ng, "The impact of virtualization on network performance of amazon ec2 data center," in Proceedings of IEEE INFOCOM, 2010.
11. L. Oliker, A. Canning, J. Carter, J. Shalf, and S. Ethier, "Scientific computations on modern parallel vector systems," in Proc. SC04: International Conference for High Performance Computing, Networking, Storage and Analysis, Pittsburgh, PA, Nov 6-12, 2004.
12. L. Oliker, J. Carter, M. Wehner et al., "Leading computational methods on scalar and vector HEC platforms," in Proc. SC05: International Conference for High Performance Computing, Networking, Storage and Analysis, Seattle, WA, Nov 12-18, 2005.
13. J. Carter, L. Oliker, and J. Shalf, "Performance evaluation of scientific applications on modern parallel vector systems," in VECPAR: High Performance Computing for Computational Science, Rio de Janeiro, Brazil, July 10-12, 2006.
14. L. Oliker, A. Canning, J. Carter et al., "Scientific application performance on candidate petascale platforms," in Proc. IEEE International Parallel & Distributed Processing Symposium (IPDPS), Long Beach, CA, Mar 26-30, 2007.
15. T. H. Dunigan Jr., J. S. Vetter, J. B. White III, and P. H. Worley, "Performance evaluation of the Cray X1 distributed shared-memory architecture," IEEE Micro, vol. 25(1), pp. 30-40, Jan/Feb 2005.
16. K. Nakajima, "Three-level hybrid vs. flat MPI on the earth simulator: Parallel iterative solvers for finite-element method," in Proc. 6th IMACS Symposium Iterative Methods in Scientific Computing, vol. 6, Denver, CO, Mar 27-30, 2003.
17. J. Vetter, S. Alam, T. Dunigan, Jr. et al., "Early evaluation of the Cray XT3," in Proc. IEEE International Parallel & Distributed Processing Symposium (IPDPS), Rhodes Island, Greece, April 25-29, 2006.
18. F. Gygi, E. W. Draeger, B. R. de Supinski et al., "Large-scale first-principles molecular dynamics simulations on the BlueGene/L platform using the Qbox code," in Proc. SC05: International Conference for High Performance Computing, Networking, Storage and Analysis, Seattle, WA, Nov 12-18, 2005.
19. D. Skinner, "Integrated Performance Monitoring: A portable profiling infrastructure for parallel applications," in Proc. ISC2005: International Supercomputing Conference, Heidelberg, Germany, 2005.
20. M. Palankar, A. Iamnitchi, M. Ripeanu, and S. Garfinkel, "Amazon S3 for science grids: a viable solution?" in Proceedings of the 2008 international workshop on Data-aware distributed computing. ACM, 2008, pp. 55-64.
21. K. Keahey, T. Freeman, J. Lauret, and D. Olson, "Virtual workspaces for scientific applications," in Journal of Physics: Conference Series, vol. 78. Institute of Physics Publishing, 2007, p. 012038.
22. L. Ramakrishnan, K. R. Jackson, S. Canon, S. Cholia, and J. Shalf, "Defining Future Platform Requirements for e-Science Clouds," in Proceedings of the ACM Symposium on Cloud Computing (SoCCi). ACM, 2010.
23. J. Li, D. Agarwal, M. Humphrey, C. van Ingen, K. Jackson, and Y. Ryu, "eScience in the Cloud: A MODIS Satellite Data Reprojection and Reduction Pipeline in the Windows Azure Platform," in Proceedings of the 24th IEEE International Parallel and Distributed Processing Symposium (IPDPS 2010), Atlanta, GA, April 19-23, 2010.
24. J. Rehr, F. Vila, J. Gardner, L. Svec, and M. Prange, "Scientific computing in the cloud," Computing in Science and Engineering, vol. 99, no. PrePrints, 2010.
25. I. Foster, T. Freeman, K. Keahey, D. Scheftner, B. Sotomayor, and X. Zhang, "Virtual clusters for grid communities," in Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid. Citeseer, 2006, pp. 513-520.
26. "Amazon Elastic Block Store," http://aws.amazon.com/ebs/.
27. W. Kramer, J. Shalf, and E. Strohmaier, "The NERSC Sustained System Performance (SSP) Metric," 2005.
28. K. Antypas, J. M. Shalf, and H. Wasserman, "NERSC-6 workload analysis and benchmark selection process," LBNL, Tech. Rep., 2008.
29. "CAM3.1," http://www.ccsm.ucar.edu/models/atm-cam/.
30. "Community Atmopshere Model," http://www.cgd.ucar.edu/csm/ models.atm-cam.
31. W. W. Lee, "Gyrokinetic particle simulation model," J. Comp. Phys., vol. 72, 1987.
32. "HPCC benchmark web page: http://icl.cs.utk.edu/hpcc/."
33. N. J. Wright, W. Pfeiffer, and A. Snavely, "Characterizing parallel scaling of scientific applications using IPM," in The 10th LCI International Conference on High-Performance Clustered Computing, March 10-12, 2009.