Understanding the Performance and Potential of Cloud Computing for Scientific Applications

IEEE Transactions on Cloud Computing

Volumn 5, Issue 2, 2017, Pages 358-371

  Sadooghi, Iman ^a   Hernandez Martin, Jesus ^a   Li, Tonglin ^a   Brandstatter, Kevin ^a   Maheshwari, Ketan ^c   Pitta De Lacerda Ruivo, Tiago Pais ^a   Garzoglio, Gabriele ^d   Timm, Steven ^d   Zhao, Yong ^b   Raicu, Ioan ^a  

^a Illinois Institute of Technology   (United States)

^b UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

^c ARGONNE NATIONAL LABORATORY   (United States)

^d FERMI NATIONAL ACCELERATOR LABORATORY   (United States)

Author keywords

Amazon AWS; Cloud computing; cloud costs; performance; scientific computing

Indexed keywords

CLOUD COMPUTING; COST BENEFIT ANALYSIS; COSTS; NATURAL SCIENCES COMPUTING;

AMAZON AWS; COMPREHENSIVE EVALUATION; DIFFERENT SERVICES; HIGH END COMPUTING; MONETARY COSTS; PERFORMANCE; SCIENTIFIC APPLICATIONS; SCIENTIFIC COMPUTING APPLICATIONS;

BENCHMARKING;

EID: 85027579403     PISSN: None     EISSN: 21687161     Source Type: Journal    
DOI: 10.1109/TCC.2015.2404821     Document Type: Article

References (36)

1. Amazon EC2 Instance Types, Amazon Web Services. (2013). [Online]. Available: Http://aws.amazon.com/ec2/instance-types/
2. Amazon Elastic Compute Cloud (Amazon EC2), Amazon Web Services. (2013). [Online]. Available: Http://aws.amazon.com/ec2/
3. Amazon Simple Storage Service (Amazon S3), Amazon Web Services. (2013). [Online]. Available: Http://aws.amazon.com/s3/
4. Iperf, Souceforge. (2011, Jun.). [Online]. Available: Http://sourceforge. net/projects/iperf/
5. A. Petitet, R. C. Whaley, J. Dongarra, and A. Cleary HPL, (netlib. org). (2008, Sep.). [Online]. Available: Http://www.netlib.org/benchmark/hpl/
6. J. J. Dongarra, S. W. Otto, M. Snir, and D. Walker, "An introduction to the MPI standard," Univ. of Tennessee, Knoxville, TN, USA, Tech. Rep. CS-95-274, Jan. 1995.
7. Release:Amazon EC2 on 2007-07-12,AmazonWeb Services. (2013). [Online]. Available: Http://aws.amazon.com/releasenotes/Amazon-EC2/3964
8. K. Yelick, S. Coghlan, B. Draney, and R. S. Canon, "The magellan report on cloud computing for science," US Dept. of Energy, Washington DC, USA, 2011, http://www.nersc.gov/assets/StaffPublications/2012/MagellanFinalReport.pdf
9. L. Ramakrishnan, R. S. Canon, K. Muriki, I. Sakrejda, and N. J. Wright, "Evaluating Interconnect and virtualization performance for high performance computing," ACM Perform. Eval. Rev., pp. 55-60,vol. 40, 2012.
10. P. Mehrotra J. Djomehri, S. Heistand, R. Hood, H. Jin, A. Laza-noff, S. Saini, and R. Biswas, "Performance evaluation of Amazon EC2 for NASA HPC applications," in Proc. 3rd Workshop Scientific Cloud Comput., 2012, pp. 41-50.
11. A. J. Younge, R. Henschel, J. T. Brown, G. von Laszewski, J. Qiu, and G. C. Fox, "Analysis of virtualization technologies for high performance computing environments," in Proc. IEEE 4th Int. Conf. Cloud Comput., 2011, pp. 9-16.
12. Y. Zhao, M. Hategan, B. Clifford, I. Foster, G. von Laszewski, I. Raicu, T. Stef-Praun, and M. Wilde, "Swift: Fast, reliable, loosely coupled parallel computation," in Proc. IEEE Int. Workshop Scientific Workflows, 2007, pp. 199-206.
13. I. Raicu, Z. Zhang, M. Wilde, I. Foster, P. Beckman, K. Iskra, B. Clifford, "Towards loosely-coupled programming on petascale systems," IEEE/ACM Supercomput., pp. 1-12, 2008.
14. S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema, "A performance analysis of EC2 cloud computing services for scientific computing," in Proc. 1st Int. Conf. Cloud Comput, 2009, pp. 115-131.
15. Q. He, S. Zhou, B. Kobler, D. Duffy, and T. McGlynn, "Case study for running HPC applications in public clouds," in Proc. 19th ACM Int. Symp. High Perform. Distrib. Comput., 2010, pp. 395-401.
16. G. Wang and T. S. Eugene Ng., "The Impact of virtualization on network performance of amazon EC2 data center," in Proc. IEEE 29th Conf. Inform. Commun., 2010, pp. 1163-1171.
17. S. L. Garfinkel, "An evaluation of amazon's grid computing services: Ec2, s3 and sqs," Comput. Sci. Group, Harvard Univ, Cambridge, MA, USA, Tech. Rep. tR-08-07, 2007.
18. K. R. Jackson, K. Muriki, L. Ramakrishnan, K. J. Runge, and R. C. Thomas, "Performance and cost analysis of the supernova factory on the amazon aws cloud," Scientific Programm., vol. 19, no. 2-3, pp. 107-119, 2011.
19. J.-S. Vockler, G. Juve, E. Deelman, M. Rynge, and G. B. Berriman, "Experiences using cloud computing for a scientific workflow application," in Proc. 2nd Workshop Scientific Cloud Comput., 2011, pp. 15-24.
20. L. Ramakrishnan, P. T. Zbiegel, S. Campbell, R. Bradshaw, R. S. Canon, S. Coghlan, I. Sakrejda, N. Desai, T. Declerck, and A. Liu, "Magellan: Experiences from a science cloud," in Proc. 2nd Int. Workshop Scientific Cloud Comput., 2011, pp. 49-58.
21. K. Jackson, L. Ramakrishnan, K. Muriki, S. Canon, S. Cholia, J. Shalf, H. Wasserman, and N. Wright, "Performance analysis of high performance computing applications on the Amazon web services cloud," in Proc. 2nd IEEE Int. Conf. Cloud Comput. Technol. Sci., 2010, pp. 159-168.
22. J.-S. Vockler, G. Juve, E. Deelman, M. Rynge, and G. B. Berriman, "Experiences using cloud computing for a scientific workflow application," in Proc. 2nd Workshop Scientific Cloud Comput., 2011, pp. 15-24.
23. J. Lange, K. Pedretti, P. Dinda, P. Bridges, C. Bae, P. Soltero, A. Merritt, "Minimal overhead virtualization of a large scale supercomputer," in Proc. 7th ACM SIGPLAN/SIGOPS Int. Conf. Virtual Execution Environ, 2011, pp. 169-180.
24. G. Juve, E. Deelman, G. B. Berriman, B. P. Berman, and P.Maechling, "An evaluation of the cost and performance of scientific workflows on amazon EC2," J.Grid Comput., vol. 10, no. 1, p. 5-21, 2012.
25. R. Fourer, D. M. Gay, and B. Kernighan, Algorithms and Model Formulations in Mathematical Programming. New York, NY, USA: Springer-Verlag , 1989, ch. AMPL: A mathematical programming language, pp. 150-151.
26. T. Li, X. Zhou, K. Brandstatter, D. Zhao, K. Wang, A. Rajendran, Z. Zhang, and I. Raicu, "ZHT: A light-weight reliable persistent dynamic scalable zero-hop distributed hash table," in Proc. IEEE 27th Int. Parallel Distrib. Process. Symp., 2013, pp. 775-787.
27. FermiCloud, Fermilab Computing Sector. (Apr. 2014). [Online]. Available: Http://fclweb.fnal.gov/
28. R. Moreno-vozmendiano, S. Montero, and I. Llorente, "IaaS cloud architecture: From virtualized datacenters to federated cloud infrastructures: Digital Forensics," IEEE Comput., vol. 45, no. 12, pp. 65-72, Dec. 2012.
29. K. Hwang, J. Dongarra, and G. C. Fox, Distributed and Cloud Computing: From Parallel Processing to the Internet of Things. San Mateo, CA, USA: Morgan Kaufmann, 2011
30. W. Voegels. (2012, Jan.). Amazon DynamoDB-a fast andscalable NoSQL database service designed for Internet-scale applications. [Online]. Available: Http://www.allthingsdistributed.com/2012/01/amazon-dynamodb.html
31. I. Sadooghi S. Palur, A. Anthony, I. Kapur, K. Ramamurty, K. Wang, and I. Raicu, "Achieving efficient distributed scheduling with message queues in the cloud for many-task computing and high-performance computing," in Proc. 14th IEEE/ACM Int. Symp. Cluster, Cloud Grid Comput., 2014, pp. 404-413.
32. T. L. Ruivo, G. B. Altayo, G. Garzoglio, S. Timm, K. Hyun, N. Seo-Young, and I. Raicu, "Exploring infiniband hardware virtualization in opennebula towards efficient high-performance computing," in Proc. 14th IEEE/ACM Int. Symp. Cluster, Cloud Grid Comput., 2014, pp. 943-948.
33. D. Macleod, (2013). OpenNebula KVM SR-IOV driver.
34. K. Maheshwari, K. Birman, J. Wozniak, and D. V. Zandt, "Evaluating cloud computing techniques for smart power grid design using parallel scripting," in Proc. 14th IEEE/ACM Int. Symp. Cluster, Cloud Grid Comput. 2013, pp. 319-326.
35. A. Gupta, L. Kale, F. Gioachin, V. March, C. Suen, P. Faraboschi, R. Kaufmann, and D. Milojicic, "The who, what, why and how of high performance computing applications in the cloud," HP Labs, Tech. Rep. HPL-2013-49, Jul. 2013.
36. E. Walker, "Benchmarking amazon EC2 for high-performance scientific computing," USENIX; Login: Mag., vol. 33, no. 5, pp. 18-23, Oct. 2008.