HPC cloud for scientific and business applications: Taxonomy, vision, and research challenges

ACM Computing Surveys

Volumn 51, Issue 1, 2018, Pages

  Netto, Marco A S ^a   Calheiros, Rodrigo N ^b   Rodrigues, Eduardo R ^a   Cunha, Renato L F ^a   Buyya, Rajkumar ^c  

^a IBM RESEARCH   (United States)

^b UNIVERSITY OF WESTERN SYDNEY   (Australia)

^c UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Advisory systems; Big data; Charging models; High performance computing; HPC cloud; Parallel applications; Resource allocation

Indexed keywords

BIG DATA; COST BENEFIT ANALYSIS; DISTRIBUTED COMPUTER SYSTEMS; ECONOMICS; RESOURCE ALLOCATION; TAXONOMIES;

ADVISORY SYSTEMS; CHARGING MODELS; HIGH PERFORMANCE COMPUTING; HPC CLOUDS; PARALLEL APPLICATION;

TANTALUM COMPOUNDS;

EID: 85040654697     PISSN: 03600300     EISSN: 15577341     Source Type: Journal    
DOI: 10.1145/3150224     Document Type: Article

References (126)

1. Martín Abadi, Paul Barham, Jianmin Chen, Zhifeng Chen, Andy Davis, Jeffrey Dean, Matthieu Devin, et al. 2016. TensorFlow: A system for large-scale machine learning. In Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI’16). 265–283.
2. Moustafa AbdelBaky, Javier Diaz-Montes, Michael Johnston, Vipin Sachdeva, Richard L. Anderson, Kirk E. Jordan, and Manish Parashar. 2014. Exploring HPC-based scientific software as a service using CometCloud. In Proceedings of the International Conference on Collaborative Computing: Networking, Applications, and Worksharing (CollaborateCom’14). IEEE, Los Alamitos, CA, 35–44.
3. Moustafa AbdelBaky, Manish Parashar, Kirk Jordan, Hyunjoo Kim, Hani Jamjoom, Zon-Yin Shae, Gergina Pencheva, et al. 2012. Enabling high-performance computing as a service. Computer 45, 10, 72–80.
4. Amazon. 2017a. Amazon Web Services. Retrieved December 5, 2017, from https://aws.amazon.com.
5. Amazon. 2017b. Amazon Web Services (HPC). Retrieved December 5, 2017, from https://aws.amazon.com/hpc/.
6. Michael Armbrust, Armando Fox, Rean Griffith, Anthony D. Joseph, Randy Katz, Andy Konwinski, Gunho Lee, et al. 2010. A view of cloud computing. Communications of the ACM 53, 4, 50–58.
7. J. P. Ashwini, C. Divya, and H. A. Sanjay. 2013. Efficient resource selection framework to enable cloud for HPC applications. In Proceedings of the 4th International Conference on Computer and Communication Technology (ICCCT’13). IEEE, Los Alamitos, CA, 34–38.
8. Marcos D. Assunção, Rodrigo N. Calheiros, Silvia Bianchi, Marco A. S. Netto, and Rajkumar Buyya. 2015. Big data computing and clouds: Trends and future directions. Journal of Parallel and Distributed Computing 79, 3–15.
9. Rocco Aversa, Beniamino Di Martino, Massimiliano Rak, Salvatore Venticinque, and Umberto Villano. 2011. Performance prediction for HPC on clouds. In Cloud Computing: Principles and Paradigms. Wiley, 437–456.
10. Ammar Ahmad Awan, Khaled Hamidouche, Jahanzeb Maqbool Hashmi, and Dhabaleswar K. Panda. 2017. S-Caffe: Co-designing MPI runtimes and Caffe for scalable deep learning on modern GPU clusters. In Proceedings of the 22nd ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. ACM, New York, NY, 193–205.
11. Mehdi Bahrami and Mukesh Singhal. 2015. The Role of Cloud Computing Architecture in Big Data. Springer International Publishing, 275–295.
12. David H. Bailey, Eric Barszcz, John T. Barton, David S. Browning, Robert L. Carter, Leonardo Dagum, Rod A. Fatoohi, et al. 1991. The NAS parallel benchmarks. International Journal of Supercomputing Applications 5, 3, 63–73.
13. Bartosz Balis, Kamil Figiela, Konrad Jopek, Maciej Malawski, and Maciej Pawlik. 2017. Porting HPC applications to the cloud: A multi-frontal solver case study. Journal of Computational Science 18, 106–116.
14. Denilson Barbosa, Ioana Manolescu, and Jeffrey Xu Yu. 2009. Microbenchmark. In Encyclopedia of Database Systems, L. Liu and T. Ozsu (Eds.). Springer, Boston, MA, 1737.
15. Mohamed Ben Belgacem and Bastien Chopard. 2015. A hybrid HPC/cloud distributed infrastructure: Coupling EC2 cloud resources with HPC clusters to run large tightly coupled multiscale applications. Future Generation Computer Systems 42, 11–21.
16. G. Bruce Berriman, Gideon Juve, Ewa Deelman, Moira Regelson, and Peter Plavchan. 2010. The application of cloud computing to astronomy: A study of cost and performance. In Proceedings of the IEEE International Conference on e-Science. IEEE, Los Alamitos, CA.
17. Onkar Bhardwaj and Guojing Cong. 2016. Practical efficiency of asynchronous stochastic gradient descent. In Proceedings of the Workshop on Machine Learning in High Performance Computing Environments. IEEE, Los Alamitos, CA, 56–62.
18. N. J. Boden, D. Cohen, R. E. Felderman, A. E. Kulawik, C. L. Seitz, J. N. Seizovic, and Wen-King Su. 1995. Myrinet: A gigabit-per-second local area network. IEEE Micro 15, 1, 29–36.
19. Julian Borrill, Jonathan Carter, Leonid Oliker, David Skinner, and Rupak Biswas. 2005. Integrated performance monitoring of a cosmology application on leading HEC platforms. In Proceedings of the International Conference on Parallel Processing. IEEE, Los Alamitos, CA, 119–128.
20. Chris Bunch, Navraj Chohan, Chandra Krintz, and Khawaja Shams. 2011. Neptune: A domain specific language for deploying HPC software on cloud platforms. In Proceedings of the 2nd International Workshop on Scientific Cloud Computing. ACM, New York, NY, 59–68.
21. Rajkumar Buyya. 1999. High Performance Cluster Computing. Prentice Hall, Upper Saddle River, NJ.
22. Rajkumar Buyya and Diana Barreto. 2015. Multi-cloud resource provisioning with Aneka: A unified and integrated utili-sation of Microsoft Azure and Amazon EC2 instances. In Proceedings of the International Conference on Computing and Network Communications (CoCoNet’15). IEEE, Los Alamitos, CA.
23. Rajkumar Buyya, Chee Shin Yeo, Srikumar Venugopal, James Broberg, and Ivona Brandic. 2009. Cloud computing and emerging IT platforms: Vision, hype, and reality for delivering computing as the 5th utility. Future Generation Computer Systems 25, 6, 599–616.
24. Adam G. Carlyle, Stephen L. Harrell, and Preston M. Smith. 2010. Cost-effective HPC: The community or the cloud? In Proceedings of the International Conference on Cloud Computing Technology and Science (CloudCom’10). IEEE, Los Alamitos, CA, 169–176.
25. Henri Casanova, Arnaud Legrand, Dmitrii Zagorodnov, and Francine Berman. 2000. Heuristics for scheduling parameter sweep applications in grid environments. In Proceedings of the 9th Heterogeneous Computing Workshop. IEEE, Los Alamitos, CA, 349–363.
26. Brent Chun, David Culler, Timothy Roscoe, Andy Bavier, Larry Peterson, Mike Wawrzoniak, and Mic Bowman. 2003. PlanetLab: An overlay testbed for broad-coverage services. SIGCOMM Computer Communication Review 33, 3, 3–12.
27. Phillip Church and Andrzej Goscinski. 2011. IaaS clouds vs. clusters for HPC: A performance study. In Proceedings of the International Conference on Cloud Computing, GRIDs, and Virtualization.
28. Philip Church, Andrzej Goscinski, and Christophe Lefvre. 2015. Exposing HPC and sequential applications as services through the development and deployment of a SaaS cloud. Future Generation Computer Systems 4344, 0, 24–37.
29. Philip Church, Adam Wong, Michael Brock, and Andrzej Goscinski. 2012. Toward exposing and accessing HPC applications in a SaaS cloud. In Proceedings of the International Conference on Web Services (ICWS’12). IEEE, Los Alamitos, CA, 692–699.
30. Philip C. Church and Andrzej M. Goscinski. 2014. A survey of cloud-based service computing solutions for mammalian genomics. IEEE Transactions on Services Computing 7, 4, 726–740.
31. Adam Coates, Brody Huval, Tao Wang, David J. Wu, Bryan Catanzaro, and Andrew Y. Ng. 2013. Deep learning with COTS HPC systems. In Proceedings of the 30th International Conference on Machine Learning.
32. Renato L. F. Cunha, Eduardo R. Rodrigues, Leonardo P. Tizzei, and Marco A. S. Netto. 2017. Job placement advisor based on turnaround predictions for HPC hybrid clouds. Future Generation Computer Systems 67, 35–46.
33. Rodrigo da Rosa Righi, Vinicius Facco Rodrigues, Cristiano André da Costa, Guilherme Galante, Luis Carlos Erpen De Bona, and Tiago Ferreto. 2016. Autoelastic: Automatic resource elasticity for high performance applications in the cloud. IEEE Transactions on Cloud Computing 4, 1, 6–19.
34. Marcos Dias de Assuncao, Alexandre di Costanzo, and Rajkumar Buyya. 2009. Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters. In Proceedings of the 18th ACM International Symposium on High Performance Distributed Computing.
35. Daniel de Oliveira, Eduardo Ogasawara, Fernanda Baião, and Marta Mattoso. 2010. SciCumulus: A lightweight cloud middleware to explore many task computing paradigm in scientific workflows. In Proceedings of the 2010 IEEE 3rd International Conference on Cloud Computing (CLOUD’10). IEEE, Los Alamitos, CA, 378–385.
36. Jeffrey Dean and Sanjay Ghemawat. 2008. MapReduce: Simplified data processing on large clusters. Communications of the ACM 51, 1, 107–113.
37. Jack J. Dongarra, Piotr Luszczek, and Antoine Petitet. 2003. The LINPACK benchmark: Past, present and future. Concurrency and Computation: Practice and Experience 15, 9, 803–820.
38. Ifeanyi P. Egwutuoha, Shiping Chen, David Levy, and Rafael Calvo. 2013. Cost-effective cloud services for HPC in the cloud: The IaaS or the HaaS? In Proceedings of the International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’13). 217.
39. Jaliya Ekanayake and Geoffrey Fox. 2009. High performance parallel computing with clouds and cloud technologies. In Proceedings of the International Conference on Cloud Computing. 20–38.
40. Huston Eubank. 2003. Design Recommendations for High Performance Data Centers. Rocky Mountain Institute.
41. C. Evangelinos and C. Hill. 2008. Cloud computing for parallel scientific HPC applications: Feasibility of running coupled atmosphere-ocean climate models on Amazon’s EC2. In Proceedings of the Workshop on Cloud Computing and Its Applications (CCA’08).
42. Roberto R. Expósito, Guillermo L. Taboada, Sabela Ramos, Juan Touriño, and Ramón Doallo. 2013. Performance analysis of HPC applications in the cloud. Future Generation Computer Systems 29, 1, 218–229.
43. Pei Fan, Zhenbang Chen, Ji Wang, Zibin Zheng, and Michael R. Lyu. 2012. Topology-aware deployment of scientific applications in cloud computing. In Proceedings of the International Conference on Cloud Computing (CLOUD’12).
44. Pei Fan, Zhenbang Chen, Ji Wang, Zibin Zheng, and Michael R. Lyu. 2014. A topology-aware method for scientific application deployment on cloud. International Journal of Web and Grid Services 10, 4, 338–370.
45. Dror G. Feitelson, Larry Rudolph, Uwe Schwiegelshohn, Kenneth C. Sevcik, and Parkson Wong. 1997. Theory and practice in parallel job scheduling. In Proceedings of the International Workshop on Job Scheduling Strategies for Parallel Processing.
46. Wes Felter, Alexandre Ferreira, Ram Rajamony, and Juan Rubio. 2015. An updated performance comparison of virtual machines and Linux containers. In Proceedings of the 2015 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS’15). IEEE, Los Alamitos, CA, 171–172.
47. Ian Foster and Carl Kesselman. 2003. The Grid 2: Blueprint for a New Computing Infrastructure. Elsevier.
48. Ian Foster, Carl Kesselman, and Steven Tuecke. 2001. The anatomy of the grid: Enabling scalable virtual organizations. International Journal of High Performance Computing Applications 15, 3, 200–222.
49. Guilherme Galante, Luis Carlos Erpen De Bona, Antonio Roberto Mury, Bruno Schulze, and Rodrigo da Rosa Righi. 2016. An analysis of public clouds elasticity in the execution of scientific applications: A survey. Journal of Grid Computing 14, 2, 193–216.
50. Holger Gantikow, Christoph Reich, Martin Knahl, and Nathan Clarke. 2015. A taxonomy for HPC-aware cloud computing. In Proceedings of the BW-CAR Symposium on Information and Communication Systems (SinCom’15).
51. General Accountability Office. 2013. GAO Protest Decision B-407073.3. Retrieved December 5, 2017, from http://www.gao.gov/assets/660/655241.pdf.
52. Wolfgang Gentzsch and Burak Yenier. 2013. The UberCloud HPC Experiment: Compendium of Case Studies. Technical Report. Tabor Communications Inc. https://www.theubercloud.com/wp-content/uploads/2013/11/The_UberCloud_Compendium_2013_rnd2t3.pdf.
53. Wolfgang Gentzsch and Burak Yenier. 2014. The UberCloud Experiment: Technical Computing in the Cloud—2nd Compendium of Case Studies. Technical Report. Tabor Communications Inc. http://www.theubercloud.com/wp- content/uploads/2014/ 06/The_UberCloud_Compendium_2014_rnd1j6.pdf.
54. Giulio Giunta, Raffaele Montella, Giuseppe Agrillo, and Giuseppe Coviello. 2010. A GPGPU transparent virtualization component for high performance computing clouds. In Proceedings of the European Conference on Parallel Processing.
55. William Gropp, Ewing Lusk, Nathan Doss, and Anthony Skjellum. 1996. A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22, 6, 789–828.
56. William Gropp, Ewing Lusk, and Anthony Skjellum. 1999. Using MPI: Portable Parallel Programming With the Message-Passing Interface. Vol. 1. MIT Press, Cambridge, MA.
57. Abhishek Gupta, Paolo Faraboschi, Filippo Gioachin, Laxmikant V. Kale, Richard Kaufmann, B.-S. Lee, Verdi March, Dejan Milojicic, and Chun Hui Suen. 2014. Evaluating and improving the performance and scheduling of HPC applications in cloud. IEEE Transactions on Cloud Computing 4, 3, 308–320.
58. Abhishek Gupta, Laxmikant V. Kale, Filippo Gioachin, Verdi March, Chun Hui Suen, Bu-Sung Lee, Paolo Faraboschi, Richard Kaufmann, and Dejan Milojicic. 2013a. The who, what, why and how of high performance computing applications in the cloud. In Proceedings of the 5th IEEE International Conference on Cloud Computing Technology and Science (CloudCom’13).
59. Abhishek Gupta, Laxmikant V. Kale, Dejan Milojicic, Paolo Faraboschi, and Susanne M. Balle. 2013b. HPC-aware VM placement in infrastructure clouds. In Proceedings of the International Conference on Cloud Engineering (IC2E’13). IEEE, Los Alamitos, CA, 11–20.
60. Abhishek Gupta, Laxmikant V. Kalé, Dejan S. Milojicic, Paolo Faraboschi, Richard Kaufmann, Verdi March, Filippo Gioachin, Chun Hui Suen, and Bu-Sung Lee. 2012. Exploring the performance and mapping of HPC applications to platforms in the cloud. In Proceedings of the 21st International Symposium on High-Performance Parallel and Distributed Computing. ACM, New York, NY.
61. Abhishek Gupta and Dejan Milojicic. 2011. Evaluation of HPC applications on cloud. In Proceedings of the 6th Open Cirrus Summit (OCS’11).
62. Hanan A. Hassan, Shimaa A. Mohamed, and Walaa M. Sheta. 2015. Scalability and communication performance of HPC on Azure Cloud. Egyptian Informatics Journal 17, 2, 175–182.
63. Rashid Hassani, Md Aiatullah, and Peter Luksch. 2014. Improving HPC application performance in public cloud. IERI Pro-cedia 10, 169–176.
64. Qiming He, Shujia Zhou, Ben Kobler, Dan Duffy, and Tom McGlynn. 2010. Case study for running HPC applications in public clouds. In Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing. ACM, New York, NY, 395–401.
65. Zach Hill and Marty Humphrey. 2009. A quantitative analysis of high performance computing with Amazon’s EC2 infrastructure: The death of the local cluster? In Proceedings of the 10th IEEE/ACM International Conference on Grid Computing. IEEE, Los Alamitos, CA.
66. Qian Huang. 2014. Development of a SaaS application probe to the physical properties of the Earth’s interior: An attempt at moving HPC to the cloud. Computers and Geosciences 70, 147–153.
67. Michael Hüttermann. 2012. DevOps for Developers. Apress.
68. InfiniBand Trade Association. 2000. InfiniBand Architecture Specification: Release 1.0. InfiniBand Trade Association.
69. Intel. 2017. Intel MPI Benchmarks User Guide. Retrieved December 5, 2017, from https://software.intel.com/en-us/imb-user-guide-pdf.
70. Anca Iordache, Guillaume Pierre, Peter Sanders, Jose Gabriel de F. Coutinho, and Mark Stillwell. 2016. High performance in the cloud with FPGA groups. In Proceedings of the 9th International Conference on Utility and Cloud Computing. ACM New York, NY.
71. Keith R. Jackson, Lavanya Ramakrishnan, Krishna Muriki, Shane Canon, Shreyas Cholia, John Shalf, Harvey J. Wasserman, and Nicholas J. Wright. 2010. Performance analysis of high performance computing applications on the Amazon Web Services cloud. In Proceedings of the International Conference on Cloud Computing Technology and Science (CloudCom’10). IEEE, Los Alamitos, CA, 159–168.
72. C. L. Jermain, G. E. Rowlands, R. A. Buhrman, and D. C. Ralph. 2016. GPU-accelerated micromagnetic simulations using cloud computing. Journal of Magnetism and Magnetic Materials 401, 320–322.
73. Norman P. Jouppi, Cliff Young, Nishant Patil, David Patterson, Gaurav Agrawal, Raminder Bajwa, Sarah Bates, et al. 2017. In-datacenter performance analysis of a tensor processing unit. In Proceedings of the International Symposium on Computer Architecture (ISCA’17).
74. Christoforos Kachris and Dimitrios Soudris. 2016. A survey on reconfigurable accelerators for cloud computing. In Proceedings of the International Conference on Field Programmable Logic and Applications (FPL’16). IEEE, Los Alamitos, CA.
75. Mohammad Mahdi Kashef and Jörn Altmann. 2011. A cost model for hybrid clouds. In Proceedings of the International Workshop on Grid Economics and Business Models. 46–60.
76. Janis Keuper and Franz-Josef Preundt. 2016. Distributed training of deep neural networks: Theoretical and practical limits of parallel scalability. In Proceedings of the Workshop on Machine Learning in High Performance Computing Environments. IEEE, Los Alamitos, CA, 19–26.
77. Brian Kocoloski, Jiannan Ouyang, and John Lange. 2012. A case for dual stack virtualization: Consolidating HPC and commodity applications in the cloud. In Proceedings of the 3rd ACM Symposium on Cloud Computing. ACM, New York, NY, 23.
78. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proceedings of the Advances in Neural Information Processing Systems. 1097–1105.
79. Yu-Kwong Kwok and Ishfaq Ahmad. 1999. Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Computing Surveys 3, 4, 406–471.
80. He Li, Kaoru Ota, Mianxiong Dong, Athanasios Vasilakos, and Koji Nagano. 2017. Multimedia processing pricing strategy in GPU-accelerated cloud computing. IEEE Transactions on Cloud Computing (2017).
81. Xiaorong Li, Henry Palit, Yong Siang Foo, and Terence Hung. 2011. Building an HPC-as-a-service toolkit for user-interactive HPC services in the cloud. In Proceedings of the IEEE Workshops of the International Conference on Advanced Information Networking and Applications (WAINA’11). IEEE, Los Alamitos, CA, 369–374.
82. Robert Love. 2003. Kernel korner: CPU affinity. Linux Journal 2003, 111, 8.
83. Aniruddha Marathe, Rachel Harris, David Lowenthal, Bronis R. De Supinski, Barry Rountree, and Martin Schulz. 2014. Exploiting redundancy for cost-effective, time-constrained execution of HPC applications on Amazon EC2. In Proceedings of the 23rd International Symposium on High-Performance Parallel and Distributed Computing. ACM, New York, NY.
84. Aniruddha Marathe, Rachel Harris, David K. Lowenthal, Bronis R. De Supinski, Barry Rountree, Martin Schulz, and Xin Yuan. 2013. A comparative study of high-performance computing on the cloud. In Proceedings of the 22nd International Symposium on High-Performance Parallel and Distributed Computing (HPDC’13).
85. Paul Marshall, Henry Tufo, and Kate Keahey. 2013. High-performance computing and the cloud: A match made in heaven or hell? XRDS: Crossroads, the ACM Magazine for Students 19, 3, 52–57.
86. Gabriel Mateescu, Wolfgang Gentzsch, and Calvin J. Ribbens. 2011. Hybrid computing—where HPC meets grid and cloud computing. Future Generation Computer Systems 27, 5, 440–453.
87. Marta Mattoso, Jonas Dias, Kary A. C. S. Ocaña, Eduardo Ogasawara, Flavio Costa, Felipe Horta, Vítor Silva, and Daniel de Oliveira. 2015. Dynamic steering of HPC scientific workflows: A survey. Future Generation Computer Systems 46, 100–113.
88. Viktor Mauch, Marcel Kunze, and Marius Hillenbrand. 2013. High performance cloud computing. Future Generation Computer Systems 29, 6, 1408–1416.
89. Peter Mell and Tim Grance. 2011. The NIST Definition of Cloud Computing. Technical Report. National Institute of Standards and Technology (NIST), Gaithersburg, MD.
90. Jeffrey Napper and Paolo Bientinesi. 2009. Can cloud computing reach the TOP500? In Proceedings of the Combined Workshops on UnConventional High Performance Computing Workshop Plus Memory Access Workshop (UCHPC-MAW’09).
91. Marco A. S. Netto, Renato L. F. Cunha, and Nicole Sultanum. 2015. Deciding when and how to move HPC jobs to the cloud. IEEE Computer 48, 11, 86–89.
92. NOAA. 2016. NOAA Completes Weather and Climate Supercomputer Upgrades. Retrieved December 5, 2017, from http://www.noaanews.noaa.gov/stories2016/011116-noaa-completes-weather-and-climate-supercomputer-upgrades.html.
93. Daniel Nurmi, Rich Wolski, Chris Grzegorczyk, Graziano Obertelli, Sunil Soman, Lamia Youseff, and Dmitrii Zagorodnov. 2008. The eucalyptus open-source cloud-computing system. In Proceedings of the 1st Workshop on Cloud Computing and Its Applications. IEEE, Los Alamitos, CA.
94. Kary A. C. S. Ocaña, Daniel de Oliveira, Eduardo Ogasawara, Alberto M. R. Dávila, Alexandre A. B. Lima, and Marta Mattoso. 2011. SciPhy: A cloud-based workflow for phylogenetic analysis of drug targets in protozoan genomes. In Proceedings of the Brazilian Symposium on Bioinformatics. 66–70.
95. Simon Ostermann, Alexandria Iosup, Nezih Yigitbasi, Radu Prodan, Thomas Fahringer, and Dick Epema. 2009. A performance analysis of EC2 cloud computing services for scientific computing. In Proceedings of the International Conference on Cloud Computing. 115–131.
96. Claus Pahl, Antonio Brogi, Jacopo Soldani, and Pooyan Jamshidi. 2017. Cloud container technologies: A state-of-the-art review. IEEE Transactions on Cloud Computing PP, 99, 1.
97. Manish Parashar, Moustafa AbdelBaky, Ivan Rodero, and Aditya Devarakonda. 2013. Cloud paradigms and practices for computational and data-enabled science and engineering. Computing in Science and Engineering 15, 4, 10–18.
98. Dana Petcu, Horacio González-Vélez, Bogdan Nicolae, Juan Miguel García-Gómez, Elies Fuster-Garcia, and Craig Sheridan. 2014. Next generation HPC clouds: A view for large-scale scientific and data-intensive applications. In Proceedings of the European Conference on Parallel Processing. 26–37.
99. Massimiliano Rak, Mauro Turtur, and Umberto Villano. 2015. Early prediction of the cost of cloud usage for HPC applications. Scalable Computing: Practice and Experience 16, 3, 303–320.
100. Daniel A. Reed and Jack Dongarra. 2015. Exascale computing and big data. Communications of the ACM 58, 7, 56–68.
101. Harald Richter. 2016. About the suitability of clouds in high-performance computing. arXiv:1601.01910.
102. Eduardo Roloff, Matthias Diener, Alexandre Carissimi, and Philippe O. A. Navaux. 2012. High performance computing in the cloud: Deployment, performance and cost efficiency. In Proceedings of the 2012 IEEE 4th International Conference on Cloud Computing Technology and Science (CloudCom’12). IEEE, Los Alamitos, CA, 371–378.
103. Tiago Pais Pitta De Lacerda Ruivo, Gerard Bernabeu Altayo, Gabriele Garzoglio, Steven Timm, Hyun Woo Kim, Seo-Young Noh, and Ioan Raicu. 2014. Exploring InfiniBand hardware virtualization in OpenNebula towards efficient high-performance computing. In Proceeding of the 14th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing (CCGrid’14). IEEE, Los Alamitos, CA, 943–948.
104. Iman Sadooghi and Ioan Raicu. 2013. Understanding the cost of the cloud for scientific applications. In Proceedings of the 2nd Greater Chicago Area System Research Workshop (GCASR’13).
105. Jahanzeb Sherwani, Nosheen Ali, Nausheen Lotia, Zahra Hayat, and Rajkumar Buyya. 2004. Libra: A computational economy-based job scheduling system for clusters. Software: Practice and Experience 34, 6, 573–590.
106. Justin Y. Shi, Moussa Taifi, Aakash Pradeep, Abdallah Khreishah, and Vivek Antony. 2012. Program scalability analysis for HPC cloud: Applying Amdahl’s law to NAS benchmarks. In Proceedings of the High Performance Computing, Networking, Storage, and Analysis (SCC’12), 2012 SC Companion. IEEE, Los Alamitos, CA, 1215–1225.
107. B. Silva, M. A. S. Netto, and R. L. F. Cunha. 2016. SLA-aware interactive workflow assistant for HPC parameter sweeping experiments. In Proceedings of the International Workshop on Workflows in Support of Large-Scale Science in conjunction with the International Conference for High Performance Computing, Networking, Storage, and Analysis (WORKS@SC’16). IEEE, Los Alamitos, CA.
108. Stephen Soltesz, Herbert Pötzl, Marc E. Fiuczynski, Andy Bavier, and Larry Peterson. 2007. Container-based operating system virtualization: A scalable, high-performance alternative to hypervisors. SIGOPS Operating Systems Review 41, 3, 275–287.
109. Thamarai Selvi Somasundaram and Kannan Govindarajan. 2014. CLOUDRB: A framework for scheduling and managing high-performance computing (HPC) applications in science cloud. Future Generation Computer Systems 34, 47–65.
110. Thomas Sterling and Dylan Stark. 2009. A high-performance computing forecast: Partly cloudy. Computing in Science and Engineering 11, 4, 42–49.
111. Thomas Lawrence Sterling. 2002. Beowulf Cluster Computing with Linux. MIT Press, Cambridge, MA.
112. TOP500. 2017. TOP500 Supercomputing Sites. Retrieved December 5, 2017, from https://www.top500.org.
113. U.S. Department of Energy Office of Science. 2011. The Magellan Report on Cloud Computing for Science. Technical Report. Office of Advanced Scientific Computing Research (ASCR), Washington, DC.
114. Blesson Varghese and Rajkumar Buyya. 2017. Next generation cloud computing: New trends and research directions. Future Generation Computer Systems 79, 3, 849–861.
115. Christian Vecchiola, Suraj Pandey, and Rajkumar Buyya. 2009. High-performance cloud computing: A view of scientific applications. In Proceedings of the 10th International Symposium on Pervasive Systems, Algorithms, and Networks. IEEE, Los Alamitos, CA.
116. Jerome Vienne, Jitong Chen, Md Wasi-Ur-Rahman, Nusrat S. Islam, Hari Subramoni, and Dhabaleswar K. Panda. 2012. Performance analysis and evaluation of InfiniBand FDR and 40GigE RoCE on HPC and cloud computing systems. In Proceedings of the IEEE 20th Annual Symposium on High-Performance Interconnects (HOTI’12). IEEE, Los Alamitos, CA, 48–55.
117. Adam K. L. Wong and Andrzej M. Goscinski. 2013. A unified framework for the deployment, exposure and access of HPC applications as services in clouds. Future Generation Computer Systems 29, 6, 1333–1344.
118. Miguel G. Xavier, Marcelo V. Neves, Fabio D. Rossi, Tiago C. Ferreto, Timoteo Lange, and Cesar A. F. De Rose. 2013. Performance evaluation of container-based virtualization for high performance computing environments. In Proceedings of the Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP’13). IEEE, Los Alamitos, CA.
119. Xiaoyu Yang, David Wallom, Simon Waddington, Jianwu Wang, Arif Shaon, Brian Matthews, Michael Wilson, et al. 2014. Cloud computing in e-Science: Research challenges and opportunities. Journal of Supercomputing 70, 1, 408–464.
120. Feroz Zahid, Ernst Gunnar Gran, and Tor Skeie. 2016. Realizing a self-adaptive network architecture for HPC clouds. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC’16) Doctoral Showcase.
121. Netanel Zakay and Dror G. Feitelson. 2012. On identifying user session boundaries in parallel workload logs. In Proceedings of the Workshop on Job Scheduling Strategies for Parallel Processing. 216–234.
122. Peter Zaspel and Michael Griebel. 2011. Massively parallel fluid simulations on Amazon’s HPC cloud. In Proceedings of the 1st International Symposium on Network Cloud Computing and Applications (NCCA’11). IEEE, Los Alamitos, CA, 73–78.
123. Yan Zhai, Mingliang Liu, Jidong Zhai, Xiaosong Ma, and Wenguang Chen. 2011. Cloud versus in-house cluster: Evaluating Amazon cluster compute instances for running MPI applications. In Proceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis (SC’11): State of the Practice Reports. ACM, New York, NY, 11.
124. Jie Zhang, Xiaoyi Lu, and Dhabaleswar K. Panda. 2016. High performance MPI library for container-based HPC cloud on InfiniBand clusters. In Proceedings of the International Conference on Parallel Processing (ICPP’16). IEEE, Los Alamitos, CA.
125. Jie Zhang, Xiaoyi Lu, and Dhabaleswar K. Panda. 2017. Designing locality and NUMA aware MPI runtime for nested virtualization based HPC cloud with SR-IOV enabled InfiniBand. In Proceedings of the 13th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments. ACM, New York, NY.
126. Han Zhao and Xiaolin Li. 2012. Designing flexible resource rental models for implementing HPC-as-a-service in cloud. In Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium and Workshops (IPDPSW’12) and PhD Forum. IEEE, Los Alamitos, CA, 2550–2553.