Cost-oriented proactive fault tolerance approach to high performance computing (HPC) in the cloud

International Journal of Parallel, Emergent and Distributed Systems

Volumn 29, Issue 4, 2014, Pages 363-378

  Egwutuoha, Ifeanyi P ^a   Chen, Shiping ^b   Levy, David ^a   Selic, Bran ^a   Calvo, Rafael ^a  

^a UNIVERSITY OF SYDNEY   (Australia)

^b CSIRO   (Australia)

Author keywords

Cloud computing; computationintensive; HaaS; HPC; proactive fault tolerance

Indexed keywords

ALGORITHMS; CLOCKS; CLOUD COMPUTING; FAULT TOLERANCE;

COMPUTATIONINTENSIVE; COMPUTING PARADIGM; ELECTRONIC COMPONENT; EXECUTION ENVIRONMENTS; HAAS; HIGH PERFORMANCE COMPUTING (HPC); HPC; PROACTIVE FAULT;

COST REDUCTION;

EID: 84898914916     PISSN: 17445760     EISSN: 17445779     Source Type: Journal    
DOI: 10.1080/17445760.2013.803686     Document Type: Article

References (33)

1. Amazon. [Online]. Available at. http://aws.amazon.com/ec2/
2. Baremetalcloud. [Online]. Available at. http://baremetalcloud.com/index. php/en/
3. B.P. Rimal, E. Choi, and I. Lumb, A taxonomy and survey of cloud computing systems, in NCM '09: Proceedings of the 2009 Fifth International Joint Conference on INC, IMS and IDC. Washington, DC, USA, IEEE Comp. Society, 2009, pp. 44-51.
4. Nicholas Carr. [Online]. Available at. http://www.roughtype.com/p279
5. CFDR. Available at. http://cfdr.usenix.org (2012).
6. B. Schroeder and G.A. Gibson, A Large-Scale Study of Failures in High Performance Computing Systems, Dependable and Secure Computing, IEEE Transactions 7(4) (2010), pp. 337-351.
7. Al Geist and Christian Engelmann, Development of naturally fault tolerant algorithms for computing on 100,000 processors, J. Parallel Distributed Comput. (2002). Available at www.csm.ornl.gov/,geist
8. R. Riesen, K. Ferreira, and J. Stearley, See Applications Run and Throughput Jump: The Case for Redundant Computing in HPC, in Proceedings of the 2010 International Conference on Dependable Systems and Networks Workshops (DSN-W), DSNW '10, Washington, DC, USA, IEEE Computer Society, 2010, pp. 29-34.
9. Huajun Hu, Suchang Guo, and Bo Yang, Cost-oriented task allocation and hardware redundancy policies in heterogeneous distributed computing systems considering software reliability, Comput. Ind. Eng. 56(4) (2009), pp. 1687-1696.
10. C.-C. Hsieh, Optimal task allocation and hardware redundancy policies in distributed computing systems, Eur. J. Operational Res. 147(2) (2003), pp. 430-447.
11. F. Cappello, Fault Tolerance in Petascale/exascale systems: Current knowledge, challenges and research opportunities, Int. J. High Perform. Comput. Appl. 23(3) (2009), pp. 212-226.
12. The MPI Forum, The MPI message-passing interface standard, 1995. Available at: Http://www.mcs.anl.gov/mpi/standard.html
13. C. Evangelinos and C.N. Hill, Cloud computing for parallel scientific HPC Applications: Feasibility of running coupled Atmosphere-Ocean climate models on Amazon's EC2, in Cloud Computing and Its Applications 2008 (CCA-08), October 2008, Chicago, IL, ACM.
14. I.P. Egwutuoha, S. Chen, D. Levy, and B. Selic, A fault tolerance framework for high performance computing in cloud, in Cluster, Cloud and Grid Computing (CCGrid), 2012 12th IEEE/ACM International Symposium, Ottawa, Canada, IEEE, 2012, pp. 709-710.
15. A. Kumar, L. Shang, L. Peh, and N. Jha, System-level dynamic thermal management for highperformance microprocessors, IEEE Trans. Computer-Aided Design Integr. Circuits Syst. 27(1) (2008), pp. 96-108.
16. J. Stearley and A. Oliner, What Supercomputers Say: A Study of Five System Logs, in DSN 07: Proceedings of the 37th Annual IEEE/IFIP International Conference on Dependable Systems and Networks, Washington, DC, USA, 2007, pp. 575-584.
17. Arun Babu Nagarajan, Frank Mueller, Christian Engelmann, and Stephen L. Scot, Proactive Fault Tolerance for HPC with Xen Virtualization, in Proceedings of the 21st Annual International Conference on Supercomputing, Seattle, Washington, 2007, pp. 23-32.
18. Lm-sensors. [Online]. Aavailable at. http://lm-sensors.org/wiki/ Documentation
19. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good, The Cost of Doing Science on the Cloud: The Montage Example, in SC 08: Proceedings of the 2008 ACM/IEEE Conference on Supercomputing, Piscataway, NJ, USA, 2008, pp. 1-12.
20. M. Armbrust, A. Fox, R. Griffith, A. Joseph, R. Katz, A. Konwinski, G. Lee, D. Patterson, A. Rabkin, I. Stoica, and M. Zaharia, A view of cloud computing. Commun. ACM. 53(4) (2010), pp. 50-58.
21. Open-iscsi, 2013. Available at: Http://www.open-iscsi.org
22. Xen, Xen hypervisor. [Online]. Available at. http://www.xen.org/products/ xenhyp.html
23. A. Petitet, R.C. Whaley, J. Dongarra, and A. Cleary, HPL. [Online]. Available at. http://www. netlib.org/benchmark/hpl/(2008).
24. E.N.M. Elnozahy, L. Alvisi, Y.M. Wang, and D.B. Johnson, A survey of rollback-recovery protocols in message-passing systems, ACM Comput. Surv. (CSUR) 34(3) (2002), pp. 375-408.
25. Checkpointing.org, [Online]. Available at. http://checkpointing.org/
26. I.P. Egwutuoha, D. Schragl, and R. Calvo, A Brief Review of Cloud Computing, Challenges and Potential Solutions, J. Parallel Cloud Comput. 2(1) (2013).
27. H.J. Berendsen, D. van der Spoel, and R. van Drunen, GROMACS: A message-passing parallel molecular dynamics implementation, Comput. Phys. Commun. 91(1) (1995), pp. 43-56.
28. I.P. Egwutuoha, S. Chen, D. Levy, B. Selic, and R. Calvo, A Proactive Fault Tolerance Approach to High Performance Computing (HPC) in 2012 Second International Conference on the Cloud, in Cloud and Green Computing (CGC), Xiangtan, Hunan, China, IEEE, 2012, pp. 268-273.
29. L. Youseff, M. Butrico, and D.D. Silva, Toward a unified ontology of cloud computing, in Proc. of the Grid Computing Environments Workshop (GCE08), Nov 2008, pp. 1-10.
30. I.P. Egwutuoha, D. Levy, B. Selic, and S. Chen, A survey of fault tolerance mechanisms and checkpoint/restart implementations for high performance computing systems, J. Supercomput. (2013). 10.1007/s11227-013-0884-0
31. J.T. Daly, A higher order estimate of the optimum checkpoint interval for restart dumps, Generation Comput. Syst. 22 (2006), pp. 303-312.
32. C. Clark, K. Fraser, S. Hand et al. Live migration of virtual machines, in Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation-Volume 2, USENIX Association 2005, pp. 273-286.
33. K. Li, J.F. Naughton, and J.S. Plank, Low-latency, concurrent checkpointing for parallel programs, IEEE Transactions on Parallel and Distributed Systems 5(8) (1994), pp. 874-879.