Failure-aware resource provisioning for hybrid Cloud infrastructure

Journal of Parallel and Distributed Computing

Volumn 72, Issue 10, 2012, Pages 1318-1331

  Javadi, Bahman ^a   Abawajy, Jemal ^b   Buyya, Rajkumar ^c  

^a UNIVERSITY OF WESTERN SYDNEY   (Australia)

^b DEAKIN UNIVERSITY   (Australia)

^c UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Deadline; Hybrid Cloud computing; Quality of service; Resource failures; Resource provisioning; Workload model

Indexed keywords

ARCHITECTURAL FRAMEWORKS; CLOUD PROVIDERS; DEADLINE; END-USERS; FAILURE CORRELATION; PRIVATE CLOUDS; RESOURCE PROVISIONING; VIOLATION RATES; WORK-LOAD MODELS; WORKING CONDITIONS;

CLOUD COMPUTING; QUALITY OF SERVICE;

COST BENEFIT ANALYSIS;

EID: 84865067611     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2012.06.012     Document Type: Article

References (52)

1. J.H. Abawajy, Determining service trustworthiness in Intercloud computing environments, in: The 10th International Symposium on Pervasive Systems, Algorithms, and Networks, ISPAN 2009, 2009, pp. 784-788.
2. Amazon Inc., Amazon Elastic Compute Cloud (Amazon EC2). http://aws.amazon.com/ec2.
3. M. Bouguerra, T. Gautier, D. Trystram, and J.-M. Vincent A flexible checkpoint/restart model in distributed systems Proceedings of the 9th International Conference on Parallel Processing and Applied Mathematics PPAM 2010 2010 Springer-Verlag Berlin, Torun, Poland 206 215
4. R.N. Calheiros, R. Ranjan, A. Beloglazov, C.A.F. De Rose, and R. Buyya CloudSim: a toolkit for modeling and simulation of Cloud computing environments and evaluation of resource provisioning algorithms Software: Practice and Experience 41 1 2011 23 50
5. CloudHarmony. http://cloudharmony.com/.
6. M.D. de Assunção, R. Buyya, and S. Venugopal InterGrid: a case for Internetworking islands of Grids Concurrency and Computation: Practice and Experience 20 8 2008 997 1024 10.1002/cpe.1249
7. M.D. de Assunção, A. di Costanzo, and R. Buyya Evaluating the cost-benefit of using Cloud computing to extend the capacity of clusters Proceedings of the 18th International Symposium on High Performance Parallel and Distributed Computing HPDC 2009 2009 ACM New York, NY, Garching, Germany 141 150
8. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good The cost of doing science on the Cloud: the montage example Proceedings of the 19th ACM/IEEE International Conference on Supercomputing SC 2008 2008 IEEE Press Piscataway, NJ, Austin, Texas 1 12
9. A. di Costanzo, M.D. de Assunção, and R. Buyya Harnessing cloud technologies for a virtualized distributed computing infrastructure IEEE Internet Computing 13 5 2009 24 33
10. A. Downey, A model for speedup of parallel programs, Technical Report UCB/CSD-97-933, Computer Science Division, UC, Berkeley, California, CA, 1997.
11. D.G. Feitelson, Workload Modeling for Computer Systems Performance Evaluation, e-Book. http://www.cs.huji.ac.il/~feit/wlmod/, 2009.
12. D.G. Feitelson, L. Rudolph, U. Schwiegelshohn, K.C. Sevcik, and P. Wong Theory and practice in parallel job scheduling Proceedings of the 3rd International Workshop on Job Scheduling Strategies for Parallel Processing JSSPP'97 1997 Springer-Verlag London, Seattle, WA 1 34
13. J. Fontán, T. Vázquez, L. Gonzalez, R.S. Montero, I.M. Llorente, OpenNEbula: the open source virtual machine manager for cluster computing, in: Open Source Grid and Cluster Software Conference, Book of Abstracts, San Francisco, CA, 2008.
14. D. Ford, F. Labelle, F.I. Popovici, M. Stokely, V.-A. Truong, L. Barroso, C. Grimes, and S. Quinlan Availability in globally distributed storage systems Proceedings of the 9th USENIX Conference on Operating Systems Design and Implementation 2010 USENIX Association Berkeley, CA, Vancouver, BC, Canada 1 7
15. S. Fu, and C.-Z. Xu Quantifying event correlations for proactive failure management in networked computing systems Journal of Parallel and Distributed Computing 70 2010 1100 1109
16. M. Gallet, N. Yigitbasi, B. Javadi, D. Kondo, A. Iosup, and D. Epema A model for space-correlated failures in large-scale distributed systems Proceedings of the 16th International European Conference on Parallel and Distributed Computing Euro-Par 2010 2010 Springer-Verlag Berlin, Ischia, Italy 88 100
17. GoGrid Inc., GoGrid Cloud Hosting. http://www.gogrid.com/.
18. L. He, S.A. Jarvis, D.P. Spooner, X. Chen, and G.R. Nudd Dynamic scheduling of parallel jobs with QoS demands in multiclusters and Grids Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing Grid 2004 2004 IEEE Computer Society Washington, DC, Pittsburgh, USA 402 409
19. U. Hoelzle, and L.A. Barroso The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines 2009 Morgan and Claypool Publishers San Rafael, CA
20. E. Huedo, R.S. Montero, and I.M. Llorente Grid architecture from a metascheduling perspective IEEE Computer 43 7 2010 51 56
21. A. Iosup, D.H.J. Epema, T. Tannenbaum, M. Farrellee, and M. Livny Inter-operating Grids through delegated matchmaking Proceedings of the 18th ACM/IEEE Conference on Supercomputing SC 2007 2007 ACM New York, NY, Reno, Nevada 1 12
22. M. Islam, P. Balaji, P. Sadayappan, and D.K. Panda QoPS: a QoS based scheme for parallel job scheduling Proceedings of the 9th International Workshop on Job Scheduling Strategies for Parallel Processing JSSPP'03 2003 Springer-Verlag Berlin, Seattle, WA 252 268
23. B. Javadi, D. Kondo, J.-M. Vincent, and D.P. Anderson Discovering statistical models of availability in large distributed systems: an empirical study of SETI@home IEEE Transactions on Parallel and Distributed Systems 22 11 2011 1896 1903
24. D. Kondo, B. Javadi, A. Iosup, and D.H.J. Epema The failure trace archive: enabling comparative analysis of failures in diverse distributed systems Proceedings of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing CCGrid 2010 2010 IEEE Computer Society Washington, DC, Melbourne, Australia 398 407
25. D. Kondo, B. Javadi, P. Malecot, F. Cappello, and D.P. Anderson Cost-benefit analysis of Cloud computing versus desktop grids Proceedings of the 23rd IEEE International Parallel and Distributed Processing Symposium IPDPS 2009 2009 IEEE Computer Society Washington, DC, Rome, Italy 1 12
26. H. Li, D. Groep, and L. Wolters Workload characteristics of a multi-cluster supercomputer Proceedings of the 10th International Workshop on Job Scheduling Strategies for Parallel Processing JSSPP'04 2004 Springer-Verlag Berlin, New York, USA 176 193
27. D.A. Lifka The ANL/IBM SP scheduling system Proceedings of the 1st Workshop on Job Scheduling Strategies for Parallel Processing JSSPP'95 1995 Springer-Verlag London, Santa Barbara, CA 295 303
28. U. Lublin, and D.G. Feitelson The workload on parallel supercomputers: modeling the characteristics of rigid jobs Journal of Parallel and Distributed Computing 63 11 2003 1105 1122
29. P. Marshall, K. Keahey, and T. Freeman Elastic site: using clouds to elastically extend site resources Proceedings of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing CCGrid 2010 2010 IEEE Computer Society Washington, DC, Melbourne, Australia 43 52
30. T. Mather, S. Kumaraswamy, and S. Latif Cloud Security and Privacy: An Enterprise Perspective on Risks and Compliance 2009 O'Reilly Media, Inc.
31. M. Mattess, C. Vecchiola, and R. Buyya Managing peak loads by leasing cloud infrastructure services from a spot market Proceedings of the 12th IEEE International Conference on High Performance Computing and Communications HPCC 2010 2010 IEEE Press Piscataway, NJ, Melbourne, Australia 180 188
32. J. McKendrick, NASA's Nebula: a stellar example of private clouds in government. http://nebula.nasa.gov/.
33. I. Moschakis, and H. Karatza Evaluation of gang scheduling performance and cost in a cloud computing system The Journal of Supercomputing 1 2010 1 18
34. A.W. Mu'alem, and D.G. Feitelson Utilization, predictability, workloads, and user runtime estimates in scheduling the IBM SP2 with backfilling IEEE Transactions on Parallel and Distributed Systems 12 6 2001 529 543
35. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov The Eucalyptus open-source cloud-computing system Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid CCGrid 2009 2009 IEEE Computer Society Washington, DC, Shanghai, China 124 131
36. D. Oppenheimer, A. Ganapathi, and D.A. Patterson Why do Internet services fail, and what can be done about it? Proceedings of the 4th Conference on USENIX Symposium on Internet Technologies and Systems 2003 USENIX Association Berkeley, CA, Seattle, WA 1 15
37. L.F. Orleans, and P. Furtado Fair load-balancing on parallel systems for QoS Proceedings of the 36th International Conference on Parallel Processing ICPP 2007 2007 IEEE Computer Society Los Alamitos, CA, XiAn, China 22 30
38. S. Ostermann, A. Iosup, N. Yigitbasi, R. Prodan, T. Fahringer, and D. Epema A performance analysis of EC2 Cloud computing services for scientific computing Proceedings of the 1st International Conference on Cloud Computing CloudComp 2009 2009 Springer-Verlag Berlin, Beijing, China 115 131
39. M.R. Palankar, A. Iamnitchi, M. Ripeanu, and S. Garfinkel Amazon S3 for science Grids: a viable solution? Proceedings of the 1st International Workshop on Data-Aware Distributed Computing (DADC'08) in Conjunction with HPDC 2008 2008 ACM New York, NY, Boston, MA 55 64
40. S. Pandey, W. Voorsluys, M. Rahman, R. Buyya, J.E. Dobson, and K. Chiu A grid workflow environment for brain imaging analysis on distributed systems Concurrency and Computation: Practice and Experience 21 16 2009 2118 2139
41. Parallel Workload Archive. http://www.cs.huji.ac.il/labs/parallel/ workload/.
42. A.J. Rubio-Montero, E. Huedo, R.S. Montero, and I.M. Llorente Management of virtual machines on Globus Grids using GridWay Proceedings of the 21st IEEE International Parallel and Distributed Processing Symposium IPDPS 2007 2007 IEEE Press Piscataway, NJ, Long Beach, USA 1 7
43. P. Ruth, P. McGachey, and D. Xu VioCluster: virtualization for dynamic computational domain Proceedings of the 7th IEEE International Conference on Cluster Computing Cluster 2005 2005 IEEE Press Piscataway, NJ, Burlington, MA 1 10
44. B. Sotomayor, R.S. Montero, I.M. Llorente, and I. Foster Virtual infrastructure management in private and hybrid clouds IEEE Internet Computing 13 5 2009 14 22
45. S. Srinivasan, R. Kettimuthu, V. Subramani, and P. Sadayappan Selective reservation strategies for backfill job scheduling Proceedings of the 8th International Workshop on Job Scheduling Strategies for Parallel Processing JSSPP'02 2002 Springer-Verlag London, Edinburgh, Scotland, UK 55 71
46. W. Tang, N. Desai, D. Buettner, and Z. Lan Analyzing and adjusting user runtime estimates to improve job scheduling on the Blue Gene/P Proceedings of the 24th IEEE International Parallel and Distributed Processing Symposium IPDPS 2010 2010 IEEE Press Piscataway, NJ, Atlanta, USA 1 11
47. M. Tatezono, N. Maruyama, and S. Matsuoka Making wide-area, multi-site MPI feasible using Xen VM Proceedings of the 4th Workshop on Frontiers of High Performance Computing and Networking in conjunction with ISPA 2006 2006 Springer-Verlag Berlin, Sorrento, Italy 387 396
48. D. Tsafrir, Y. Etsion, and D.G. Feitelson Backfilling using system-generated predictions rather than user runtime estimates IEEE Transactions on Parallel and Distributed Systems 18 2007 789 803
49. J. Varia Best Practices in Architecting Cloud Applications in the AWS Cloud 2011 Wiley Press Hoboken, NJ pp. 459-490
50. C. Vecchiola, X. Chu, and R. Buyya Aneka: A Software Platform for.NET-Based Cloud Computing 2009 IOS Press Amsterdam pp. 267-295
51. P. Xavier, W. Cai, and B.-S. Lee A dynamic admission control scheme to manage contention on shared computing resources Concurrency and Computation: Practice and Experience 21 2 2009 133 158
52. N. Yigitbasi, M. Gallet, D. Kondo, A. Iosup, and D. Epema Analysis and modeling of time-correlated failures in large-scale distributed systems Proceedings of the 11th IEEE/ACM International Conference on Grid Computing Grid 2010 2010 IEEE Computer Society Washington, DC, Brussels, Belgium 65 72