Flexible resource allocation for reliable virtual cluster computing systems

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Hacker, Thomas J ^a   Mahadik, Kanak ^a  

^a PURDUE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALLOCATION POLICIES; COMPUTATIONAL TASK; COMPUTING SYSTEM; COMPUTING TECHNOLOGY; GRADE OF SERVICE; HIGH PERFORMANCE COMPUTING; HIGH-PERFORMANCE COMPUTING CLUSTERS; PARALLEL COMPUTING SYSTEM; RESOURCE PREDICTION; VIRTUAL CLUSTERS; VIRTUALIZATIONS;

CLUSTER ANALYSIS; CLUSTER COMPUTING; COMPUTER SOFTWARE SELECTION AND EVALUATION; COMPUTER SYSTEMS; ESTIMATION; MATHEMATICAL MODELS; PARALLEL ARCHITECTURES; RESOURCE ALLOCATION;

CLOUD COMPUTING;

EID: 83155182871     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063448     Document Type: Conference Paper

References (37)

1. H. Meuer, E. Strohmaier, J. Dongarra, and H. Simon, "Top500 Supercomputer Sites, " The report can be downloaded from http://www.top500.org/.
2. R. Henderson, "Job scheduling under the portable batch system, " in Job Scheduling Strategies for Parallel Processing. Springer, 1995, pp. 279-294.
3. M. Litzkow, M. Livny, and M. Mutka, "Condor-a hunter of idle workstations, " in Distributed Computing Systems, 1988., 8th International Conference on. IEEE, 2002, pp. 104-111.
4. S. Kannan, M. Roberts, P. Mayes, D. Brelsford, and J. Skovira, "Workload management with loadleveler, " IBM Redbooks, vol. 2, p. 2, 2001.
5. B. Sotomayor, R. S. Montero, I. M. Llorente, and I. Foster, "Virtual infrastructure management in private and hybrid clouds, " IEEE Internet Computing, vol. 13, pp. 14-22, 2009.
6. R. Eigenmann, T. Hacker, and E. Rathje, "Nees cyberinfrastructure: A foundation for innovative research and education, " in Proceedings of the 9th US/10th Canadian Conference on Earthquake Engineering, 2010.
7. T. Hacker, R. Eigenmann, S. Bagchi, A. Irfanoglu, S. Pujol, A. Catlin, and E. Rathje, "The neeshub cyberinfrastructure for earthquake engineering, " Computing in Science & Engineering, vol. 13, no. 4, pp. 67-78, 2011.
8. T. Hacker, "Toward a Reliable Cloud Computing Service, " Cloud Computing and Software Services: Theory and Techniques, p. 139, 2010.
9. M. McLennan and R. Kennell, "HUBzero: A Platform for Dissemination and Collaboration in Computational Science and Engineering, " Computing in Science & Engineering, vol. 12, no. 2, pp. 48-53, 2010.
10. N. Wilkins-Diehr, "Special issue: Science gateways - Common community interfaces to grid resources, " Concurrency and Computation: Practice and Experience, vol. 19, no. 6, pp. 743-749, 2007. (Pubitemid 46693248)
11. F. Zhang, J. Cao, X. Song, H. Cai, and C. Wu, "AMREF: An Adaptive MapReduce Framework for Real Time Applications, " in 2010 Ninth International Conference on Grid and Cloud Computing. IEEE, 2010, pp. 157-162.
12. T. Hacker and B. Athey, "A methodology for account management in grid computing environments, " in Grid Computing GRID 2001, ser. Lecture Notes in Computer Science, C. Lee, Ed. Springer Berlin/Heidelberg, 2001, vol. 2242, pp. 133-144. (Pubitemid 33371002)
13. H. Kobayashi and B. Mark, System Modeling and Analysis: Foundations of System Performance Evaluation. Pearson Education, 2009.
14. T. Bonald, "Insensitive traffic models for communication networks, " Discrete Event Dynamic Systems, vol. 17, no. 3, pp. 405-421, 2007. (Pubitemid 47338443)
15. J. S. Kaufman, "Blocking in a shared resource environment, " IEEE trans. on commun., vol. COM-29, 10, pp. 1474-1481, 1981.
16. H. Li, D. Groep, and L. Walters, "Workload characteristics of a multi-cluster supercomputer, " in Job Scheduling Strategies for Parallel Processing, D. G. Feitelson, L. Rudolph, and U. Schwiegelshohn, Eds. Springer-Verlag, 2004, pp. 176-193, lect. Notes Comput. Sci. vol. 3277. (Pubitemid 41190427)
17. F. Hubner and P. Tran-Gia, "An analysis of multi-service systems with trunk reservation mechanisms, " 1992.
18. S. M. Ross, Introduction to Probability Models, 4th ed. Academic Press, 1989.
19. G. Zeng, "Two common properties of the erlang-B function, erlang-C function, and Engset blocking function, " Mathematical and Computer Modelling, vol. 37, no. 12-13, pp. 1287-1296, 2003. (Pubitemid 36964796)
20. V. Iverson, "Teletraffic engineering and network planning, Technical University of Denmark, Revised January 2007.".
21. P. Smith, T. Hacker, and C. Song, "Implementing an industrial-strength academic cyberinfrastructure at purdue university, " in Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on. IEEE, 2008, pp. 1-7.
22. T. Hacker, F. Romero, and C. Carothers, "An analysis of clustered failures on large supercomputing systems, " Journal of Parallel and Distributed Computing, vol. 69, no. 7, pp. 652-665, 2009.
23. T. J. Hacker and Z. Meglicki, "Using queue structures to improve job reliability, " in Proceedings of the 16th International Symposium on High-Performance Distributed Computing (HPDC-16 2007), 25-29 June 2007, Monterey, California, USA. ACM, 2007, pp. 43-54. (Pubitemid 47291191)
24. D. Nurmi, J. Brevik, and R. Wolski, "Quantifying machine availability in networked and desktop grid systems, " University of California, Santa Barbara, Computer Science, Tech. Rep. ucsb-cs:TR-2003-37, Nov. 2003.
25. J. Brevik, D. Nurmi, and R. Wolski, "Automatic methods for predicting machine availability in desktop grid and peer-to-peer systems, " in CCGRID. IEEE Computer Society, 2004, pp. 190-199.
26. D. Nurmi, J. Brevik, and R. Wolski, "Modeling machine availability in enterprise and wide-area distributed computing environments, " in Euro-Par 2005, Parallel Processing, 11th International Euro-Par Conference, Lisbon, Portugal, August 30 - September 2, 2005, Proceedings, ser. Lecture Notes in Computer Science, vol. 3648. Springer, 2005, pp. 432-441. (Pubitemid 41490843)
27. D. N. P. Murthy, M. Xie, and R. Jiang, Weibull Models. Wiley Series in Probability and Statistics, Wiley-Interscience, 2003.
28. M. Rausand and A. Høyland, System Reliability Theory: Models, Statistical Methods and Applications Second Edition. Wiley-Interscience, 2003.
29. F. Romero and T. J. Hacker, "Live migration of parallel applications with openvz, " in Proceedings of the 2011 IEEE Workshops of International Conference on Advanced Information Networking and Applications, ser. WAINA'11. Washington, DC, USA: IEEE Computer Society, 2011, pp. 526-531. [Online]. Available: http://dx.doi.org/10.1109/WAINA.2011.156.
30. D. L. Grosh, Primer of Reliability Theory. New York, NY: John Wiley, 1989.
31. B. Sotomayor, R. Montero, I. Llorente, I. Foster, and F. de Informatica, "Capacity leasing in cloud systems using the opennebula engine, " Cloud Computing and Applications, vol. 2008, 2008.
32. S. Venugopal, J. Broberg, and R. Buyya, "OpenPEX: An open provisioning and execution system for virtual machines, " in 17th International Conference on Advanced Computing and Communications (ADCOMŠ09). Citeseer, 2009.
33. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, and D. Zagorodnov, "The eucalyptus open-source cloud-computing system, " in Proceedings of Cloud Computing and Its Applications, 2008.
34. M. De Assunção, A. Di Costanzo, and R. Buyya, "Evaluating the cost-benefit of using cloud computing to extend the capacity of clusters, " in Proceedings of the 18th ACM international symposium on High performance distributed computing. ACM, 2009, pp. 141-150.
35. T. Hacker and B. Athey, "A methodology for account management in grid computing environments, " Grid ComputingŮGRID 2001, pp. 133-144, 2001. (Pubitemid 33371002)
36. D. Nurmi, A. Mandal, J. Brevik, C. Koelbel, R. Wolski, and K. Kennedy, "Evaluation of a workflow scheduler using integrated performance modelling and batch queue wait time prediction, " in Proceedings of the 2006 ACM/IEEE conference on Supercomputing, ser. SC'06. New York, NY, USA: ACM, 2006. [Online]. Available: http://doi.acm.org/10.1145/1188455.1188579.
37. W. Smith, "A service for queue prediction and job statistics, " in Gateway Computing Environments Workshop (GCE), 2010, nov. 2010, pp. 1 -8.