Resource allocation algorithms for virtualized service hosting platforms

Journal of Parallel and Distributed Computing

Volumn 70, Issue 9, 2010, Pages 962-974

  Stillwell, Mark ^a   Schanzenbach, David ^a   Vivien, Frdric ^b   Casanova, Henri ^a  

^a University of Hawai'i at Manoa   (United States)

^b UNIV LYON   (France)

Author keywords

Cluster; Resource allocation; Virtual machine

Indexed keywords

BEST-EFFORT; CLUSTER UTILIZATION; COMMODITY CLUSTERS; HARDWARE RESOURCES; MULTIPLE SERVICES; OBJECTIVE FUNCTIONS; OPERATION COST; OPTIMAL RESOURCE ALLOCATION; RESOURCE ALLOCATION ALGORITHMS; RESOURCE ALLOCATION PROBLEM; SERVICE HOSTING; SERVICE INSTANCES; VIRTUAL MACHINE TECHNOLOGY; VIRTUAL MACHINES; VIRTUALIZED SERVICES;

ALGORITHMS; COMPUTER HARDWARE; COMPUTER SIMULATION; OPTIMIZATION;

RESOURCE ALLOCATION;

EID: 77955515011     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2010.05.006     Document Type: Article

References (70)

1. S. Ali, J.-K. Kim, H.J. Siegel, and A.A. Maciejewski Static heuristics for robust resource allocation of continuously executing applications Journal of Parallel and Distributed Computing 68 2008 1070 1080
2. M. Aron, P. Druschel, W. Zwaenepoel, Cluster reserves: a mechanism for resource management in cluster-based network servers, in: Proc. of the ACM Sigmetrics International Conference on Measurement and Modeling of Computer Systems, June 2000.
3. N. Bansal, A. Caprara, M. Sviridenko, Improved approximation algorithms for multidimensional bin packing problems, in: Foundations of Computer Science, 2006, pp. 697708.
4. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, A. Warfield, Xen and the art of virtualization, in: Proc. of the ACM Symp. on Operating Systems Principles, October 2003, pp. 164177.
5. M.A. Bender, S. Chakrabarti, S. Muthukrishnan, Flow and stretch metrics for scheduling continuous job streams, in: Proc. of the Symp. on Discrete Algorithms, 1998, pp. 270279.
6. M. Bichler, T. Setzer, B. Speitkamp, Capacity planning for virtualized servers, in: Proc. of the 16th Annual Workshop on Information Technologies & Systems, WITS, 2006.
7. A. Caprara, and P. Toth Lower bounds and algorithms for the 2-dimensional vector packing problem Discrete Applied Mathematics 111 3 2001 231 262
8. D. Carrera, M. Steinder, I. Whalley, J. Torres, E. Ayguad, Utility-based placement of dynamic web applications with fairness goals, in: IEEE Network Operations and Management Symposium, 2008, pp. 916.
9. J. Chase, D. Anderson, P. Thakar, A. Vahdat, and R. Doyle Managing energy and server resources in hosting centers SIGOPS Operating Systems Review 35 5 2001 103 116
10. C. Chekuri, and S. Khanna On multi-dimensional packing problems SIAM Journal on Computing 33 4 2004 837 851
11. Y. Chen, S. Iyer, X. Liu, D. Milojicic, and A. Sahai Translating service level objectives to lower level policies for multi-tier services Cluster Computing 11 3 2008 299 311
12. L. Cherkasova, R. Gardner, Measuring CPU overhead for I/O processing in the Xen virtual machine monitor, in: Proc. of the Usenix Annual Technical Conference, 2005.
13. C. Clark, K. Fraser, S. Hand, J.G. Hansen, E. Jul, C. Limpach, I. Pratt, A. Warfield, Live migration of virtual machines, in: Proc. of the Symp. on Networked Systems Design and Implementation, 2005, pp. 273286.
14. ILOG CPLEX: high-performance software for mathematical programming and optimization. http://www.ilog.com/products/cplex/.
15. J. Csirik, J.B.G. Frenk, M. Labbe, and S. Zhang On multidimensional vector bin packing Acta Cybernetica 9 4 1990 361 369
16. R.P. Doyle, J.S. Chase, O.M. Asad, W. Jin, A.M. Vahdat, Model-based resource provisioning in a web service utility, in: Proc. of the USENIX Symposium on Internet Technologies and Systems, 2003.
17. W. Fernandez de la Vega, and G.S. Lueker Bin packing can be solved within 1 + in linear time Combinatorica 1 4 1981 349 355
18. GAlib: a C++ library of genetic algorithm components, 2010. http://lancet.mit.edu/ga/.
19. M.R. Garey, and D.S. Johnson Computers and Intractability, A Guide to the Theory of NP-Completeness 1979 W.H. Freeman and Company
20. D. Gmach, Managing shared resource pools for enterprise applications, Ph.D. Thesis, Technische Universitt Mnchen, Fakultt fr Informatik, 2009.
21. D. Gmach, J. Rolia, L. Cherkasova, G. Belrose, T. Turicchi, A. Kemper, An integrated approach to resource pool management: policies, efficiency and quality metrics, in: Proc. of the IEEE Intnl. Conf. on Dependable Systems and Networks, June 2008, pp. 326335.
22. D. Gmach, J. Rolia, L. Cherkasova, A. Kemper, Workload analysis and demand prediction of enterprise data center applications, in: Proc. of the 10th IEEE Intnl. Symp. on Workload Characterization, September 2007, pp. 171180.
23. D. Gmach, J. Rolia, L. Cherkasova, and A. Kemper Resource pool management: reactive versus proactive or let's be friend Computer Networks 53 2009 2905 2922
24. L. Grit, D. Irwin, V. Marupadi, P. Shivam, A. Yumerefendi, J. Chase, J. Albrecht, Harnessing virtual machine resource control for job management, in: Proc. of the 1st Workshop on System-level Virtualization for High Performance Computing, November 2007.
25. J. Gueyoung, K. Joshi, M. Hiltunen, Performance aware regeneration in virtualized multitier applications, in: Proc. of Proactive Failure Avoidance Recovery and Maintenance, PFARM, June 2009.
26. D. Gupta, L. Cherkasova, and A. Vahdat Comparison of the three CPU schedulers in Xen ACM SIGMETRICS Performance Evaluation Review (PER) 35 2 2007 42 51
27. D. Gupta, R. Gardner, L. Cherkasova, XenMon: QoS monitoring and performance profiling tool, Technical Report HPL-2005-187, Hewlett-Packard Labs, 2005.
28. D. Irwin, J. Chase, L. Grit, A. Yumerefendi, D. Becker, K. Yocum, Sharing networked resources with brokered leases, in: Proc. of the USENIX Technical Conference, June 2006.
29. S.T. Jones, A.C. Arpaci-Dusseau, R.H. Arpaci-Dusseau, Antfarm: tracking processes in a virtual machine environment, in: Proc. of the USENIX Annual Technical Conf., June 2006.
30. S.T. Jones, A.C. Arpaci-Dusseau, R.H. Arpaci-Dusseau, Geiger: monitoring the buffer cache in a virtual machine environment, in: Proc. of Architectural Support for Programming Languages and Operating Systems, October 2006.
31. A. Karve, T. Kimbrel, G. Pacifici, M. Spreitzer, M. Steinder, M. Sviridenko, A. Tantawi, Dynamic placement for clustered web applications, in: Proceedings of the 15th International Conference on the World Wide Web, 2006, pp. 595604.
32. L.T. Kou, and G. Markowsky Multidimensional bin packing algorithms IBM Journal of Research and Development 21 5 1977 443 448
33. D. Kusic, J. Kephart, J. Hanson, N. Kandasamy, and G. Jiang Power and performance management of virtualized computing environments via lookahead control Cluster Computing 12 1 2009 1 15
34. A. Legrand, A. Su, and F. Vivien Minimizing the stretch when scheduling flows of divisible requests Journal of Scheduling 11 5 2008 381 404
35. W. Leinberger, G. Karypis, V. Kumar, Multi-capacity bin packing algorithms with applications to job scheduling under multiple constraints, in: Proc. of the Intl. Conf. on Parallel Processing, 1999, pp. 404412.
36. L. Marchal, Y. Yang, H. Casanova, and Y. Robert Steady-state scheduling of multiple divisible load applications on wide-area distributed computing platforms International Journal of High Performance Computing Applications 20 3 2006 365 381
37. K. Maruyama, S.K. Chang, and D.T. Tang A general packing algorithm for multidimensional resource requirements International Journal of Computer and Information Sciences 6 2 1977 131 149
38. M. McNett, D. Gupta, A. Vahdat, G.M. Voelker, Usher: an extensible framework for managing clusters of virtual machines, in: Proc. of the 21st Large Installation System Administration Conference, November 2007, pp. 167181.
39. N. Mi, G. Casale, L. Cherkasova, E. Smirni, Burstiness in multi-tier applications: symptoms, causes, and new models, in: Proc. of the 9th ACM/IFIP/USENIX International Conference on Middleware, 2008, pp. 265286.
40. Microsoft virtual PC. http://www.microsoft.com/windows/products/ winfamily/virtualpc/default.mspx.
41. K. Nesbit, J. Laudon, J. Smith, Virtual private caches, in: Proc. of the Symp. on Computer Architecture, 2007.
42. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. Soman, L. Youseff, D. Zagorodnov, The Eucalyptus open-source cloud-computing system, in: Proc. of Cloud Computing and its Applications, October 2008.
43. D. Ongaro, A.L. Cox, S. Rixner, Scheduling I/O in virtual machine monitors, in: Proc. of the ACM SIGPLAN/SIGOPS Intl. Conf. on Virtual Execution Environment, VEE, March 2008.
44. G. Pacifici, M. Spreitzer, A.N. Tantawi, and A. Youssef Performance management for cluster-based web services Journal on Selected Areas in Communications 23 12 2005 2333 2343
45. P. Padala, K.G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, A. Merchant, K. Salem, Adaptive control of virtualized resources in utility computing environments, in: Proc. of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems, 2007, pp. 289302.
46. L. Ramakrishnan, L. Grit, A. Iamnitchi, D. Irwin, A. Yumerefendi, J. Chase, Toward a doctrine of containment: grid hosting with adaptive resource control, in: Proc. of the International Conference for High Performance Computing Networking, Storage, and Analysis, 2006.
47. J. Rolia, A. Andrzejak, M.F. Arlitt, Automating enterprise application placement in resource utilities, in: Proc. of the 4th IFIP/IEEE International Workshop on Distributed Systems: Operations and Management, DSOM, 2003.
48. J. Rolia, L. Cherkasova, M. Arlitt, A. Andrzejak, A capacity management service for resource pools, in: Proc. of the 5th International Workshop on Software and Performance, 2005, pp. 229237.
49. N. Roy, J.S. Kinnebrew, N. Shankaran, G. Biswas, D.C. Schmidt, Toward effective multi-capacity resource allocation in distributed real-time and embedded systems, in: Proceedings of the 11th Symposium on Object Oriented Real-Time and Distributed Computing, 2008.
50. P. Ruth, R. Junghwan, D. Xu, R. Kennell, S. Goasguen, Autonomic live adaptation of virtual computational environments in a multi-domain infrastructure, in: Proc. of the IEEE Intl. Conf. on Autonomic Computing, June 2006, pp. 514.
51. D. Schanzenbach, H. Casanova, Accuracy and responsiveness of CPU sharing using Xen's cap values, Technical Report ICS2008-05-01, Computer and Information Sciences Dept., University of Hawai'i at Mnoa. Available at: http://www.ics.hawaii.edu/research/tech-reports/ICS2008-05-01.pdf/view (May 2008).
52. K. Shen, H. Tang, T. Yang, L. Chu, Integrated resource management for cluster-based internet services, in: Proc. of the 5th Symposium on Operating Systems Design and Implementation, December 2002.
53. P. Shivam, S. Babu, J. Chase, Active and accelerated learning of cost models for optimizing scientific applications, in: Proc. of the International Conference on Very Large Data Bases, VLDB, 2006.
54. Y. Song, H. Wang, Y. Li, B. Feng, Y. Sun, Multi-tiered on-demand resource scheduling for VM-based data center, in: Proc. of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid, 2009, pp. 148155.
55. C. Stewart, K. Shen, Performance modeling and system management for multi-component online services, in: Proc. of the 2nd Symposium on Networked Systems Design & Implementation, 2005, pp. 7184.
56. M. Stillwell, D. Schanzenbach, F. Vivien, H. Casanova, Resource allocation using virtual clusters, Technical Report ICS2008-09-01, Information and Computer Sciences Dept., University of Hawai'i at Mnoa, September 2008.
57. M. Stillwell, D. Schanzenbach, F. Vivien, H. Casanova, Resource allocation using virtual clusters, in: Proc. of the 9th IEEE Symposium on Cluster Computing and the Grid, CCGrid'09, May 2009.
58. M. Stillwell, F. Vivien, H. Casanova, Dynamic fractional resource scheduling for HPC workloads, in: Proc. of the 24th IEEE International Parallel & Distributed Processing Symposium, IPDPS, April 2010.
59. B. Urgaonkar, P. Shenoy, A. Chandra, P. Goyal, and T. Wood Agile dynamic provisioning of multi-tier internet applications ACM Transactions on Autonomous and Adaptive Systems 3 1 2008 1 39
60. B. Urgaonkar, P. Shenoy, and T. Roscoe Resource overbooking and application profiling in shared hosting platforms SIGOPS Operating Systems Review 36 SI 2002 239 254
61. US Environmental Protection Agency, Report to Congress on Server and Data Center Energy Efficiency. http://repositories.cdlib.org/lbnl/LBNL-363E/ (August 2007).
62. Virtualcenter, 2008, http://www.vmware.com/products/vi/vc.
63. VMware. http://www.vmware.com/.
64. R. Wang, N. Kandasamy, A distributed control framework for performance management of virtualized computing environments: some preliminary results, in: Proc. of the 1st Workshop on Automated Control for Datacenters and Clouds, 2009, pp. 712.
65. A. Warfield, S. Hand, T. Harris, I. Pratt, Isolation of shared network resources in XenoServers, Technical Report PDN-02-2006, PlanetLab Project, November 2002.
66. P. Willmann, J. Shafer, D. Carr, A. Menon, S. Rixner, A.L. Cox, W. Zwaenepoel, Concurrent direct network access for virtual machine monitors, in: Proc. of the Intl. Symp. on High-Performance Computer Architecture, February 2007.
67. T. Wood, L. Cherkasova, K. Ozonat, P. Shenoy, Profiling and modeling resource usage of virtualized applications, in: Proceedings of the 9th International ACM/IFIP/USENIX Middleware Conference, 2008.
68. Proc. of the 1st USENIX Workshop on I/O Virtualization, WIOV, December 2008.
69. Citric XenServer enterprise, 2008. http://www.xensource.com/products/ Pages/XenEnterprise.aspx.
70. X. Zhu, D. Young, B.J. Watson, Z. Wang, J. Rolia, S. Singhal, B. McKee, C. Hyser, D. Gmach, R. Gardner, T. Christian, L. Cherkasova, 1000 Islands: integrated capacity and workload management for the next generation data center, in: Proceedings of the International Conference on Autonomic Computing, ICAC'08, June 2008, pp. 172181.