Network-aware virtual machine placement and migration in cloud data centers

Emerging Research in Cloud Distributed Computing Systems

Volumn , Issue , 2015, Pages 42-91

  Ferdaus, Md Hasanul ^a   Murshed, Manzur ^b   Calheiros, Rodrigo N ^c   Buyya, Rajkumar ^c  

^a MONASH UNIVERSITY   (Australia)

^b UNIVERSITY OF BALLARAT   (Australia)

^c UNIVERSITY OF MELBOURNE   (Australia)

Author keywords

Cloud computing; Data center; Network topology; Virtual machine; Virtualization; VM live migration; VM placement

Indexed keywords

CLOUD COMPUTING; COMPUTER SUPPORTED COOPERATIVE WORK; DIGITAL STORAGE; ENERGY UTILIZATION; NETWORK ARCHITECTURE; NETWORK SECURITY; SURVEYS; VIRTUAL MACHINE; VIRTUALIZATION;

DATA CENTERS; FUTURE RESEARCH DIRECTIONS; LIVE MIGRATIONS; NETWORK RESOURCE UTILIZATION; NETWORK TOPOLOGY; STATE-OF-THE-ART TECHNIQUES; VIRTUAL MACHINE PLACEMENTS; VM PLACEMENTS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 84954342112     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.4018/978-1-4666-8213-9.ch002     Document Type: Chapter

References (91)

1. Adra, B., Blank, A., Gieparda, M., Haust, J., Stadler, O.,&Szerdi, D. (2004). Advanced power virtualization on ibm eserver p5 servers: Introduction and basic configuration. IBM Corp.
2. Agrawal, S., Bose, S.K.,&Sundarrajan, S. (2009). Grouping genetic algorithm for solving the server consolidation problem with conflicts. In proceedings of the first ACM/SIGEVO summit on genetic and evolutionary computation. ACM. doi:10.1145/1543834.1543836
3. Al-fares, M., Loukissas, A.,&Vahdat, A. (2008). A scalable, commodity data center network architecture. Computer communication review, 38(4), 63-74. doi:10.1145/1402946.1402967
4. Armbrust, M., Fox, A., Griffith, R., Joseph, A.D., Katz, R.,&Konwinski, A. (2010). A view of cloud computing. Communications of the ACM, 53(4), 50-58. doi:10.1145/1721654.1721672
5. Armour, G. C.,&Buffa, E. S. (1963). A heuristic algorithm and simulation approach to relative location of facilities. Management science, 9(2), 294-309. doi:10.1287/mnsc.9.2.294
6. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A.,&Warfield, A. et al. (2003). Xen and the art of virtualization. Operating systems review, 37(5), 164-177. doi:10.1145/1165389.945462
7. Bharathi, S., Chervenak, A., Deelman, E., Mehta, G., Su, M.H.,&Vahi, K. (2008). Characterization of scientific workflows. In proceedings of third workshop on workflows in support of large-scale science. Academic press.
8. Bhuyan, L. N.,&Agrawal, D. P. (1984). Generalized hypercube and hyperbus structures for a computer network. IEEE transactions on computers, 100(4), 323-333.
9. Biran, O., Corradi, A., Fanelli, M., Foschini, L., Nus, A., Raz, D., &Silvera, E. (2012). A stable network-aware VM placement for cloud systems. In proceedings of the 2012 12th IEEE/ACM international symposium on cluster, Cloud and Grid Computing (CCGRID 2012) (pp 498-506). IEEE. doi:10.1109/CCGrid.2012.119
10. Burkard, R. E.,&Rendl, F. (1984). A thermodynamically motivated simulation procedure for combinatorial optimization problems. European journal of operational research, 17(2), 169-174. doi:10.1016/0377-2217(84)90231-5
11. Buyya, R., Broberg, J.,&Goscinski, A. M. (2010). Cloud computing: Principles and paradigms (Vol. 87). John Wiley&Sons.
12. Buyya, R., Ranjan, R.,&Calheiros, R. N. (2009). Modeling and simulation of scalable cloud computing environments and the CloudSim toolkit: Challenges and opportunities. In proceedings of high performance computing&simulation. Academic press.
13. Calheiros, R. N., Ranjan, R., Beloglazov, A., De Rose, C. A.,&Buyya, R. (2011). CloudSim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms. Software, Practice&Experience, 41(1), 23-50. doi:10.1002/spe.995
14. Chen, M., Zhang, H., Su, Y.Y., Wang, X., Jiang, G.,&Yoshihira, K. (2011). Effective vm sizing in virtualized data centers. In proceedings of integrated network management (pp. 594-601). Academic press. doi:10.1109/INM.2011.5990564
15. Cisco, M.D.S. 9000 SANTap. (2014). Retrieved from http://www.cisco.com/c/en/us/products/collateral/storage-networking/mds-9000-santap/data_sheet_c78-568960.html
16. cisco data center infrastructure 2.5 design guide. (2014). Retrieved from http://www.cisco.com/c/en/us/td/docs/solutions/Enterprise/Data_Center/DC_Infra2_5/DCI_SRND_2_5a_book/DCInfra_1a.html
17. Clark, C., Fraser, K., Hand, S., Hansen, J.G., Jul, E., Limpach, C., . . . Warfield, A. (2005). Live migration of virtual machines. In proceedings of the 2nd conference on symposium on networked systems design&implementation (vol. 2, pp. 273-286). Academic press.
18. Crosby, S.,&Brown, D. (2006). The virtualization reality. Queue, 4(10), 34-41. doi:10.1145/1189276.1189289
19. Ersoz, D., Yousif, M. S.,&Das, C. R. (2007). Characterizing network traffic in a cluster-based, multi-tier data center. In proceedings of distributed computing systems (pp. 59-59). Academic press. doi:10.1109/ICDCS.2007.90
20. Ferdaus, M. H., Murshed, M., Calheiros, R. N.,&Buyya, R. (2014). Virtual machine consolidation in cloud data centers using ACO metaheuristic. In proceedings of Euro-Par 2014 parallel processing (pp. 306-317). Springer. doi:10.1007/978-3-319-09873-9_26
21. Georgiou, S., Tsakalozos, K.,&Delis, A. (2013). Exploiting network-topology awareness for VM placement in Iaas clouds. In proceedings of cloud and green computing (CGC) (pp. 151-158). Academic press. doi:10.1109/CGC.2013.30
22. Greenberg, A., Hamilton, J. R., Jain, N., Kandula, S., Kim, C., Lahiri, P.,&Sengupta, S. etal. (2009). VL2: A scalable and flexible data center network. Computer communication review, 39(4), 51-62. doi:10.1145/1594977.1592576
23. Guo, C., Lu, G., Li, D., Wu, H., Zhang, X., Shi, Y.,&Lu, S. etal.(2009).BCube: A high performance, server-centric network architecture for modular data centers. Computer communication review, 39(4), 63-74. doi:10.1145/1594977.1592577
24. Guo, C., Wu, H., Tan, K., Shi, L., Zhang, Y.,&Lu, S. (2008). Dcell: A scalable and faulttolerant network structure for data centers. Computer communication review, 38(4), 75-86. doi:10.1145/1402946.1402968
25. Gupta, R., Bose, S.K., Sundarrajan, S., Chebiyam, M.,&Chakrabarti, A. (2008). A two stage heuristic algorithm for solving the server consolidation problem with item-item and bin-item incompatibility constraints. In proceedings of services computing (Vol. 2, pp. 39-46). IEEE. doi:10.1109/SCC.2008.39
26. Hines, M. R., Deshpande, U.,&Gopalan, K. (2009). Post-copy live migration of virtual machines. Operating systems review, 43(3), 14-26. doi:10.1145/1618525.1618528
27. Huang, D., Gao, Y., Song, F., Yang, D., &Zhang, H. (2013). Multi-objective virtual machine migration in virtualized data center environments. In proceedings of communications (ICC) (pp. 3699- 3704). IEEE. doi:10.1109/ICC.2013.6655129
28. Huang, D., Yang, D., Zhang, H.,&Wu, L. (2012). Energy-aware virtual machine placement in data centers. In proceedings of global communications conference (GLOBECOM). IEEE.
29. Kandula, S., Sengupta, S., Greenberg, A., Patel, P.,&Chaiken, R. (2009). The nature of data center traffic: Measurements&analysis. In proceedings of the 9th ACM SIGCOMM conference on internet measurement (pp. 202-208). ACM. doi:10.1145/1644893.1644918
30. Kivity, A., Kamay, Y., Laor, D., Lublin, U.,&Liguori, A. (2007). KVM: The Linux virtual machine monitor. In proceedings of the linux symposium (Vol. 1, pp. 225-230). Academic press
31. Kliazovich, D., Bouvry, P.,&Khan, S. U. (2013). DENS: Data center energy-efficient networkaware scheduling. Cluster computing, 16(1), 65-75. doi:10.1007/s10586-011-0177-4
32. Korupolu, M., Singh, A.,&Bamba, B. (2009). Coupled placement in modern data centers. in proceedings of parallel&distributed processing (pp. 1-12). IEEE. doi:10.1109/IPDPS.2009.5161067
33. Kusic, D., Kephart, J. O., Hanson, J. E., Kandasamy, N.,&Jiang, G. (2009). Power and performance management of virtualized computing environments via lookahead control. Cluster computing, 12(1), 1-15. doi:10.1007/s10586-008-0070-y
34. Leiserson, C.E. (1985). Fat-trees: Universal networks for hardware-efficient supercomputing. IEEE transactions on computers, 100(10), 892-901.
35. Lo, J. (2005). VMware and CPU virtualization technology. World wide web electronic publication.
36. Loiola, E.M., de Abreu, N.M.M., Boaventura-netto, P.O., Hahn, P.,&Querido, T. (2007). A survey for the quadratic assignment problem. European journal of operational research, 176(2), 657-690. doi:10.1016/j.ejor.2005.09.032
37. Mann, V., Gupta, A., Dutta, P., Vishnoi, A., Bhattacharya, P., Poddar, R., &Iyer, A. (2012). Remedy: Network-aware steady state VM management for data centers. In proceedings of networking 2012 (pp. 190-204). Springer.
38. Mcvitie, D.G.,&Wilson, L.B. (1971). The stable marriage problem. Communications of the ACM, 14(7), 486-490. doi:10.1145/362619.362631
39. Meng, X., Isci, C., Kephart, J., Zhang, L., Bouillet, E.,&Pendarakis, D. (2010). Efficient resource provisioning in compute clouds via VM multiplexing. In proceedings of the 7th international conference on autonomic computing (pp. 11-20). Academic press. doi:10.1145/1809049.1809052
40. Meng, X., Pappas, V.,&Zhang, L. (2010). Improving the scalability of data center networks with traffic-aware virtual machine placement. In proceedings of INFOCOM (pp. 1-9). IEEE. doi:10.1109/INFCOM.2010.5461930
41. Mysore, R. N., Pamboris, A., Farrington, N., Huang, N., Miri, P., Radhakrishnan, S.,&Vahdat, A. et al. (2009). Portland: A scalable fault-tolerant layer 2 data center network fabric. Computer communication review, 39(4), 39-50. doi:10.1145/1594977.1592575
42. Nelson, M., Lim, B.H., Hutchins, G.,&Associates. (2005). Fast transparent migration for virtual machines. In proceedings of USENIX annual technical conference, General track (pp. 391- 394). Academic press.
43. Nimbus is cloud computing for science. (2014). Retrieved from http://www.nimbusproject.org/
44. Novell platespin recon. (2014). Retrieved from https://www.netiq.com/products/recon/
45. Nurmi, D., Wolski, R., Grzegorczyk, C., Obertelli, G., Soman, S., Youseff, L.,&Zagorodnov, D. (2009). The eucalyptus open-source cloudcomputing system. In proceedings of cluster computing and the grid (pp. 124-131). IEEE. doi:10.1109/CCGRID.2009.93
46. Piao, J. T.,&Yan, J. (2010). A network-aware virtual machine placement and migration approach in cloud computing. In proceedings of grid and cooperative computing (GCC) (pp. 87-92). Academic press. doi:10.1109/GCC.2010.29
47. Pisinger, D. (1997). A minimal algorithm for the 0-1 knapsack problem. Operations research, 45(5), 758-767. doi:10.1287/opre.45.5.758
48. Sapuntzakis, C. P., Chandra, R., Pfaff, B., Chow, J., Lam, M. S.,&Rosenblum, M. (2002). Optimizing the migration of virtual computers. ACM SIGOPS operating systems review, 36(SI), 377-390.
49. Saran, H.,&Vazirani, V.V. (1995). Finding k cuts within twice the optimal. SIAM journal on computing, 24(1), 101-108. doi:10.1137/S0097539792251730
50. Shrivastava, V., Zerfos, P., Lee, K.W., Jamjoom, H., Liu, Y.H.,&Banerjee, S. (2011). Applicationaware virtual machine migration in data centers. In proceedings of INFOCOM, 2011 (pp. 66-70). IEEE. doi:10.1109/INFCOM.2011.5935247
51. Smith, J.,&Nair, R. (2005). Virtual machines: Versatile platforms for systems and processes. Elsevier.
52. Song, F., Huang, D., Zhou, H.,&You, I. (2012). Application-aware virtual machine placement in data centers. In proceedings of innovative mobile and internet services in ubiquitous computing (IMIS) (pp. 191-196). Academic press. doi:10.1109/IMIS.2012.119
53. Sotomayor, B., Montero, R.S., Llorente, I.M.,&Foster, I. (2009). Virtual infrastructure management in private and hybrid clouds. IEEE internet computing, 13(5), 14-22. doi:10.1109/MIC.2009.119
54. Takemura, C.&Crawford, L.S. (2009). The book of Xen: A practical guide for the system administrator. No starch press.
55. Takouna, I., Dawoud, W.,&Meinel, C. (2012). Analysis and simulation of HPC applications in virtualized data centers. In proceedings of green computing and communications (GreenCom) (pp. 498-507). IEEE. doi:10.1109/GreenCom.2012.80
56. Takouna, I., Rojas-cessa, R., Sachs, K.,&Meinel, C. (2013). Communication-aware and energyefficient scheduling for parallel applications in virtualized data centers. In proceedings of utility and cloud computing (UCC) (pp. 251-255). IEEE. doi:10.1109/UCC.2013.50
57. Vaquero, L., Rodero-merino, L., Caceres, J.,&Lindner, M. (2008). A break in the clouds: Towards a cloud definition. Computer communication review, 39(1), 50-55. doi:10.1145/1496091.1496100
58. VMware capacity planner. (2014). Retrieved from http://www.vmware.com/products/capacityplanner
59. Wood, T., Shenoy, P.J., Venkataramani, A.,&Yousif, M.S. (2007). Black-box and gray-box strategies for virtual machine migration. NSDI.
60. Xu, R.,&Wunsch, D. (2005). Survey of clustering algorithms. IEEE transactions on neural networks, 16(3), 645-678.
61. Zayas, E. (1987). Attacking the process migration bottleneck. Operating systems review, 21(5), 13-24. doi:10.1145/37499.37503
62. Zhang, B., Qian, Z., Huang, W., Li, X.,&Lu, S. (2012). Minimizing communication traffic in data centers with power-aware VM placement. In proceedings of innovative mobile and internet services in ubiquitous computing (IMIS) (pp. 280- 285). Academic press. doi:10.1109/IMIS.2012.71
63. Zhang, Q., Cheng, L.,&Boutaba, R. (2010). Cloud computing: State-of-the-art and research challenges. Journal of internet services and applications, 1(1), 7-18.
64. Al-fares, M., Radhakrishnan, S., Raghavan, B., Huang, N.,&Vahdat, A. (2010). Hedera: Dynamic flow scheduling for data center networks. In NSDI (Vol. 10, pp. 19-19).
65. Ballani, H., Jang, K., Karagiannis, T., Kim, C., Gunawardena, D., &O'shea, G. (2013). Chatty tenants and the cloud network sharing problem. In NSDI (pp. 171-184).
66. Bansal, N., Lee, K.W., Nagarajan, V.,&Zafer, M. (2011). Minimum congestion mapping in a cloud. In Proceedings of the 30th annual ACM SIGACT-SIGOPS symposium on principles of distributed computing (pp. 267-276). ACM. doi:10.1145/1993806.1993854
67. Benson, T., Akella, A., Shaikh, A., &Sahu, S. (2011). Cloudnaas: a cloud networking platform for enterprise applications. In Proceedings of the 2nd ACM symposium on cloud computing (p. 8). ACM. doi:10.1145/2038916.2038924
68. Bose, S. K.,&Sundarrajan, S. (2009). Optimizing migration of virtual machines across datacenters. In parallel processing workshops, 2009. ICPPW'09. International conference on (pp. 306-313). IEEE. doi:10.1109/ICPPW.2009.39
69. Calcavecchia, N.M., Biran, O., Hadad, E.,&Moatti, Y. (2012). VM placement strategies for cloud scenarios. In cloud computing (CLOUD), 2012 IEEE 5th international conference on (pp. 852-859). IEEE. doi:10.1109/CLOUD.2012.113
70. Chaisiri, S., Lee, B. S.,&Niyato, D. (2009). Optimal virtual machine placement across multiple cloud providers. In services computing conference, 2009. APSCC 2009. IEEE Asia-Pacific (pp. 103-110). IEEE. doi:10.1109/APSCC.2009.5394134
71. Cruz, J.,&Park, K. (2001). Towards communication-sensitive load balancing. In distributed computing systems, 2001. 21st international conference on. (pp. 731-734). IEEE. doi:10.1109/ICDSC.2001.919011
72. Fan, P., Chen, Z., Wang, J., Zheng, Z.,&Lyu, M. R. (2012). Topology-aware deployment of scientific applications in cloud computing. In cloud computing (CLOUD), 2012 IEEE 5th international conference on (pp. 319-326). IEEE. doi:10.1109/CLOUD.2012.70
73. Ferreto, T. C., Netto, M. A., Calheiros, R. N.,&De Rose, C. A. (2011). Server consolidation with migration control for virtualized data centers. Future generation computer systems, 27(8), 1027-1034. doi:10.1016/j.future.2011.04.016
74. Gupta, A., Kalé, L. V., Milojicic, D., Faraboschi, P.,&Balle, S. M. (2013). HPC-aware VM placement in infrastructure clouds. In cloud engineering (IC2E), 2013 IEEE international conference on (pp. 11-20). IEEE.
75. Gupta, A., Milojicic, D.,&Kaĺ, L. V. (2012). Optimizing VM Placement for HPC in the Cloud. In proceedings of the 2012 workshop on Cloud services, federation, and the 8th open cirrus summit (pp. 1-6). ACM. doi:10.1145/2378975.2378977
76. Hyser, C., Mckee, B., Gardner, R.,&Watson, B.J. (2007). Autonomic virtual machine placement in the data center. Hewlett packard laboratories, Tech. Rep. HPL-2007-189, 2007-189.
77. Jung, G., Hiltunen, M.A., Joshi, K.R., Schlichting, R.D.,&Pu, C. (2010). Mistral: Dynamically managing power, performance, and adaptation cost in cloud infrastructures. In distributed computing systems (ICDCS), 2010 IEEE 30th international conference on (pp. 62-73). IEEE.
78. Kozuch, M.A., Ryan, M.P., Gass, R., Schlosser, S.W., O'hallaron, D., Cipar, J.,&Ganger, G. R. (2009). Tashi: location-aware cluster management. In Proceedings of the 1st workshop on automated control for datacenters and clouds (pp. 43-48). ACM. doi:10.1145/1555271.1555282
79. Machida, F., Kim, D. S., Park, J. S.,&Trivedi, K. S. (2008). Toward optimal virtual machine placement and rejuvenation scheduling in a virtualized data center. In software reliability engineering workshops, 2008. ISSRE Wksp 2008. IEEE international conference on (pp. 1-3). IEEE. doi:10.1109/ISSREW.2008.5355515
80. Mann, V., Gupta, A., Dutta, P., Vishnoi, A., Bhattacharya, P., Poddar, R.,&Iyer, A. (2012). Remedy: Network-aware steady state VM management for data centers. In NETWORKING 2012 (pp. 190-204). Springer berlin heidelberg.
81. Mann, V., Kumar, A., Dutta, P.,&Kalyanaraman, S. (2011). VMFlow: leveraging VM mobility to reduce network power costs in data centers. In NETWORKING 2011 (pp. 198-211). Springer berlin heidelberg. doi:10.1007/978- 3-642-20757-0_16
82. Mogul, J. C.,&Popa, L. (2012). What we talk about when we talk about cloud network performance. Computer communication review, 42(5), 44-48. doi:10.1145/2378956.2378964
83. Nakada, H., Hirofuchi, T., Ogawa, H.,&Itoh, S. (2009). Toward virtual machine packing optimization based on genetic algorithm. In Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living (pp. 651-654). Springer berlin heidelberg. doi:10.1007/978-3-642-02481-8_96
84. Rodrigues, H., Santos, J. R., Turner, Y., Soares, P.,&Guedes, D. (2011). Gatekeeper: Supporting bandwidth guarantees for multi-tenant datacenter networks. In WIOV.
85. Shieh, A., Kandula, S., Greenberg, A. G., Kim, C.,&Saha, B. (2011). Sharing the data center network. In NSDI.
86. Sonnek, J., Greensky, J., Reutiman, R.,&Chandra, A. (2010). Starling: Minimizing communication overhead in virtualized computing platforms using decentralized affinity-aware migration. In parallel processing (ICPP), 2010 39th international conference on (pp. 228-237). IEEE.
87. Stage, A.,&Setzer, T. (2009). Network-aware migration control and scheduling of differentiated virtual machine workloads. In proceedings of the 2009 ICSE workshop on software engineering challenges of cloud computing (pp. 9-14). IEEE computer society. doi:10.1109/CLOUD.2009.5071527
88. Tsakalozos, K., Roussopoulos, M.,&Delis, A. (2011). VM placement in non-homogeneous Iaas-clouds. In service-oriented computing (pp. 172-187). Springer berlin heidelberg. doi:10.1007/978-3-642-25535-9_12
89. Wang, S.H., Huang, P.P.W., Wen, C.H.P.,&Wang, L.C. (2014). EQVMP: Energy-efficient and QoS-aware virtual machine placement for software defined datacenter networks. In information networking (ICOIN), 2014 International Conference on (pp. 220-225). IEEE.
90. Xu, J.,&Fortes, J. (2011). A multi-objective approach to virtual machine management in datacenters. In Proceedings of the 8th ACM international conference on autonomic computing (pp. 225-234). ACM. doi:10.1145/1998582.1998636
91. Zhang, Y., Su, A. J.,&Jiang, G. (2011). Understanding data center network architectures in virtualized environments: A view from multi-tier applications. Computer networks, 55(9), 2196-2208. doi:10.1016/j.comnet.2011.03.001