Load-balancing algorithms in cloud computing: A survey

Journal of Network and Computer Applications

Volumn 88, Issue , 2017, Pages 50-71

  Jafarnejad Ghomi, Einollah ^a   Masoud Rahmani, Amir ^a   Nasih Qader, Nooruldeen ^b  

^a ISLAMIC AZAD UNIVERSITY   (Iran)

^b UNIVERSITY OF HUMAN DEVELOPMENT   (Iraq)

Author keywords

Cloud computing; Hadoop MapReduce; Load balancing; Task scheduling

Indexed keywords

CLOUD COMPUTING; MULTITASKING; QUALITY OF SERVICE; RESOURCE ALLOCATION; SCHEDULING ALGORITHMS;

APPLICATION-ORIENTED; HADOOP MAPREDUCE; LOAD BALANCING ALGORITHMS; MODERN PARADIGMS; NATURAL PHENOMENA; NETWORK-AWARE; RESOURCE UTILIZATIONS; TASK-SCHEDULING;

COMPUTER SUPPORTED COOPERATIVE WORK;

EID: 85018753533     PISSN: 10848045     EISSN: 10958592     Source Type: Journal    
DOI: 10.1016/j.jnca.2017.04.007     Document Type: Review

References (108)

1. Abdolhamid, M., Shafi'i, M., Bashir, M.B., Scheduling techniques in on-demand grid as a service cloud: a review”. J. Theor. Appl. Inf. Technol. 63:1 (2014), 10–19.
2. Abdullahi, M., Md, Asri Ngadi, Md.A., Abdulhamid, S.M., Symbiotic organism search optimization based task scheduling in cloud computing environment. Future Gener. Comput. Syst. 56 (2015), 640–650.
3. Aditya, A., Chatterjee, U., Gobata, S., A comparative study of different static and dynamic load-balancing algorithm in cloud computing with special emphasis on time factor. Int. J. Curr. Eng. Technol., 3(5), 2015.
4. Ahmad, F., Chakradhar,S.T., Raghunathan,A., Vijaykumar, T.N., 2012. Tarazu: optimizing mapreduce on het-erogeneous clusters. International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). 40(1), 61-74.
5. Ahmad, R.W., Gani, A., Hamid, S.H.A., Shiraz, M., A survey on virtual machine migration and server consolidation frameworks for cloud data centers. J. Netw. Comput. Appl. 52 (2015), 11–25.
6. Alakeel, A.M., A guide to dynamic load balancing in distributed computer systems. Int. J. Comput. Sci. Netw. Secur. 10:6 (2010), 153–160.
7. Apostu, A., Puican, F., Ularu, G., George Suciu, G., Todoran, G., Study on advantages and disadvantages of cloud computing – the advantages of telemetry applications in the cloud. Recent Adv. Appl. Comput. Sci. Digit. Serv., 2013.
8. Babu, L.D.D., Krishna, P.V., Honey bee behavior inspired load balancing of tasks in cloud computing environments. Appl. Soft Comput. 13:5 (2013), 2292–2303.
9. Bellavista, P., Cinque, M., Corradi, A., Foschini, L., Frattini, F., Molina, J.P., GAMESH: a grid architecture for scalable monitoring and enhanced dependable job scheduling. Future Gener. Comput. Syst., 2016.
10. Benifa, J.V.B., Dejey, Performance improvement of MapReduce for heterogeneous clusters based on efficient locality and Replica aware scheduling (ELRAS) strategy. Wirel. Personal. Commun., 2017, 1–25.
11. Bhatia, J., Patel, T., Trivedi, H., Majmudar, V., 2012. HTV Dynamic Load-balancing algorithm for Virtual Machine Instances in Cloud. International Symposium on Cloud and Services Computing, 15–20.
12. Bok, K., Hwang, J., Jongtae Lim, J., Kim, Y., Yoo, J., An efficient MapReduce scheduling scheme for processing large multimedia data. Multimed. Tools Appl., 2016, 1–24.
13. Cai, Z., Li, X., Ruizc, R., Lia, Q., A delay-based dynamic scheduling algorithm for bag-of-task workflows with stochastic task execution times in clouds. J. Future Gener. Comput. Syst. 71 (2017), 57–72.
14. Chethana, R., Neelakantappa, B.B., Ramesh, B., Survey on adaptive task assignment in heterogeneous Hadoop cluster. IEAE Int. J. Eng., 1(1), 2016.
15. Chien, N.K., Son, N.H., HD, 2016. Load-balancing algorithm Based on Estimating Finish Time of Services in Cloud Computing, International Conference on Advanced Commutation Technology (ICACT), 228-233.
16. Cinque, M., Corradi, A., Luca Foschini,L., Frattini, F., Mol, J.P., 2016. Scalable Monitoring and Dependable Job Scheduling Support for Multi-domain Grid Infrastructures. In: Proceedings of the 31st Annual ACM Symposium on Applied Computing.
17. Dagli, M.K., Mehta, B.B., Big data and Hadoop: a review. Int. J. Appl. Res. Eng. Sci., 2(2), 2014, 192.
18. Daraghmi, E.Y., Yuan, S.M., A small world based overlay network for improving dynamic load-balancing. J. Syst. Softw. 107 (2015), 187–203.
19. Dasgupta, K., Mandalb, B., Duttac, P., Mondald, J.K., Dame, S., 2013. A Genetic Algorithm (GA) based Load-balancing strategy for Cloud Computing, International Conference on Computational Intelligence: Modeling Techniques and Applications (CIMTA), 10, 340-347.
20. Destanoğlu, O., Sevilgen, F.E., 2008. Randomized Hydrodynamic Load Balancing Approach, IEEE International Conference on Parallel Processing, 1, 196-203.
21. Deye, M.M., Slimani, Y., sene, M., 2013. Load Balancing approach for QoS management of multi-instance applications in Clouds. Proceeding on International Conference on Cloud Computing and Big Data, 119–126.
22. Domanal, S.G., Reddy, G.R.M., 2015. Load Balancing in Cloud Environment using a Novel Hybrid Scheduling Algorithm. IEEE International Conference on Cloud Computing in Emerging Markets, 37-42.
23. Doulkeridis, C., Nørvåg, K., A survey of large-scale analytical query processing in MapReduce. VLDB J., 2013, 1–26.
24. Dsouza, M.B., A survey of Hadoop MapReduce scheduling algorithms. Int. J. Innov. Res. Comput. Commun. Eng., 3(7), 2015.
25. Fadika, Z., Dede, E., Govidaraju, M., 2011. Benchmarking MapReduce Implementations for Application Usage Scenarios. In: 2011 IEEE/ACM Proceedings of the 12th International Conference on Grid Computing, 0, 90–97.
26. Farrag, A.A.S., Mahmoud, S.A., 2015. Intelligent Cloud Algorithms for Load Balancing problems: A Survey. IEEE In: Proceedings of the Seventh International Conference on Intelligent Computing and Information Systems (ICICIS 'J 5), 210-216.
27. Gautam, J.V., Prajapati, H.B., Dabhi, V.K., Chaudhary, S., 2015. A Survey on Job Scheduling Algorithms in Big Data Processing. IEEE International Conference on Electrical, Computer and Communication Technologies (ICECCT'15), 1-11.
28. Ghoneem, M., Kulkarni, L., 2016. An Adaptive MapReduce Scheduler for Scalable Heterogeneous Systems. Proceeding of the International Conference on Data Engineering and Communication Technology, 603–6011.
29. Ghosh, S., Banerjee, C., 2016. Priority Based Modified Throttled Algorithm in Cloud Computing. International Conference on Inventive Computation Technology.
30. Goyal, S., Verma, M.K., Load balancing techniques in cloud computing environment: a review. Int. J. Adv. Res. Comput. Sci. Softw. Eng., 6(4), 2016.
31. Gupta, H., Sahu, K., Honey bee behavior based load balancing of tasks in cloud computing. Int. J. Sci. Res., 3(6), 2014.
32. Gutierrez-Garcia, J.O., Ramirez-Nafarrate, A., Agent-based load balancing in Cloud data centers. Clust. Comput. 18:3 (2015), 1041–1062.
33. Hefny, H.A., Khafagy, M.H., Ahmed, M.W., Comparative study load balance algorithms for MapReduce environment. Int. Appl. Inf. Syst., 106(18), 2014, 41.
34. Hou, X., Kumar, A., Varadharajan, V., 2014. Dynamic Workload Balancing for Hadoop MapReduce. Proceeding of International Conference on Big data and Cloud Computing, 56-62.
35. Hsueh, S.C., Lin, M.Y., Chiu, Y.C., A load-balanced MapReduce algorithm for blocking-based entity-resolution with multiple keys. Parallel Distrib. Comput.(AusPDC), 2014, 3.
36. Hwang, K., Dongarra, J., Fox, G.C., 2013. Distributed and Cloud Computing: from Parallel Processing to the Internet of Things.
37. Ivanisenko, I.N., Radivilova, T.A., 2015. Survey of Major Load-balancing algorithms in Distributed System. Information Technologies in Innovation Business Conference (ITIB).
38. Jadeja, Y., Modi, K., 2012. Cloud Computing - Concepts, Architecture and Challenges. International Conference on Computing, Electronics and Electrical Technologies [ICCEET].
39. Jaikar, A., Dada, H., Kim, G.R., Noh, S.Y., 2014. Priority-based Virtual Machine Load Balancing in a Scientific Federated Cloud. IEEE In: Proceedings of the 3rd International Conference on Cloud Computing.
40. Kabir, M.S., Kabir, K.M., Islam, R., Process of load balancing in cloud computing using genetic algorithm. Electr. Comput. Eng.: Int. J., 4(2), 2015.
41. Kanakala, V.R.T., Reddy, V.K., Performance analysis of load balancing techniques in cloud computing environment. TELKOMNIKA Indones. J. Electr. Eng. 13:3 (2015), 568–573.
42. Kanakala, V.R.T., Reddy, V.K., Performance analysis of load balancing techniques in cloud computing environment. TELKOMNIKA Indones. J. Electr. Eng. 13:3 (2015), 568–573.
43. Kansal, N.J., Inderveer Chana, I., Cloud load balancing techniques: a step towards green computing. Int. J. Comput. Sci. Issues 9:1 (2012), 238–246.
44. Kaur, R., Luthra, P., 2014. Load Balancing in Cloud Computing, International Conference on Recent Trends in Information. Telecommunication and Computing, ITC, pp. 1–8.
45. Kc, K., Anyanwu, K., 2010. Scheduling Hadoop Jobs to Meet Deadlines. In: Proceedings of the 2nd IEEE International Conference on Cloud Computing Technology and Science (CloudCom), 388–392.
46. Keshvadi, S., Faghih, B., A multi-agent based load balancing system in IaaS cloud environment. Int. Robot. Autom. J., 1(1), 2016.
47. Khalil, S., Salem, S.A., Nassar, S., Saad, E.M., Mapreduce performance in heterogeneous environments: a review. Int. J. Sci. Eng. Res. 4:4 (2013), 410–416.
48. Khiyaita, A., Zbakh, M., Bakkali, H.E.I., Kettani, D.E.I., Load balancing cloud computing: state of art. Netw. Secur. Syst. (JNS2), 2012, 106–109.
49. Kianpisheh, S., Charkari, N.M., Kargahi, M., Ant colony based constrained workflow scheduling for heterogeneous computing systems. Clust. Comput. 19 (2016), 1053–1070.
50. Kliazovich, D., Pecero, J.E., Tchernykh, A., Bouvry, P., Khan, S.U., Zomaya, A.Y., CA-DAG: modeling communication-aware applications for scheduling in cloud computing. J. Grid Comput., 2016, 1–17.
51. Kolb, L., Thor, A., Rahm, E., 2011. Block-based Load Balancing for Entity Resolution with MapReduce. International Conference on Information and Knowledge Management (CIKM), 2397–2400.
52. Kolb, L., Thor, A., Rahm, E., 2012. Load Balancing for MapReduce-based Entity Resolution, IEEE In: Proceedings of the 28th International Conference on Data Engineering, 618-629.
53. Komarasamy, D., Muthuswamy, V., A novel approach for dynamic load balancing with effective Bin packing and VM reconfiguration in cloud. Indian J. Sci. Technol. 9:11 (2016), 1–6.
54. Koomey, J.G., Worldwide electricity used in datacenters. Environ. Res. Lett., 3(3), 2008, 034008.
55. Kulkarni, A.K., B, A, 2015. Load-balancing strategy for Optimal Peak Hour Performance in Cloud Datacenters. In: Proceedings of theIEEE International Conference on Signal Processing, Informatics, Communication and Energy Systems (SPICES).
56. Kumar, S., Rana, D.H., Various dynamic load-balancing algorithms in cloud environment: a survey. Int. J. Comput. Appl., 129(6), 2015.
57. Lee, K.H., Choi, H., Moon, B., Parallel data processing with MapReduce: a survey. SIGMOD Rec. 40:4 (2011), 11–20.
58. Li, R., Hu, H., Li, H., Wu, Y., Yang, J., MapReduce parallel programming model: a state-of-the-art survey. Int. J. Parallel Program., 2015, 1–35.
59. 18th Lin, C.Y., Lin, Y.C., 2015. A Load-Balancing Algorithm for Hadoop Distributed File System, International Conference on Network-Based Information Systems.
60. Lua, Y., Xie, Q., Klito, G., Geller, A., Larus, J.R., Greenberg, A., Join-Idle-Queue: a novel load-balancing algorithm for dynamically scalable web services. Int. J. Perform. Eval. 68 (2011), 1056–1071.
61. Malladi, R.R., An approach to load balancing In cloud computing. Int. J. Innov. Res. Sci. Eng. Technol. 4:5 (2015), 3769–3777.
62. Manjaly, J.S., A, CE, Relative study on task schedulers in Hadoop MapReduce. Int. J. Adv. Res. Comput. Sci. Softw. Eng., 3(5), 2013.
63. Mesbahi, M., Rahmani, A.M., Load balancing in cloud computing: a state of the art survey. Int. J. Mod. Educ. Comput. Sci., 8(3), 2016, 64.
64. Milani, A.S., Navimipour, N.J., Load balancing mechanisms and techniques in the cloud environments: systematic literature review and future trends. J. Netw. Comput. Appl. 71 (2016), 86–98.
65. Mishra, N.K., Misha, N., Load balancing techniques: need, objectives and major challenges in cloud computing: a systematic review. Int. J. Comput., 131(18), 2015.
66. Moschakisa, I.A., Karatzaa, H.D., Multi-criteria scheduling of Bag-of-Tasks applications on heterogeneous interlinked clouds with simulated annealing. J. Softw. Syst. 101 (2015), 1–14.
67. Mukhopadhyay, R., Ghosh, D. Mukherjee, N., 2010. A Study on the application of existing load-balancing algorithms for large, dynamic, and heterogeneous distributed systems ACM, A Study on the Application of Existing Load-balancing algorithms for Large, Dynamic, and Heterogeneous Distributed System. In Proceedings of 9th International Conference on Software Engineering, Parallel and Distributed Systems,238–243.
68. Neeraj, R., Chana, I., Load balancing and job migration techniques in grid: a survey of recent trends. Wirel. Personal. Commun. 79:3 (2014), 2089–2125.
69. Nishant, K., Sharma, P., Krishna, V., Gupta, C., Singh, K.P., Nitin, N., Rastogi,R., 2012. Load Balancing of Nodes in Cloud Using Ant Colony Optimization. In: Proceedings of the 14th International Conference on Modelling and Simulation, 3-8.
70. Nuaimi, K., Mohamed, N., Mariam Al-Nuaimi, M., Al-Jaroodi, J., 2012. A Survey of Load Balancing in Cloud Computing: Challenges and Algorithms, IEEE In: Proceedings of the Second Symposium on Network Cloud Computing and Applications.
71. Palta, R., Jeet, R., Load balancing in the cloud computing using virtual machine migration: a review. Int. J. Appl. Innov. Eng. Manag. 3:5 (2014), 437–441.
72. Patel, H.M., A comparative analysis of MapReduce scheduling algorithms for Hadoop. Int. J. Innov. Emerg. Res. Eng., 2(2), 2015.
73. Polato, I., Re, R., Goldman, A., Kon, F., A comprehensive view of Hadoop research – a systematic literature review. J. Netw. Comput. Appl. 46 (2014), 1–25.
74. Rajabioun, R., Cuckoo optimization algorithm. Appl. Soft Comput. 11 (2011), 5508–5518.
75. Randles, M., Lamb, D., Tareb-Bendia, A., 2010. A Comparative Study into Distributed Load-balancing algorithms for Cloud Computing, IEEE In: Proceedings of the 24th International Conference on Advanced Information Networking and Applications Workshops, pp. 551–556.
76. Rao, B.T., Reddy, L.S.S., Survey on improved scheduling in Hadoop MapReduce in cloud environments. Int. J. Comput. Appl., 34(9), 2011.
77. Rastogi, G., Sushil, R., 2015. Analytical Literature Survey on Existing Load Balancing Schemes in Cloud Computing. International Conference on Green Computing and Internet of Things (ICGCloT).
78. Rathore, N., Channa, I., 2011. A Cognitive Analysis of Load Balancing and job migration Technique in Grid World Congress on Information and Communication Technologies Congr. Inf. Commun. Technol. (WICT). pp. 77–82.
79. Rathore, N., Chana, I., 2013. A Sender Initiate Based Hierarchical Load Balancing Technique for Grid Using Variable Threshold Value. Signal Processing, Computing and Control (ISPCC), IEEE International Conference.
80. Ray, S., Sarkar, A.D., Execution analysis of load-balancing algorithms in cloud computing environment. Int. J. Cloud Comput.: Serv. Archit. (IJCCSA), 2(5), 2012.
81. Sarood, O., Gupta, A., Kale, L.V., 2012. Cloud Friendly Load Balancing for HPC Applications: Preliminary Work. International Conference on Parallel Processing Workshops, 200–205.
82. Scharf, M., Stein, M., Voith,T., Hilt, V., 2015. Network-aware Instance Scheduling in OpenStack. International Conference on Computer Communication and Network (ICCCN), 1-6.
83. Selvi, R.T., Aruna, R., Longest approximate time to end scheduling algorithm in Hadoop environment. Int. J. Adv. Res. Manag. Archit. Technol. Eng., 2(6), 2016.
84. Shadkam, E., Bijari, M., Evaluation the efficiency of cuckoo optimization algorithm. Int. J. Comput. Sci. Appl. 4:2 (2014), 39–47.
85. Shaikh, B., Shinde, K., Borde, S., Challenges of big data processing and scheduling of processes using various Hadoop Schedulers: a survey. Int. Multifaceted Multiling. Stud., 3, 2017, 12.
86. Shen, H., Sarker, A., Yuy, L., Feng Deng, F., 2016. Probabilistic Network-Aware Task Placement for MapReduce Scheduling. In: Proceedings of the IEEE International Conference on Cluster Computing.
87. Shen, H., Yu, L., Chen,L., Li, Z., 2016. Goodbye to Fixed Bandwidth Reservation: Job Scheduling with Elastic Bandwidth Reservation in Clouds. In: Proceedings of the International Conference on Cloud Computing Technology and Science.
88. Sidhu, A.K., Kinger, S., Analysis of load balancing techniques in cloud computing. Int. J. Comput. Technol., 4(2), 2013.
89. Sim, K.M., Agent-based cloud computing. IEEE Trans. Serv. Comput. 5:4 (2011), 564–577.
90. Singh, P., Baaga, P., Gupta, S., Assorted load-balancing algorithms in cloud computing: a survey”. Int. J. Comput. Appl., 143(7), 2016.
91. Singha, A., Juneja, D., Malhotra, M., 2015. Autonomous Agent Based Load-balancing algorithm in Cloud Computing. International Conference on Advanced Computing Technologies and Applications (ICACTA), 45, 832–841.
92. Sui, Z., Pallickara, S., A survey of load balancing techniques forData intensive computing. In. Furht, Borko, Escalante, Armando, (eds.) Handbook of Data Intensive Computing, 2011, Springer, New York, 157–168.
93. Tasquier, L., Agent based load-balancer for multi-cloud environments. Columbia Int. Publ. J. Cloud Comput. Res. 1:1 (2015), 35–49.
94. Vaidya, M., Parallel processing of cluster by Map Reduce. Int. J. Distrib. Parallel Syst., 3(1), 2012.
95. Valvåg, S.V., Cogset: A High-Performance MapReduce Engine. 2011, Faculty of Science and Technology Department of Computer Science, University of Tromsö, 14.
96. Valvåg, S.V., Johansen, D., 2009. Cogset: A unified engine for reliable storage and parallel processing, In: Proceedings of the Sixth IFIP International Conference on Network and Parallel Computing, 174–181.
97. Vasic, N., Barisits, M., 2009. Salzgeber, V. Making Cluster Applications Energy-Aware, In ACDC ’09 In: Proceedings of the 1st Workshop on Automated Control for Datacenters and Clouds, ACM, New York, NY, USA, pp. 37–42.
98. Vernica, R., Balmin, A., Beyer, K.S., Ercegovac, V., 2012. Adaptive MapReduce using situation-aware mappers. International Conference on Extending Database Technology (EDBT), 420–431.
99. Wei, X., Fan, J., Lu, Z., Ding, K., Application scheduling in mobile cloud computing with load balancing. J. Appl. Math., 2013, 1–13.
100. Wei, X., Fan, J., Wang, T., Wang, Q., Efficient application scheduling in mobile cloud computing based on MAX–MIN ant system. Soft Comput., 2015, 1–15.
101. Xia, Y., Wang, L., Zhao, Q., Zhang, G., Research on job scheduling algorithm in Hadoop. J. Comput. Inf. Syst. 7 (2011), 5769–5775.
102. Yahaya, B., Latip, R., Othman, M., Abdullah, A., Dynamic load balancing policy with communication and computation elements in grid computing with multi-agent system integration. Int. J. New Comput. Archit. Appl. (IJNCAA) 1:3 (2011), 757–765.
103. Yakhchi, M., Ghafari, S.M., Yakhchi, S., Fazeliy, M., Patooghi, A., 2015. Proposing a Load Balancing Method Based on Cuckoo Optimization Algorithm for Energy Management in Cloud Computing Infrastructures. Published In: Proceedings of the 6th International Conference on Modeling, Simulation, and Applied Optimization (ICMSAO).
104. Yang, S.J., Chen, Y.R., Design adaptive task allocation scheduler to improve MapReduce performance in heterogeneous clouds. J. Netw. Comput. Appl. 57 (2015), 61–70.
105. Zaharia, M., Job Scheduling with the Fair and Capacity Schedulers, 9, 2009, Berkley University.
106. Zaharia, M., Borthakur, D., Sarma, J.S., 2010. Delay Scheduling: A Simple Technique for Achieving Locality and Fairness in Cluster Scheduling, in Proceedings of the European conference on Computer systems (EuroSys'10), 265–278.
107. Zaharia, M., Konwinski, A., Joseph, A.D., Katz, R., Stoica, I., 2008. Improving MapReduce Performance in Heterogeneous Environments. In: Proceedings of the 8th conference on Symposium on Opearting Systems Design and Implementation, 29–42.
108. Zhang, Y., Li, Y., 2015. An improved Adaptive workflow scheduling Algorithm in cloud environments. In: Proceedings of the Third International Conference on Advanced Cloud and Big Data, 112-116.