Evolutionary Multi-Objective Workflow Scheduling in Cloud

IEEE Transactions on Parallel and Distributed Systems

Volumn 27, Issue 5, 2016, Pages 1344-1357

  Zhu, Zhaomeng ^a,b   Zhang, Gongxuan ^a   Li, Miqing ^b   Liu, Xiaohui ^b  

^a NANJING UNIVERSITY OF SCIENCE AND TECHNOLOGY   (China)

^b BRUNEL UNIVERSITY   (United Kingdom)

Author keywords

Cloud computing; evolutionary algorithm; Infrastructure as a Service; multi objective optimization; workflow scheduling

Indexed keywords

ALGORITHMS; CLOUD COMPUTING; COSTS; EVOLUTIONARY ALGORITHMS; MULTIOBJECTIVE OPTIMIZATION; OPTIMIZATION; QUALITY OF SERVICE; SCHEDULING; SCHEDULING ALGORITHMS;

COMPUTATIONAL RESOURCES; EVOLUTIONARY MULTI-OBJECTIVES; EVOLUTIONARY MULTIOBJECTIVE OPTIMIZATION; HETEROGENEOUS COMPUTING; HETEROGENEOUS ENVIRONMENTS; MULTI-OBJECTIVE OPTIMIZATION PROBLEM; POPULATION INITIALIZATIONS; WORKFLOW SCHEDULING;

INFRASTRUCTURE AS A SERVICE (IAAS);

EID: 84963819494     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2015.2446459     Document Type: Article

References (43)

1. P. Mell and T. Grance, "The NIST definition of cloud computing," Nat. Inst. Standards Technol., Gaithersburg, MD, USA, Tech. Rep. 6, 2009.
2. B. Martens, M. Walterbusch, and F. Teuteberg, "Costing of cloud computing services: A total cost of ownership approach," in Proc. IEEE 45th Hawaii Int. Conf. Syst. Sci., 2012, pp. 1563-1572.
3. E. Deelman, G. Singh, M.-H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G. B. Berriman, J. Good, A. Laity, J. C. Jacob, and D. S. Katz, "Pegasus: A framework for mapping complex scientific workflows onto distributed systems," Sci. Programm., vol. 13, no. 3, pp. 219-237, 2005.
4. T. Fahringer, R. Prodan, R. Duan, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H.-L. Truong, A. Villazon, and M. Wieczorek, "Askalon: A grid application development and computing environment," in Proc. 6th IEEE/ACM Int. Workshop Grid Comput., 2005, pp. 122-131.
5. G. Juve, M. Rynge, E. Deelman, J.-S. Vockler, and G. B. Berriman, "Comparing futuregrid, amazon ec2, and open science grid for scientific workflows," Comput. Sci. Eng., vol. 15, no. 4, pp. 20-29, 2013.
6. J. Yu, M. Kirley, and R. Buyya, "Multi-objective planning for workflow execution on grids," in Proc. 8th IEEE/ACM Int. Conf. Grid Comput., 2007, pp. 10-17.
7. M. Wieczorek, A. Hoheisel, and R. Prodan, "Towards a general model of the multi-criteria workflow scheduling on the grid," Future Generation Comput. Syst., vol. 25, no. 3, pp. 237-256, 2009.
8. W.-N. Chen and J. Zhang, "An ant colony optimization approach to a grid workflow scheduling problem with various QoS requirements," IEEE Trans. Syst. Man Cybern. A., Syst. Humans, vol. 39, no. 1, pp. 29-43, Jan. 2009.
9. A. Talukder, M. Kirley, and R. Buyya, "Multiobjective differential evolution for scheduling workflow applications on global grids," Concurrency Comput.: Practice Experience, vol. 21, no. 13, pp. 1742-1756, 2009.
10. F. Zhang, J. Cao, K. Hwang, and C. Wu, "Ordinal optimized scheduling of scientific workflows in elastic compute clouds," in Proc. 3rd IEEE Int. Conf. Cloud Comput. Technol. Sci., 2011, pp. 9-17.
11. R. Garg and A. K. Singh, "Multi-objective workflow grid scheduling based on discrete particle swarm optimization," in Proc. Swarm, Evol., Memetic Comput., 2011, pp. 183-190.
12. M. Zhu, Q. Wu, and Y. Zhao, "A cost-effective scheduling algorithm for scientific workflows in clouds," in Proc. 31th IEEE Int. Perform. Comput. Commun. Conf., 2012, pp. 256-265.
13. O. Udomkasemsub, L. Xiaorong, and T. Achalakul, "A multipleobjective workflow scheduling framework for cloud data analytics," in Proc. 24th IEEE Int. Joint Conf. Comput. Sci. Softw. Eng., 2012, pp. 391-398.
14. M. Malawski, G. Juve, E. Deelman, and J. Nabrzyski, "Cost-and deadline-constrained provisioning for scientific workflow ensembles in IAAS clouds," in Proc. Int. Conf. High Perform. Comput., Netw., Storage Anal., 2012, p. 22.
15. S. Su, J. Li, Q. Huang, X. Huang, K. Shuang, and J. Wang, "Costefficient task scheduling for executing large programs in the cloud," Parallel Comput., vol. 39, no. 4, pp. 177-188, 2013.
16. W. Zheng and R. Sakellariou, "Budget-deadline constrained workflow planning for admission control," J. Grid Comput., vol. 11, no. 4, pp. 633-651, 2013.
17. N. D. Man and E.-N. Huh, "Cost and efficiency-based scheduling on a general framework combining between cloud computing and local thick clients," in Proc. Int. Conf. Comput., Manage. Telecommun., 2013, pp. 258-263.
18. S. Abrishami, M. Naghibzadeh, and D. H. Epema, "Deadlineconstrained workflow scheduling algorithms for infrastructure as a service clouds," Future Generation Comput. Syst., vol. 29, no. 1, pp. 158-169, 2013.
19. H. Arabnejad and J. G. Barbosa, "A budget constrained scheduling algorithm for workflow applications," J. Grid Comput., vol. 12, pp. 665-679, 2014.
20. H. M. Fard, R. Prodan, and T. Fahringer, "Multi-objective list scheduling of workflow applications in distributed computing infrastructures," J. Parallel Distrib. Comput., vol. 74, no. 3, pp. 2152-2165, 2014.
21. R. Garg and A. K. Singh, "Multi-objective workflow grid scheduling using fuzzy dominance sort based discrete particle swarm optimization," J. Supercomput., vol. 68, no. 2, pp. 709-732, 2014.
22. J. J. Durillo and R. Prodan, "Multi-objective workflow scheduling in amazon ec2," Cluster Comput., vol. 17, no. 2, pp. 169-189, 2014.
23. H. Topcuoglu, S. Hariri, and M.-Y. Wu, "Performance-effective and low-complexity task scheduling for heterogeneous computing," IEEE Trans. Parallel Distrib. Syst, vol. 13, no. 3, pp. 260-274, Mar. 2002.
24. R. Sakellariou, H. Zhao, E. Tsiakkouri, and M. D. Dikaiakos, "Scheduling workflows with budget constraints," in Proc. Integr. Res. Grid Comput., 2007, pp. 189-202.
25. I. Foster, Y. Zhao, I. Raicu, and S. Lu, "Cloud computing and grid computing 360-degree compared," in Proc. IEEE Grid Comput. Environments Workshop, 2008, pp. 1-10.
26. C. Computing. (2013, Nov.). Back to the future: 1.21 petaflops (rpeak), 156,000-core cyclecloud HPC runs 264 years of materials science [Online]. Available: http://goo.gl/59ItjU
27. H. Liu. (2014, Feb.). Amazon ec2 grows 62% in 2 years [Online]. Available: http://goo.gl/FgkxoR
28. M. Rosoff. (2015, Apr.). Amazon's true brilliance shone this week in a tale of three clouds. Business Insider. [Online]. Available: http://goo.gl/D6GhW1
29. I. Amazon Web Services. (2014). Amazon ec2 pricing [Online]. Available: http://goo.gl/yKb41s
30. Microsoft. (2014). Virtual machines pricing details [Online]. Available: http://goo.gl/UrDkvF
31. Google. (2014). Google compute engine pricing [Online]. Available: http://goo.gl/fKQwzb
32. K. Deb, A. Pratap, S. Agarwal, and T. Meyarivan, "A fast and elitist multiobjective genetic algorithm: Nsga-ii," IEEE Trans. Evol. Comput., vol. 6, no. 2, pp. 182-197, Apr. 2002.
33. H. Li and Q. Zhang, "Multiobjective optimization problems with complicated pareto sets, moea/d and nsga-ii," IEEE Trans. Evol. Comput., vol. 13, no. 2, pp. 284-302, Apr. 2009.
34. H. Ishibuchi, Y. Hitotsuyanagi, N. Tsukamoto, and Y. Nojima, "Many-objective test problems to visually examine the behavior of multiobjective evolution in a decision space," in Proc. Parallel Problem Solving Nat., 2010, pp. 91-100.
35. M. Li, S. Yang, and X. Liu, "Shift-based density estimation for pareto-based algorithms in many-objective optimization," IEEE Trans. Evol. Comput., vol. 18, no. 3, pp. 348-365, Jun. 2014.
36. S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M.-H. Su, and K. Vahi, "Characterization of scientific workflows," in Proc. 3rd Workshop Workflows Support Large-Scale Sci., 2008, pp. 1-10.
37. G. Juve, A. Chervenak, E. Deelman, S. Bharathi, G. Mehta, and K. Vahi, "Characterizing and profiling scientific workflows," Future Generation Comput. Syst., vol. 29, no. 3, pp. 682-692, 2013.
38. Q. Zhang and H. Li, "Moea/d: A multiobjective evolutionary algorithm based on decomposition," IEEE Trans. Evol. Comput., vol. 11, no. 6, pp. 712-731, Dec. 2007.
39. E. Zitzler, M. Laumanns, L. Thiele, E. Zitzler, E. Zitzler, L. Thiele, and L. Thiele, "Spea2: Improving the strength pareto evolutionary algorithm," Eidgenössische Technische Hochschule Zürich (ETH), Institut für Technische Informatik und Kommunikationsnetze (TIK), Zürich, Switzerland, Tech. Rep. 103, 2001.
40. X. Li, "A non-dominated sorting particle swarm optimizer for multiobjective optimization," in Proc. Genetic Evol. Comput., 2003, pp. 37-48.
41. E. Zitzler and L. Thiele, "Multiobjective evolutionary algorithms: A comparative case study and the strength pareto approach," IEEE Trans. Evol. Comput., vol. 3, no. 4, pp. 257-271, Nov. 1999.
42. M. Li, S. Yang, J. Zheng, and X. Liu, "ETEA: A Euclidean minimum spanning tree-based evolutionary algorithm for multiobjective optimization," Evol. Comput., vol. 22, no. 2, pp. 189-230, 2014.
43. M. Li, S. Yang, K. Li, and X. Liu, "Evolutionary algorithms with segment-based search for multiobjective optimization problems," IEEE Trans. Cybern., vol. 44, no. 8, pp. 1295-1313, Aug. 2014.