Workflow Scheduling in Multi-Tenant Cloud Computing Environments

IEEE Transactions on Parallel and Distributed Systems

Volumn 28, Issue 1, 2017, Pages 290-304

  Rimal, Bhaskar Prasad ^a   Maier, Martin ^a  

^a INSTITUT NATIONAL DE LA RECHERCHE SCIENTIFIQUE   (Canada)

Author keywords

Cloud computing; direct acyclic graph; multi tenancy; resource management; scientific workflow applications

Indexed keywords

CLOUD COMPUTING; COMPLEX NETWORKS; HUMAN COMPUTER INTERACTION; NATURAL RESOURCES MANAGEMENT; RESOURCE ALLOCATION; SCALABILITY; SCHEDULING;

CLOUD COMPUTING ENVIRONMENTS; DIRECT ACYCLIC GRAPHS; FIRST COME FIRST SERVED; MINIMUM COMPLETION TIME; MULTI TENANCIES; RESOURCE MANAGEMENT; SCIENTIFIC WORKFLOWS; STATE-OF-THE-ART ALGORITHMS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 85006789473     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2016.2556668     Document Type: Article

References (47)

1. L. M. Vaquero, L. Rodero-Merino, J. Caceres, and M. Lindner, "A break in the clouds: Towards a cloud definition, " SIGCOMM Com-put. Commun. Rev., vol. 39, no. 1, pp. 50-55, Jan. 2009.
2. B. P. Rimal and E. Choi, "A service-oriented taxonomical spectrum, cloudy challenges and opportunities of cloud computing, " Int. J. Commun. Syst., vol. 25, no. 6, pp. 796-819, Jun. 2012.
3. I. Foster, Y. Zhao, I. Raicu, and S. Lu, "Cloud computing and grid computing 360-degree compared, " in Proc. IEEE Grid Comput. Environ. Workshop, Nov. 2008, pp. 1-10.
4. C. D. Weissman and S. Bobrowski, "The design of the force.com multitenant internet application development platform, " in Proc., ACM SIGMOD, Jun. 2009, pp. 889-896.
5. B. P. Rimal and M. A. El-Refaey, "A framework of scientific work-flow management systems for multi-tenant cloud orchestration environment, " in Proc. 19th IEEE Int. Workshop Enabling Technol. Infrastructures Collaborative Enterprises, Jun. 2010, pp. 88-93.
6. C. J. Guo, W. Sun, Y. Huang, Z. H. Wang, and B. Gao, "A frame-work for native multi-tenancy application development and man-agement, " in Proc. IEEE 9th Int. Conf. E-Commerce Technol. 4th IEEE Int. Conf. Enterprise Comput. E-Commerce E-Services, Jul. 2007, pp. 551-558.
7. H. Ballani, P. Costa, T. Karagiannis, and A. Rowstron, "Towards predictable datacenter networks, " in Proc. ACM SIGCOMM Conf., Aug. 2011, pp. 242-253.
8. D. Fernandez-Baca, "Allocating modules to processors in a distributed system, " IEEE Trans. Softw. Eng., vol. 15, no. 11, pp. 1427-1436, Nov. 1989.
9. J. Yu, R. Buyya, and K. Ramamohanarao, "Workflow scheduling algorithms for grid computing, " in Metaheuristics Scheduling Dis-trib. Comput. Environ., 2008, vol. 146, pp. 173-214.
10. Y. Zhao, X. Fei, I. Raicu, and S. Lu, "Opportunities and challenges in running scientific workflows on the cloud, " in Proc. IEEE Cyber-Enabled Distrib. Comput. Knowl. Discovery, Oct. 2011, pp. 455-462.
11. Y. Gil, E. Deelman, M. Ellisman, T. Fahringer, G. Fox, D. Gannon, C. Goble, M. Livny, L. Moreau, and J. Myers, "Examining the chal-lenges of scientific workflows, " Computer, vol. 40, no. 12, pp. 24-32, Dec. 2007.
12. J. Livny, H. Teonadi, M. Livny, and M. K. Waldor, "High-throughput, kingdom-wide prediction and annotation of bacterial non-coding rnas, " PLoS ONE, vol. 3, no. 9, p. e3197, Sep. 2008.
13. F. S. Hsieh and J. B. Lin, "A dynamic scheme for scheduling com-plex tasks in manufacturing systems based on collaboration of agents, " Appl. Intell., vol. 41, no. 2, pp. 366-382, Sep. 2014.
14. H. Topcuoglu, S. Hariri, and M. Y. Wu, "Performance-effective and low-complexity task scheduling for heterogeneous computing, " IEEE Trans. Parallel Distrib. Syst., vol. 13, no. 3, pp. 260-274, Mar. 2002.
15. A. Radulescu and A. J. C. van Gemund, "On the complexity of list scheduling algorithms for distributed-memory systems, " in Proc. ACM Supercomput., Jun. 1999, pp. 68-75.
16. H. M. Fard, R. Prodan, J. J. D. Barrionuevo, and T. Fahringer, "A multi-objective approach for workflow scheduling in heterogeneous environments, " in Proc. IEEE/ACM CCGrid, May 2012, pp. 300-309.
17. S. Darbha and D. P. Agrawal, "Optimal scheduling algorithm for distributed-memory machines, " IEEE Trans. Parallel Distrib. Syst., vol. 9, no. 1, pp. 87-95, Jan. 1998.
18. R. Bajaj and D. P. Agrawal, "Improving scheduling of tasks in a heterogeneous environment, " IEEE Trans. Parallel Distrib. Sys., vol. 15, no. 2, pp. 107-118, Feb. 2004.
19. A. Gerasoulis and T. Yang, "A comparison of clustering heuristics for scheduling directed acyclic graphs on multiprocessors, " J. Parallel Distrib. Comput., vol. 16, no. 4, pp. 276-291, Dec. 1992.
20. J.-C. Liou and M. A. Palis, "An efficient task clustering heuristic for scheduling DAGs on multiprocessors, " in Proc. Resource Manag., Symp. Parallel Distrib. Process., 1996, pp. 152-156.
21. K. Bessai, S. Youcef, A. Oulamara, C. Godart, and S. Nurcan, "Bi-criteria workflow tasks allocation and scheduling in cloud computing environments, " in Proc. IEEE CLOUD, Jun. 2012, pp. 638-645.
22. T. He, S. Chen, H. Kim, L. Tong, and K.-W. Lee, "Scheduling par-allel tasks onto opportunistically available cloud resources, " in Proc. IEEE CLOUD, Jun. 2012, pp. 180-187.
23. Z. Xiao, W. Song, and Q. Chen, "Dynamic resource allocation using virtual machines for cloud computing environment, " IEEE Trans. Parallel Distrib. Syst., vol. 24, no. 6, pp. 1107-1117, Jun. 2013.
24. S. T. Maguluri, R. Srikant, and L. Ying, "Stochastic models of load balancing and scheduling in cloud computing clusters, " in Proc. IEEE INFOCOM, Mar. 2012, pp. 702-710.
25. T. R. Browning and A. A. Yassine, "Resource-constrained multi-project scheduling: Priority rule performance revisited, " Int. J. Prod. Econ., vol. 126, no. 2, pp. 212-228, Mar. 2010.
26. D. Shue, M. J. Freedman, and A. Shaikh, "Performance isolation and fairness for multi-tenant cloud storage, " in Proc. 10th USENIX Conf. Operating Syst. Des. Implementation, Oct. 2012, pp. 349-362.
27. S. Pandey, L. Wu, S. Guru, and R. Buyya, "A particle swarm opti-mization-based heuristic for scheduling workflow applications in cloud computing environments, " in Proc. IEEE Adv. Inform. Netw. Appl., Apr. 2010, pp. 400-407.
28. M. A. Rodriguez and R. Buyya, "Deadline based resource provi-sioningand scheduling algorithm for scientific workflows on clouds, " IEEE Trans. Cloud Comput., vol. 2, no. 2, pp. 222-235, Apr. 2014.
29. Z. Wu, X. Liu, Z. Ni, D. Yuan, and Y. Yang, "A market-oriented hierarchical scheduling strategy incloud workflow systems, " J. Supercomput., vol. 63, no. 1, pp. 256-293, Jan. 2013.
30. H. M. Fard, R. Prodan, and T. Fahringer, "A truthful dynamic workflow scheduling mechanism for commercial multicloud envi-ronments, " IEEE Trans. Parallel Distrib. Syst., vol. 24, no. 6, pp. 1203-1212, Jun. 2013.
31. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B. Berman, and P. Maechling, "Scientific workflow applications on amazon ec2, " in Proc. IEEE E-Sci. Workshop, Dec. 2009, pp. 59-66.
32. J. Jin, J. Luo, A. Song, F. Dong, and R. Xiong, "Bar: An efficient data locality driven task scheduling algorithm for cloud computing, " in Proc. 11th IEEE/ACM Int. Symp. Cluster, Cloud Grid Comput., May 2011, pp. 295-304.
33. D. Yuan, Y. Yang, X. Liu, and J. Chen, "A data placement strategy in scientific cloud workflows, " Future Gen. Comput. Syst., vol. 26, no. 8, pp. 1200-1214, Oct. 2010.
34. Q. Zhu and G. Agrawal, "Resource provisioning with budget constraints for adaptive applications in cloud environments, " IEEE Trans. Servi. Comput., vol. 5, no. 4, pp. 497-511, Oct./Dec. 2012.
35. L. Ramakrishnan, C. Koelbel, Y. suk Kee, R. Wolski, D. Nurmi, D. Gannon, G. Obertelli, A. YarKhan, A. Mandal, T. Huang, K. Thyagaraja, and D. Zagorodnov, "Vgrads: enabling e-science workflows on grids and clouds with fault tolerance, " in Proc. IEEE High Perform. Comput. Netw., Storage Anal., Nov. 2009, pp. 1-12.
36. K. Plankensteiner and R. Prodan, "Meeting soft deadlines in scien-tific workflows using resubmission impact, " IEEE Trans. Parallel Distrib. Syst., vol. 23, no. 5, pp. 890-901, May 2012.
37. S. Abrishami, M. Naghibzadeh, and D. H. J. Epema, "Deadline-constrained workflow scheduling algorithms for infrastructure as a service clouds, " Future Gen. Comput. Syst., vol. 29, no. 1, pp. 158-169, Jan. 2013.
38. W. Tsai, X. Sun, Q. Shao, and G. Qi, "Two-tier multi-tenancy scal-ing and load balancing, " in Proc. IEEE 7th Int. Conf. e-Business Eng., Nov. 2010, pp. 484-489.
39. T. Kwok and A. Mohindra, "Resource calculations with con-straints, and placement of tenants and instances for multi-tenant saas applications, " in Proc. Int. Conf. Serv.-Oriented Comput., Dec. 2008, pp. 633-648.
40. E. Javier, M. Arturo, J. Guillermo, M. Martn, R. Ral, and C. David, "A tenant-based resource allocation model for scaling software-as-a-service applications over cloud computing infrastructures, " Future Gen. Compt. Syst., vol. 29, no. 1, pp. 273-286, Jan. 2013.
41. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, K. Blackburn, A. Lazzarini, A. Arbree, R. Cavanaugh, and S. Koranda, "Mapping abstract complex workflows onto grid environments, " J. Grid Comput., vol. 1, no. 1, pp. 25-39, 2003.
42. D. Klusek, H. Rudov, R. Baraglia, M. Pasquali, and G. Capannini, "Comparison of multi-criteria scheduling techniques, " in Grid Computing, Berlin, Germany: Springer, 2008, pp. 173-184.
43. R. N. Calheiros, R. Ranjan, A. Beloglazov, C. A. F. De Rose, and R. Buyya, "Cloudsim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms, " Softw. Pract. Exper., vol. 41, no. 1, pp. 23-50, Jan. 2011.
44. M. Mao and M. Humphrey, "Auto-scaling to minimize cost and meet application deadlines in cloud workflows, " in Proc. IEEE/ACM Int. Conf. High Performance Comput. Netw. Storage Anal., Nov. 2011, pp. 1-12.
45. M. Mao and M. Humphrey, "A performance study on the VM startup time in the cloud, " in Proc. IEEE CLOUD, Jun. 2012, pp. 423-430.
46. M. Malawski, G. Juve, E. Deelman, and J. Nabrzyski, "Cost-and deadline-constrained provisioning for scientific workflow ensembles in IaaS clouds, " in Proc. IEEE High Perform. Comput., Netw., Storage Anal., Nov. 2012, pp. 1-11.
47. G. Juve, A. Chervenak, E. Deelman, S. Bharathi, G. Mehta, and K. Vahi, "Characterizing and profiling scientific workflows, " Future Gen. Compt. Syst., vol. 29, no. 3, pp. 682-692, Mar. 2013.