Resource-efficient workflow scheduling in clouds

Knowledge-Based Systems

Volumn 80, Issue , 2015, Pages 153-162

  Lee, Young Choon ^a   Han, Hyuck ^b   Zomaya, Albert Y ^c   Yousif, Mazin ^d  

^a MACQUARIE UNIVERSITY   (Australia)

^b Dongduk Women's University   (South Korea)

^c UNIVERSITY OF SYDNEY   (Australia)

^d T SYSTEMS   (Germany)

Author keywords

Cloud computing; Resource efficiency; Resource management; Scientific workflows; Workflow scheduling

Indexed keywords

CLOUD COMPUTING; ECONOMIC AND SOCIAL EFFECTS; ENERGY UTILIZATION;

EXTENSIVE SIMULATIONS; RESOURCE EFFICIENCIES; RESOURCE MANAGEMENT; RESOURCE UTILIZATIONS; SCIENCE AND ENGINEERING; SCIENTIFIC WORKFLOWS; WORKFLOW APPLICATIONS; WORKFLOW SCHEDULING;

SCHEDULING;

EID: 84926208153     PISSN: 09507051     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.knosys.2015.02.012     Document Type: Article

References (23)

1. J.C. Jacob, and D.S. Katz Montage: a grid portal and software toolkit for science-grade astronomical image mosaicking Int. J. Comput. Sci. Eng. 4 2 2009 73 87
2. R. Graves, T.H. Jordan, S. Callaghan, E. Deelman, E. Field, G. Juve, C. Kesselman, P. Maechling, G. Mehta, K. Milner, D. Okaya, P. Small, and K. Vahi Cybershake: a physics-based seismic hazard model for southern california Pure Appl. Geophys. 168 3-4 2010 367 381
3. A. Abramovici, and W.E. Althouse Ligo: the laser interferometer gravitational-wave observatory Science 256 5055 1992 325 333
4. S. Bharathi, A. Chervenak, E. Deelman, G. Mehta, M.-H. Su, K. Vahi, Characterization of scientific workflows, in: Proceedings of Third Workshop on Workflows in Support of Large-Scale Science (WORKS), 2008, pp. 1-10.
5. J. Livny, H. Teonadi, M. Livny, and M.K. Waldor High-throughput, kingdom-wide prediction and annotation of bacterial non-coding RNAs PLoS ONE 3 9 2008 e3197+
6. L.A. Barroso, and U. Hölzle The case for energy-proportional computing Computer 40 12 2007 33 37
7. M. Mao, M. Humphrey, Auto-scaling to minimize cost and meet application deadlines in cloud workflows, in: Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC), 2011, pp. 49:1-49:12.
8. C. Lin, S. Lu, Scpor: an elastic workflow scheduling algorithm for services computing, in: Proceedings of the 2011 IEEE International Conference on Service-Oriented Computing and Applications (SOCA), 2011, pp. 1-8.
9. Y.C. Lee, A.Y. Zomaya, Stretch out and compact: workflow scheduling with resource abundance, in: Proceedings of the International Symposium on Cluster Cloud and the Grid (CCGRID), 2013, pp. 219-226.
10. Y.C. Lee, H. Han, A.Y. Zomaya, On Resource Efficiency of Workflow Schedules, in: Proceedings of the 14th International Conference on Computational Science (ICCS), 2014, pp. 534-545.
11. G.R. Nudd, D.J. Kerbyson, E. Papaefstathiou, S.C. Perry, J.S. Harper, and D.V. Wilcox Pace-a toolset for the performance prediction of parallel and distributed systems Int. J. High Perform. Comput. Appl. 14 3 2000 228 251
12. Y.-K. Kwok, and I. Ahmad Dynamic critical-path scheduling: an effective technique for allocating task graphs to multiprocessors IEEE Trans. Paral. Distrib. Syst. 7 5 1996 506 521
13. H. Topcuouglu, S. Hariri, and M.-y. Wu Performance-effective and low-complexity task scheduling for heterogeneous computing IEEE Trans. Paral. Distrib. Syst. 13 3 2002 260 274
14. D.S. Katz, J.C. Jacob, G.B. Berriman, J. Good, A.C. Laity, E. Deelman, C. Kesselman, G. Singh, A comparison of two methods for building astronomical image mosaics on a grid, in: Proceedings of the 2005 International Conference on Parallel Processing Workshops, 2005, pp. 85-94.
15. R. Graves, T.H. Jordan, S. Callaghan, E. Deelman, E. Field, G. Juve, C. Kesselman, P. Maechling, G. Mehta, and K. Milner Cybershake: a physics-based seismic hazard model for southern california Pure Appl. Geophys. 168 3-4 2011 367 381
16. M. Litzkow, M. Livny, M. Mutka, Condor - a hunter of idle workstations, in: Proceedings of the 8th International Conference on Distributed Computing Systems (ICDCS), 1988, pp. 104-111.
17. D. Abramson, R. Sosic, J. Giddy, B. Hall, Nimrod: a tool for performing parameterised simulations using distributed workstations, in: Proceedings of the 4th International Symposium on High Performance Distributed Computing (HPDC), 1995, pp. 112-121.
18. M. Tanaka, O. Tatebe, Workflow scheduling to minimize data movement using multi-constraint graph partitioning, in: Proceedings of the 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID), 2012, pp. 65-72.
19. S. Abrishami, M. Naghibzadeh, and D.H.J. Epema Cost-driven scheduling of grid workflows using partial critical paths IEEE Trans. Paral. Distrib. Syst. 23 8 2012 1400 1414
20. M. Malawski, G. Juve, E. Deelman, J. Nabrzyski, Cost- and deadline-constrained provisioning for scientific workflow ensembles in iaas clouds, in: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC), 2012, pp. 22:1-22:11.
21. L.M. Leslie, Y.C. Lee, P. Lu, A.Y. Zomaya, Exploiting performance and cost diversity in the cloud, in: Proceedings of the 6th IEEE International Conference on Cloud Computing (CLOUD), 2013, pp. 107-114.
22. H.M. Fard, R. Prodan, and T. Fahringer Multi-objective list scheduling of workflow applications in distributed computing infrastructures J. Paral. Distrib. Comput. 74 3 2014 2152 2165
23. J.J. Durillo, and R. Prodan Multi-objective workflow scheduling in amazon ec2 Cluster Comput. 17 2 2014 169 189