On scientific workflow scheduling in clouds under budget constraint

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2013, Pages 90-99

  Lin, Xiangyu ^a   Wu, Chase Qishi ^a  

^a University of Memphis   (United States)

Author keywords

Cloud computing; Scientific workflows; Workflow scheduling

Indexed keywords

BUDGET CONTROL; CLOUD COMPUTING; HEURISTIC METHODS;

CLOUD BASED COMPUTING; CLOUD INFRASTRUCTURES; EXTENSIVE SIMULATIONS; FINANCIAL CONSTRAINTS; HEURISTIC SOLUTIONS; SCIENTIFIC WORKFLOWS; TASK SCHEDULING PROBLEM; WORKFLOW SCHEDULING;

SCHEDULING;

EID: 84893237134     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2013.18     Document Type: Conference Paper

References (33)

1. C. Hoffa, G. Mehta, T. Freeman, E. Deelman, K. Keahey, B. Berriman, and J. Good, "On the use of cloud computing for scientific workflows, " in Proc. of the 4th IEEE Int. Conf. on eScience, Washington, DC, USA, 2008, pp. 640-645.
2. E. Deelman, G. Singh, M. Livny, B. Berriman, and J. Good, "The cost of doing science on the cloud: The montage example, " in Proc. of the ACM/IEEE Conference on Supercomputing, Austin, Texas, USA, 2008.
3. Amazon EC2. http://aws.amazon.com/ec2/.
4. M. Mao and M. Humphrey, "Auto-scaling to minimize cost and meet application deadlines in cloud workflows, " in Proc. of Int. Conf. for High Performance Computing, Networking, Storage and Analysis, 2011, pp. 49:1-49:12.
5. G. Juve, E. Deelman, K. Vahi, G. Mehta, B. Berriman, B. Berman, and P. Maechling, "Data sharing options for scientific workflows on amazon ec2, " in Proc. of the ACM/IEEE Int. Conf. for High Performance Computing, Networking, Storage and Analysis, Washington, DC, USA, 2010, pp. 1-9.
6. Pegasus in the cloud. http://pegasus.isi.edu/cloud.
7. Y. Gu and Q. Wu, "Optimizing distributed computing workflows in heterogeneous network environments, " in Proc. of the 11th Int. Conf. on Distributed Computing and Networking, Kolkata, India, Jan. 3-6 2010.
8. M. Rahman, S. Venugopal, and R. Buyya, "A dynamic critical path algorithm for scheduling scientific workflow applications on global grids, " in IEEE Int. Conf. on e-Science and Grid Computing, Dec. 2007, pp. 35-42.
9. R. Bajaj and D. Agrawal, "Improving scheduling of tasks in a heterogeneous environment, " IEEE Trans. Parallel Distrib. Syst., vol. 15, no. 2, pp. 107-118, February 2004.
10. Q. Wu and Y. Gu, "Optimizing end-to-end performance of data-intensive computing pipelines in heterogeneous network environments, " J. of Parallel and Distributed Computing, vol. 71, no. 2, pp. 254-265, 2011.
11. H. Topcuoglu, S. Hariri, and M. Wu, "Performance effective and low-complexity task scheduling for heterogeneous computing, " IEEE TPDS, vol. 13, no. 3, pp. 260-274, 2002.
12. R. Sakellariou and H. Zhao, "A hybrid heuristic for dag scheduling on heterogeneous systems, " in Proc. of the 18th IEEE IPDPS, vol. 2, 2004, p. 111.
13. J. Yu, "A budget constrained scheduling of workflow applications on utility grids using genetic algorithms, " in Proc. of SC WORKS Workshop, 2006, pp. 1-10.
14. R. Sakellariou, H. Zhao, E. Tsiakkouri, and M. Dikaiakos, "Scheduling workflows with budget constraints, " in Integrated Research in GRID Computing, S. Gorlatch and M. Danelutto, Eds. Springer US, 2007, pp. 189-202.
15. J. Yu, R. Buyya, and C. Tham, "Cost-based scheduling of scientific workflow application on utility grids, " in Proc. of the 1st Int. Conf. on e-Science and Grid Computing, Washington, DC, USA, 2005, pp. 140-147.
16. L. Zeng, V. Bharadwaj, and X. Li, "Scalestar: Budget conscious scheduling precedence-constrained many-task workflow applications in cloud, " in Int. Conf. on Advanced Information Networking and Applications, vol. 0, Los Alamitos, CA, USA, 2012, pp. 534-541.
17. S. Abrishami and M. Naghibzadeh, "Deadline-constrained workflow scheduling in software as a service cloud, " Scientia Iranica, no. 0, 2012.
18. M. Mao, J. Li, and H. Marty, "Cloud auto-scaling with deadline and budget constraints, " in Grid Computing, Oct. 2010, pp. 41-48.
19. T. Hacker and K. Mahadik, "Flexible resource allocation for reliable virtual cluster computing systems, " in Proc. of the ACM/IEEE Supercomputing Conference, 2011, pp. 48:1-48:12.
20. V. Viana, D. Oliveira, and M. Mattoso, "Towards a cost model for scheduling scientific workflows activities in cloud environments, " in Proc. of the IEEE World Congress on Services, 2011, pp. 216-219.
21. J. Jung and J. Bae, "Workflow clustering method based on process similarity, " in Proc. of the Int. Conf. on Computational Science and Its Applications, vol. 2, 2006, pp. 379-389.
22. G. Singh, M. Su, K. Vahi, E. Deelman, B. Berriman, J. Good, D. Katz, and G. Mehta, "Workflow task clustering for best effort systems with pegasus, " in Proc. of the 15th ACM Mardi Gras Conference, 2008, pp. 9:1-9:8.
23. W. Chen and E. Deelman, "Integration of workflow partitioning and resource provisioning, " in Proc. of the 12th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Computing, Washington, DC, USA, 2012, pp. 764-768.
24. M. Tanaka and O. Tatebe, "Workflow scheduling to minimize data movement using multi-constraint graph partitioning, " in Proc. of the 12th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Computing (CCGRID), 2012, pp. 65-72.
25. Y. Gu, Q. Wu, and N. Rao, "Analyzing execution dynamics of scientific workflows for latency minimization in resource sharing environments, " in Proc. of the 7th IEEE World Congress on Services, Washington DC, Jul. 4-9 2011.
26. orithms and computer implementations. New York, NY, USA: John Wiley & Sons, Inc., 1990.
27. M. Garey and D. Johnson, Computers and Intractability: A Guide to the Theory of NP-completeness. San Francisco: W.H. Freeman and Company, 1979.
28. R. Calheiros, R. Ranjan, A. Beloglazov, C. D. Rose, and R. Buyya, "Cloudsim: A toolkit for modeling and simulation of cloud computing environments and evaluation of resource provisioning algorithms, " Software: Practice and Experience, vol. 41, no. 1, pp. 23-50, 2011.
29. W. Skamarock, J. Klemp, J. Dudhia, D. Gill, D. Barker, M. Duda, X. Huang, W. Wang, and J. Powers, "A description of the advanced research wrf version 3, " National Center for Atmospheric Research, Boulder, Colorado, USA, Tech. Rep. NCAR/TN-475+STR, June 2008.
30. Http://www.wrf-model.org/index.php.
31. WRF Preprocessing System (WPS). http://www.mmm.ucar.edu/wrf/users/wpsv2/ wps.html.
32. Nimbus cloud project. http://www.nimbusproject.org.
33. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield, "Xen and the art of virtualization, " in ACM SIGOPS Operating Systems Review, vol. 37, no. 5. ACM, 2003, pp. 164-177.