A cost-effective scheduling algorithm for scientific workflows in clouds

2012 IEEE 31st International Performance Computing and Communications Conference, IPCCC 2012

Volumn , Issue , 2012, Pages 256-265

  Zhu, Mengxia ^a   Wu, Qishi ^b   Zhao, Yang ^a  

^a Southern Illinois University Carbondale   (United States)

^b University of Memphis   (United States)

Author keywords

cloud computing; Scientific workflow; workflow scheduling

Indexed keywords

CLOUD SERVICE PROVIDERS; COMMERCIAL APPLICATIONS; COMPLETION TIME; COMPUTING DEMANDS; COST MODELS; DATA ACCESS; EXECUTION TIME; EXTENSIVE SIMULATIONS; HIGH THROUGHPUT; JOB SCHEDULER; OPTIMIZATION PROBLEMS; RESOURCE UTILIZATIONS; SCIENTIFIC APPLICATIONS; SCIENTIFIC WORKFLOWS; WORKFLOW SCHEDULING;

CONSTRAINED OPTIMIZATION; COST EFFECTIVENESS; DIGITAL STORAGE; SCHEDULING;

CLOUD COMPUTING;

EID: 84874288724     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PCCC.2012.6407766     Document Type: Conference Paper

References (23)

1. A. Bala and I. Chana. A Survey of Various Workflow Scheduling Algorithms in Cloud Environment. In Proc. of the 2nd National Conference on Information and Communication Technology, pp. 26-30, 2011.
2. S. Zhang, X. Chen, and X. Huo. Cloud Computing Research and Development Trend. In Proc. of the 2nd International Conference on Future Networks (ICFN'10), pp. 93-97, 2010.
3. J. Yu, R. Buyya, and C.K. Tham. Cost-based Scheduling of Scientific Workflow Applications on Utility Grids. In Proc. of the 1st IEEE International Conference on e-Science and Grid Computing (e-Science 2005), Dec. 5-8, 2005, Melbourne, Australia.
4. C. Hoffa, G. Mehta, T. Freeman, E. Deelman, K. Keahey, B. Berriman, and J. Goo. On the Use of Cloud Computing for Scientific Workflows. In Proc. of the IEEE 4th International Conference on eScience, pp. 640-645, 2008.
5. R. J. Figueiredo, P. A. Dinda, and J. A.B. Fortes. A Case for Grid Computing On Virtual Machines. In Proc. of Distributed Computing Systems, pp. 550-559, 2003.
6. B. Sotomayor, K. Keahey, and I. Foster. Combining batch execution and leasing using virtual machines. In Proc. of the 17th International Symposium on High Performance Distributed Computing (HPDC'08), Boston, Massachusetts, USA, June 23-27, 2008.
7. J. Vockler, G. Juve, E. Deelman, M. Rynge, and B. Berriman. Experiences using cloud computing for a scientific workflow application. In Proc. of the 2nd International Workshop on Scientific Cloud Computing (ScienceCloud'11), pp. 15-24, 2011.
8. B. Agarwalla, N. Ahmed, D. Hilley, and U. Ramachandran. Streamline: a scheduling heuristic for streaming application on the grid. In Proc. of the 13th Multimedia Computing and Networking Conf., San Jose, CA, 2006.
9. D. Nurmi, R. Wolski, C. Grzegorczyk, G. Obertelli, S. So-man, L. Youseff, and D. Zagorodnov.The Eucalyptus open-source cloud-computing system. In Proc. of IEEE International Symposium on Cluster Computing and the Grid (CCGrid'09), 2009.
10. Open Nebular, http://www.opennebula.org.
11. http://aws.amazon.com/ec2/.
12. https://developers.google.com/appengine/.
13. Nimbus, http://nimbusproject.org.
14. E. Deelman, G. Singh, M. H. Su, J. blythe, and Y. e.a. Gil. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Scientific Programming Journal, vol. 13, pp. 219-237, July 2005. (Pubitemid 43022937)
15. Q. Wu and Y. Gu. Supporting distributed application workflows in heterogeneous computing environments. In Proc. of the 14th IEEE Int. Conf. on Parallel and Distributed Systems, Melbourne, Australia, pp. 3- 10, 2008.
16. A. Sekhar, B. Manoj, and C. Murthy. A state-space search approach for optimizing reliability and cost of execution in distributed sensor networks. In Proc. of Int. Workshop on Distributed Computing, pp. 63-74, 2005.
17. S. Topcuoglu and M. Wu. Task scheduling algorithms for heterogeneous processors. In Proc. of the 8th IEEE Heterogeneous Computing Workshop (HCW'99), pp. 3-14, 1999.
18. Q. Wu, M. Zhu, X. Lu, P. Brown, Y. Lin, Y. Gu, F. Cao, and M. Reuter. Automation and management of scientific workflows in distributed network environments. In Proc. of the 6th Int. Workshop on Sys. Man. Tech., pp. 1-8, 2010.
19. Condor, http://www.cs.wisc.edu/condor.
20. DagMan, http://www.cs.wisc.edu/condor/dagman.
21. Globus, http://www.globus. org.
22. T. Ma and R. Buyya. Critical-path and priority based algorithms for scheduling workflows with parameter sweep tasks on global grids. In Proc. of the 17th Int. Symp. on Computer Architecture on High Performance Computing, pp. 251-258, 2005.
23. A. Mandal, K. Kennedy, C. Koelbel, G. Marin, J. Mellor-Crummey, B. Liu, and L. Johnsson. Scheduling Strategies for Mapping Application WorMows onto the Grid. In Proc. of the IEEE International Symposium on High Performance Distributed Computing (HPDC), pp. 125-134, 2005.