CloudWF: A computational workflow system for clouds based on Hadoop

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 5931 LNCS, Issue , 2009, Pages 393-404

  Zhang, Chen ^a   De Sterck, Hans ^b  

^a UNIVERSITY OF WATERLOO   (Canada)

^b UNIVERSITY OF WATERLOO   (Canada)

Author keywords

[No Author keywords available]

Indexed keywords

DECENTRALIZED WORKFLOW; DESCRIPTION LANGUAGES; EXECUTABLE COMPONENTS; TASK-SCHEDULING; WORK-FLOW SYSTEMS; WORKFLOW EXECUTION;

CLOUDS; COMPUTER SCIENCE; FAULT TOLERANCE; FAULT TOLERANT COMPUTER SYSTEMS; QUALITY ASSURANCE; SCHEDULING;

MANAGEMENT;

EID: 71749083423     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/978-3-642-10665-1_36     Document Type: Conference Paper

References (12)

1. Ailamaki, A., Ioannidis, Y.E., Livny, M.: Scientific Workflow Management by Database Management. In: 10th Intl. Conf. on Scientific and Statistical Database Management (SSDBM), Capri, Italy (1998)
2. Bowers, S., Ludaescher, B.: Actor-Oriented Design of Scientific Workflows. In: Delcambre, L.M.L., Kop, C., Mayr, H.C., Mylopoulos, J., Pastor, O . (eds.) ER 2005. LNCS, vol. 3716, pp. 369-384. Springer, Heidelberg (2005)
3. Cascading, http://www.cascading.org/ (retrieval date: September 25, 2009)
4. Deelman, E., Singh, G., Livny, M., Berriman, B., Good, J.: The cost of doing science on the cloud: the Montage example. In: Proceedings of the ACM/IEEE conference on Supercomputing (SC), Austin, USA (2008)
5. Hadoop, http://hadoop.apache.org/ (retrieval date: September 25, 2009)
6. Ludscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger, E., Jones, M., Lee, E., Tao, J., Zhao, Y.: Scientific Workflow Management and the Kepler System. In: Concurrency and Computation: Practice and Experience, vol. 18, pp. 1039-1065 (2006)
7. Majithia, S., Shields, M., Taylor, I., Wang, I.: Triana: A Graphical Web Service Composition and Execution Toolkit. In: Proc. IEEE Intl. Conf. Web Services (ICWS), pp. 514-524 (2004)
8. Oinn, T., Greenwood, M., Addis, M.J., Alpdemir, M.N., Ferris, J., Glover, K., Goble, C., Goderis, A., Hull, D., Marvin, D.J., Li, P., Lord, P., Pocock, M.R., Senger, M., Stevens, R., Wipat, A., Wroe, C.: Taverna: Lessons in Creating a Workflow Environment for the Life Sciences. J. Concurrency and Computation: Practice and Experience 18, 1067-1100 (2002)
9. Ranjan, R., Rehman, M., Buyya, R.: A Decentralized and Cooperative Workflow Scheduling Algorithm. In: Proc. 8th Intl. Conf. on Cluster Computing and the Grid (CCGrid). IEEE Computer Society Press, Los Alamitos (2008)
10. TeraByte Sort on Apache Hadoop, http://www.hpl.hp.com/hosted/ sortbenchmark/YahooHadoop.pdf (retrieval date: September 25, 2009)
11. Yu, J., Buyya, R.: A Taxonomy of ScientificWorkflow Systems for Grid Computing. SIGMOD Record 34, 44-49 (2005)
12. Zhang, C., De Sterck, H., Djambazian, H., Sladek, R.: Case Study of Scientific Data Processing on a Cloud Using Hadoop. In: High Performance Computing Symposium (HPCS), Kingston, Canada (2009)