A Taxonomy and Survey of Fault-Tolerant Workflow Management Systems in Cloud and Distributed Computing Environments

Software Architecture for Big Data and the Cloud

Volumn , Issue , 2017, Pages 285-320

  Poola, Deepak ^a   Salehi, Mohsen Amini ^b   Ramamohanarao, Kotagiri ^a   Buyya, Rajkumar ^a  

^a UNIVERSITY OF MELBOURNE   (Australia)

^b UNIVERSITY OF LOUISIANA AT LAFAYETTE   (United States)

Author keywords

Algorithms; Checkpointing; Cloud computing; Distributed systems; Fault tolerance; Task duplication; Task retry; Workflows

Indexed keywords

EID: 85179296455     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-0-12-805467-3.00015-6     Document Type: Chapter

References (113)

1. G. Juve and E. Deelman (2010) Scientific workflows and clouds. Crossroads 16(3), 14-18.
2. Y. Gil, E. Deelman, M. Ellisman, T. Fahringer, G. Fox, D. Gannon, C. Goble, M. Livny, L. Moreau and J. Myers (2007) Examining the challenges of scientific workflows. Computer 40(12), 24-32.
3. P. Mouallem, D. Crawl, I. Altintas, M. Vouk and U. Yildiz (2010) A fault-tolerance architecture for Kepler-based distributed scientific workflows. M. Gertz, B. Ludäscher (Eds) Scientific and Statistical Database Management Lecture Notes in Computer Science vol. 6187 452-460.
4. J. Yu and R. Buyya (2005) A taxonomy of scientific workflow systems for grid computing. SIGMOD Rec. 34(3), 44-49.
5. K. Plankensteiner, R. Prodan, T. Fahringer, A. Kertesz and P. Kacsuk (2009) Fault detection, prevention and recovery in current grid workflow systems. Grid and Services Evolution 1-13.
6. M.A. Vouk (2008) Cloud computing – issues, research and implementations. CIT, J. Comput. Inf. Technol. 16(4), 235-246.
7. M.R. Garey and D.S. Johnson (1979) Computers and Intractability: A Guide to the Theory of NP-Completeness. New York: W.H. Freeman USA
8. Y. Kwok and I. Ahmad (1999) Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Comput. Surv. 31(4), 406-471.
9. J. Yu, R. Buyya and K. Ramamohanarao (2008) Workflow scheduling algorithms for grid computing. F. Xhafa, A. Abraham (Eds) Metaheuristics for Scheduling in Distributed Computing Environments Stud. Comput. Intell. 146 173-214.
10. Z. Shi, E. Jeannot and J. Dongarra (2006) Robust task scheduling in non-deterministic heterogeneous computing systems. IEEE International Conference on Cluster Computing, 2006 IEEE 1-10.
11. G. Juve, A. Chervenak, E. Deelman, S. Bharathi, G. Mehta and K. Vahi (2013) Characterizing and profiling scientific workflows. Future Gener. Comput. Syst. 29 682-692.
12. V. Leon, S. Wu and H. Robert (1994) Robustness measures and robust scheduling for job shops. IIE Trans. 26(5), 32-43.
13. W. Herroelen and R. Leus (2005) Project scheduling under uncertainty: survey and research potentials. Eur. J. Oper. Res. 165(2), 289-306.
14. J. Smith, H. Siegel and A. Maciejewski (2008) Robust Resource Allocation in Heterogeneous Parallel and Distributed Computing Systems. Wiley Online Library USA
15. M. Isard, M. Budiu, Y. Yu, A. Birrell and D. Fetterly (2007) Dryad: distributed data-parallel programs from sequential building blocks. Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems EuroSys'07 59-72.
16. S.Y. Ko, I. Hoque, B. Cho and I. Gupta (2010) Making cloud intermediate data fault-tolerant. Proceedings of the 1st ACM Symposium on Cloud Computing SoCC'10 181-192.
17. J. Dean (2006) Experiences with MapReduce, an abstraction for large-scale computation. Proceedings of the 15th International Conference on Parallel Architectures and Compilation Techniques PACT'06
18. B. Javadi, J. Abawajy and R. Buyya (2012) Failure-aware resource provisioning for hybrid cloud infrastructure. J. Parallel Distrib. Comput. 72(10), 1318-1331.
19. F. Gärtner (1999) Fundamentals of fault-tolerant distributed computing in asynchronous environments. ACM Comput. Surv. 31(1), 1-26.
20. M. Lackovic, D. Talia, R. Tolosana-Calasanz, J. Banares and O. Rana (2010) A taxonomy for the analysis of scientific workflow faults. Proceedings of the 13th IEEE International Conference on Computational Science and Engineering 398-403.
21. A. Benoit, L.-C. Canon, E. Jeannot and Y. Robert (2012) Reliability of task graph schedules with transient and fail-stop failures: complexity and algorithms. J. Sched. 15(5), 615-627.
22. R.D. Schlichting and F.B. Schneider (1983) Fail-stop processors: an approach to designing fault-tolerant computing systems. ACM Trans. Comput. Syst. 1(3), 222-238.
23. C. Dabrowski (2009) Reliability in grid computing systems. Concurr. Comput., Pract. Exp. 21(8), 927-959.
24. W. Cirne, F. Brasileiro, D. Paranhos, L. Goes and W. Voorsluys (2007) On the efficacy, efficiency and emergent behavior of task replication in large distributed systems. Parallel Comput. 33(3), 213-234.
25. A. Benoit, M. Hakem and Y. Robert (2008) Fault tolerant scheduling of precedence task graphs on heterogeneous platforms. Proceedings of the IEEE International Symposium on Parallel and Distributed Processing IPDPS 2008 1-8.
26. D. Mosse, R. Melhem and S. Ghosh (1994) Analysis of a fault-tolerant multiprocessor scheduling algorithm. Proceedings of the 24th International Symposium on Fault-Tolerant Computing FTCS-24 16-25.
27. G. Kandaswamy, A. Mandal and D. Reed (2008) Fault tolerance and recovery of scientific workflows on computational grids. Proceedings of the 8th IEEE International Symposium on Cluster Computing and the Grid 777-782.
28. Y. Zhang, A. Mandal, C. Koelbel and K. Cooper (2009) Combined fault tolerance and scheduling techniques for workflow applications on computational grids. Proceedings of the 9th IEEE/ACM International Symposium on Cluster Computing and the Grid CCGRID 244-251.
29. K. Hashimoto, T. Tsuchiya and T. Kikuno (2002) Effective scheduling of duplicated tasks for fault tolerance in multiprocessor systems. IEICE Trans. Inf. Syst. 85(3), 525-534.
30. A. Chervenak, E. Deelman, M. Livny, M.H. Su, R. Schuler, S. Bharathi, G. Mehta and K. Vahi (2007) Data placement for scientific applications in distributed environments. Proceedings of the 8th IEEE/ACM International Conference on Grid Computing GRID'07 267-274.
31. S. Darbha and D. Agrawal (1994) A task duplication based optimal scheduling algorithm for variable execution time tasks. Proceedings of the International Conference on Parallel Processing, vol. 1 ICPP vol. 2 52-56.
32. S. Ranaweera and D. Agrawal (2000) A task duplication based scheduling algorithm for heterogeneous systems. Proceedings of the 14th International Parallel and Distributed Processing Symposium 445-450.
33. A. Dogan and F. Ozguner (2002) LDBS: a duplication based scheduling algorithm for heterogeneous computing systems. Proceedings of the International Conference on Parallel Processing 352-359.
34. X. Tang, X. Li, G. Liao and R. Li (2010) List scheduling with duplication for heterogeneous computing systems. J. Parallel Distrib. Comput. 70(4), 323-329.
35. R. Calheiros and R. Buyya (2013) Meeting deadlines of scientific workflows in public clouds with tasks replication. IEEE Trans. Parallel Distrib. Syst. PP(99), 1.
36. I. Brandic, D. Music and S. Dustdar (2009) Service mediation and negotiation bootstrapping as first achievements towards self-adaptable grid and cloud services. Proceedings of the 6th International Conference Industry Session on Grids Meets Autonomic Computing GMAC '09, New York, NY, USA 1-8.
37. D. Yuan, L. Cui and X. Liu (2014) Cloud data management for scientific workflows: Research issues, methodologies, and state-of-the-art. Proceedings of the 10th International Conference on Semantics, Knowledge and Grids (SKG) 21-28.
38. W. Li, Y. Yang and D. Yuan (2011) A novel cost-effective dynamic data replication strategy for reliability in cloud data centres. Proceedings of the 9th IEEE International Conference on Dependable, Autonomic and Secure Computing DASC'11 496-502.
39. J. Dean (2007) Software engineering advice from building large-scale distributed systems. http://research.google.com/people/jeff/stanford-295-talk.pdf
40. M. Zaharia, M. Chowdhury, T. Das, A. Dave, J. Ma, M. McCauley, M.J. Franklin, S. Shenker and I. Stoica (2012) Resilient distributed datasets: a fault-tolerant abstraction for in-memory cluster computing. Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation NSDI'12 2-12.
41. G. Malewicz, M.H. Austern, A.J.C. Bik, J.C. Dehnert, I. Horn, N. Leiser and G. Czajkowski (2010) Pregel: a system for large-scale graph processing. Proceedings of the ACM SIGMOD International Conference on Management of Data SIGMOD'10 135-146.
42. M. Zaharia, M. Chowdhury, M.J. Franklin, S. Shenker and I. Stoica (2010) Spark: cluster computing with working sets. Proceedings of the 2nd USENIX Conference on Hot Topics in Cloud Computing HotCloud'10 10-15.
43. J. Li, M. Humphrey, Y. Cheah, Y. Ryu, D. Agarwal, K. Jackson and C. van Ingen (2010) Fault tolerance and scaling in e-science cloud applications: observations from the continuing development of MODISAzure. Proceedings of the IEEE 6th International Conference on e-Science (e-Science) 246-253.
44. F. Berman, H. Casanova, A. Chien, K. Cooper, H. Dail, A. Dasgupta, W. Deng, J. Dongarra, L. Johnsson, K. Kennedy, C. Koelbel, B. Liu, X. Liu, A. Mandal, G. Marin, M. Mazina, J. Mellor-Crummey, C. Mendes, A. Olugbile, M. Patel, D. Reed, Z. Shi, O. Sievert, H. Xia and A. YarKhan (2005) New grid scheduling and rescheduling methods in the grads project. Int. J. Parallel Program. 33(2–3), 209-229.
45. S. Hwang and C. Kesselman (2003) Grid workflow: a flexible failure handling framework for the grid. Proceedings of the 12th IEEE International Symposium on High Performance Distributed Computing 126-137.
46. D. Poola, K. Ramamohanarao and R. Buyya (2014) Fault-tolerant workflow scheduling using spot instances on clouds. Proceedings of the International Conference on Computational Science in the Procedia Computer Science International Conference on Computational Science vol. 29 523-533.
47. E. Deelman, G. Singh, M.H. Su, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, G.B. Berriman, J. Good, A. Laity, J.C. Jacob and D.S. Katz (2005) Pegasus: a framework for mapping complex scientific workflows onto distributed systems. Sci. Program. 13(3), 219-237.
48. W. Chen and E. Deelman (2012) Fault tolerant clustering in scientific workflows. Proceedings of the IEEE 8th World Congress on Services SERVICES 9-16.
49. Z. Yu and W. Shi (2007) An adaptive rescheduling strategy for grid workflow applications. Proceedings of the IEEE International Parallel and Distributed Processing Symposium IPDPS 1-8.
50. K. Plankensteiner and R. Prodan (2012) Meeting soft deadlines in scientific workflows using resubmission impact. IEEE Trans. Parallel Distrib. Syst. 23(5), 890-901.
51. R. Sakellariou and H. Zhao (2004) A low-cost rescheduling policy for efficient mapping of workflows on grid systems. Sci. Program. 12(4), 253-262.
52. T. Fahringer, R. Prodan, R. Duan, J. Hofer, F. Nadeem, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H. Truong, A. Villazon and M. Wieczorek (2007) Askalon: a development and grid computing environment for scientific workflows. I. Taylor, E. Deelman, D. Gannon, M. Shields (Eds) Workflows for e-Science 450-471.
53. R. Duan, R. Prodan and T. Fahringer (2005) Dee: a distributed fault tolerant workflow enactment engine for grid computing. L. Yang, O. Rana, B. Di Martino, J. Dongarra (Eds) High Performance Computing and Communications Lecture Notes in Computer Science vol. 3726 704-716.
54. E.N. Elnozahy, L. Alvisi, Y. Wang and D.B. Johnson (2002) A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv. 34(3), 375-408.
55. J. Chen and Y. Yang (2007) Adaptive selection of necessary and sufficient checkpoints for dynamic verification of temporal constraints in grid workflow systems. ACM Trans. Auton. Adapt. Syst. 2(6)
56. M.A. Salehi, A.N. Toosi and R. Buyya (2014) Contention management in federated virtualized distributed systems: implementation and evaluation. Softw. Pract. Exp. 44(3), 353-368.
57. I. Egwutuoha, D. Levy, B. Selic and S. Chen (2013) A survey of fault tolerance mechanisms and checkpoint/restart implementations for high performance computing systems. J. Supercomput. 65(3), 1302-1326.
58. R. Tolosana-Calasanz, J. Baòares, P. Álvarez, J. Ezpeleta and O. Rana (2010) An uncoordinated asynchronous checkpointing model for hierarchical scientific workflows. J. Comput. Syst. Sci. 76(6), 403-415.
59. M.A. Salehi, B. Javadi and R. Buyya (2014) Resource provisioning based on preempting virtual machines in distributed systems. Concurr. Comput., Pract. Exp. 26(2), 412-433.
60. M.A. Salehi, J. Abawajy and R. Buyya (2014) Taxonomy of contention management in interconnected distributed systems. Computer Science and Software Engineering, Computing Handbook third edition 1-33. Chapter 57
61. G. von Laszewski, M. Hategan and D. Kodeboyina (2007) Java COG kit workflow. I. Taylor, E. Deelman, D. Gannon, M. Shields (Eds) Workflows for e-Science 340-356.
62. X. Liu, D. Yuan, G. Zhang, J. Chen and Y. Yang (2010) SwinDeW-C: a peer-to-peer based cloud workflow system. B. Furht, A. Escalante (Eds) Handbook of Cloud Computing 309-332.
63. Y.L. Simmhan, B. Plale and D. Gannon (2005) A survey of data provenance in e-science. SIGMOD Rec. 34(3), 31-36.
64. S.B. Davidson, S.C. Boulakia, A. Eyal, B. Ludäscher, T.M. McPhillips, S. Bowers, M.K. Anand and J. Freire (2007) Provenance in scientific workflow systems. IEEE Data Eng. Bull. 30(4), 44-50.
65. S.B. Davidson and J. Freire (2008) Provenance and scientific workflows: challenges and opportunities. Proceedings of the ACM SIGMOD International Conference on Management of Data SIGMOD'08, New York, NY, USA 1345-1350.
66. Y. Simmhan, R. Barga, C. van Ingen, E. Lazowska and A. Szalay (2009) Building the trident scientific workflow workbench for data management in the cloud. Proceedings of the 3rd International Conference on Advanced Engineering Computing and Applications in Sciences 2009, ADVCOMP'09 41-50.
67. D. Poola, S.K. Garg, R. Buyya, Y. Yang and K. Ramamohanarao (2014) Robust scheduling of scientific workflows with deadline and budget constraints in clouds. Proceedings of the 28th IEEE International Conference on Advanced Information Networking and Applications (AINA-2014) 1-8.
68. M. Wang, K. Ramamohanarao and J. Chen (2009) Trust-based robust scheduling and runtime adaptation of scientific workflow. Concurr. Comput., Pract. Exp. 21(16), 1982-1998.
69. Y. Yang and X. Peng (2013) Trust-based scheduling strategy for workflow applications in cloud environment. Proceedings of the 8th International Conference on P2P, Parallel, Grid, Cloud and Internet Computing (3PGCIC) 316-320.
70. W. Li, J. Wu, Q. Zhang, K. Hu and J. Li (2014) Trust-driven and QoS demand clustering analysis based cloud workflow scheduling strategies. Clust. Comput. 17(3), 1013-1030.
71. W. Tan, Y. Sun, L.X. Li, G. Lu and T. Wang (2014) A trust service-oriented scheduling model for workflow applications in cloud computing. IEEE Syst. J. 8(3), 868-878.
72. A. Benoit, M. Hakem and Y. Robert (2010) Multi-criteria scheduling of precedence task graphs on heterogeneous platforms. Comput. J. 53(6), 772-785. http://comjnl.oxfordjournals.org/content/53/6/772.full.pdf+html
73. J.J. Dongarra, E. Jeannot, E. Saule and Z. Shi (2007) Bi-objective scheduling algorithms for optimizing makespan and reliability on heterogeneous systems. Proceedings of the 19th Annual ACM Symposium on Parallel Algorithms and Architectures SPAA'07, New York, NY, USA 280-288.
74. A. Litke, D. Skoutas, K. Tserpes and T. Varvarigou (2007) Efficient task replication and management for adaptive fault tolerance in mobile grid environments. Future Gener. Comput. Syst. 23(2), 163-178.
75. M. Rahman, R. Ranjan and R. Buyya (2010) Reputation-based dependable scheduling of workflow applications in peer-to-peer grids. Comput. Netw. 54(18), 3341-3359.
76. X. Wang, C.S. Yeo, R. Buyya and J. Su (2011) Optimizing the makespan and reliability for workflow applications with reputation and a look-ahead genetic algorithm. Future Gener. Comput. Syst. 27(8), 1124-1134.
77. L. Canon and E. Jeannot (2010) Evaluation and optimization of the robustness of DAG schedules in heterogeneous environments. IEEE Trans. Parallel Distrib. Syst. 21(4), 532-546.
78. L. Bölöni and D.C. Marinescu (2002) Robust scheduling of metaprograms. J. Sched. 5(5), 395-412.
79. V. Shestak, J. Smith, H. Siegel and A. Maciejewski (2006) A stochastic approach to measuring the robustness of resource allocations in distributed systems. Proceedings of the International Conference on Parallel Processing 2006, ICPP IEEE 459-470.
80. S.K. Garg, S. Versteeg and R. Buyya (2013) A framework for ranking of cloud computing services. Future Gener. Comput. Syst. 29(4), 1012-1023. Special Section: Utility and Cloud Computing
81. S. Adabi, A. Movaghar and A.M. Rahmani (2014) Bi-level fuzzy based advanced reservation of cloud workflow applications on distributed grid resources. J. Supercomput. 67(1), 175-218.
82. T. Fahringer, R. Prodan, R. Duan, F. Nerieri, S. Podlipnig, J. Qin, M. Siddiqui, H. Truong, A. Villazon and M. Wieczorek (2005) Askalon: a grid application development and computing environment. Proceedings of the 6th IEEE/ACM International Workshop on Grid Computing GRID'05, Washington, DC, USA 122-131.
83. Pegasus workflow management system. https://pegasus.isi.edu/ [Online; accessed 01 December 2014]
84. E. Deelman, K. Vahi, G. Juve, M. Rynge, S. Callaghan, P.J. Maechling, R. Mayani, W. Chen, R.F. da Silva, M. Livny and K. Wenger (2015) Pegasus, a workflow management system for science automation. Future Gener. Comput. Syst. 46(0), 17-35.
85. I. Taylor, M. Shields, I. Wang and A. Harrison (2007) The Triana workflow environment: architecture and applications. I. Taylor, E. Deelman, D. Gannon, M. Shields (Eds) Workflows for e-Science 320-339.
86. A. Streit, P. Bala, A. Beck-Ratzka, K. Benedyczak, S. Bergmann, R. Breu, J. Daivandy, B. Demuth, A. Eifer, A. Giesler, B. Hagemeier, S. Holl, V. Huber, N. Lamla, D. Mallmann, A. Memon, M. Memon, M. Rambadt, M. Riedel, M. Romberg, B. Schuller, T. Schlauch, A. Schreiber, T. Soddemann and W. Ziegler (2010) Unicore 6 – recent and future advancements. Ann. Telecommun. 65(11–12), 757-762.
87. I. Altintas, C. Berkley, E. Jaeger, M. Jones, B. Ludascher and S. Mock (2004) Kepler: an extensible system for design and execution of scientific workflows. Proceedings of the 16th International Conference on Scientific and Statistical Database Management 423-424.
88. B. Ludascher, I. Altintas, C. Berkley, D. Higgins, E. Jaeger, M. Jones, E.A. Lee, J. Tao and Y. Zhao (2006) Scientific workflow management and the Kepler system. Concurr. Comput., Pract. Exp. 18(10), 1039-1065.
89. S. Pandey, W. Voorsluys, M. Rahman, R. Buyya, J.E. Dobson and K. Chiu (2009) A grid workflow environment for brain imaging analysis on distributed systems. Concurr. Comput., Pract. Exp. 21(16), 2118-2139.
90. R. Buyya, S. Pandey and C. Vecchiola (2009) Cloudbus toolkit for market-oriented cloud computing. M. Jaatun, G. Zhao, C. Rong (Eds) Cloud Computing Lecture Notes in Computer Science vol. 5931 24-44.
91. S. Pandey, D. Karunamoorthy and R. Buyya (2011) Workflow engine for clouds. Cloud Computing 321-344.
92. C. Vecchiola, X. Chu and R. Buyya (2009) Aneka: a software platform for.net-based cloud computing. High Speed and Large Scale Scientific Computing 267-295.
93. S. Venugopal, K. Nadiminti, H. Gibbins and R. Buyya (2008) Designing a resource broker for heterogeneous grids. Softw. Pract. Exp. 38(8), 793-825.
94. T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver, K. Glover, M.R. Pocock, A. Wipat and P. Li (2004) Taverna: a tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20(17), 3045-3054. http://bioinformatics.oxfordjournals.org/content/20/17/3045.full.pdf+html
95. K. Wolstencroft, R. Haines, D. Fellows, A. Williams, D. Withers, S. Owen, S. Soiland-Reyes, I. Dunlop, A. Nenadic, P. Fisher, J. Bhagat, K. Belhajjame, F. Bacall, A. Hardisty, A. Nieva de la Hidalga, M.P. Balcazar Vargas, S. Sufi and C. Goble The taverna workflow suite: designing and executing workflows of web services on the desktop, web or in the cloud. http://nar.oxfordjournals.org/content/early/2013/05/02/nar.gkt328.full.pdf+html Nucleic Acids Research
96. H. Hiden, S. Woodman, P. Watson and J. Cala (1983) Developing cloud applications using the e-science central platform. Philos. Trans. R. Soc. Lond. A, Math. Phys. Eng. Sci. 371
97. J. Dean and S. Ghemawat (2008) MapReduce: simplified data processing on large clusters. Commun. ACM 51(1), 107-113.
98. C. Lam (2010) Hadoop in Action. 1st edition CT, USA: Greenwich
99. K. Shvachko, H. Kuang, S. Radia and R. Chansler (2010) The Hadoop distributed file system. Proceedings of the 26th IEEE Symposium on Mass Storage Systems and Technologies MSST'10 1-10.
100. S. Ghemawat, H. Gobioff and S. Leung (2003) The Google file system. Proceedings of the 19th ACM Symposium on Operating Systems Principles SOSP'03 29-43.
101. O. Alaçam and M. Dalcı (2009) A usability study of webmaps with eye tracking tool: the effects of iconic representation of information. Proceedings of the 13th International Conference on Human–Computer Interaction 12-21.
102. M. Odersky, L. Spoon and B. Venners (2008) Programming in Scala: A Comprehensive Step-by-Step Guide. 1st edition Walnut Creek, California: Artima Press USA
103. A. Martin, T. Knauth, S. Creutz, D. Becker, S. Weigert, C. Fetzer and A. Brito (2011) Low-overhead fault tolerance for high-throughput data processing systems. Proceedings of the 31st International Conference on Distributed Computing Systems ICDCS'11 689-699.
104. K. Amin, G. von Laszewski, M. Hategan, N. Zaluzec, S. Hampton and A. Rossi (2004) Gridant: a client-controllable grid workflow system. Proceedings of the 37th Annual Hawaii International Conference on System Sciences 10.
105. S. McGough, L. Young, A. Afzal, S. Newhouse and J. Darlington (2004) Workflow enactment in ICENI. UK e-Science All Hands Meeting 894-900.
106. J. Cao, S.A. Jarvis, S. Saini and G.R. Nudd (2003) Gridflow: workflow management for grid computing. Proceedings of the 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid CCGrid 198-205.
107. E. Elmroth, F. Hernández and J. Tordsson (2008) A light-weight grid workflow execution engine enabling client and middleware independence. R. Wyrzykowski, J. Dongarra, K. Karczewski, J. Wasniewski (Eds) Parallel Processing and Applied Mathematics Lecture Notes in Computer Science vol. 4967 754-761.
108. P. Kacsuk and G. Sipos (2005) Multi-grid, multi-user workflows in the p-grade grid portal. J. Grid Comput. 3(3–4), 221-238.
109. S.P. Callahan, J. Freire, E. Santos, C.E. Scheidegger, C.T. Silva and H.T. Vo (2006) Vistrails: visualization meets data management. Proceedings of the ACM SIGMOD International Conference on Management of Data SIGMOD'06, New York, NY, USA 745-747.
110. T. Schlauch and A. Schreiber (2007) DataFinder – a scientific data management solution. Ensuring the Long-Term Preservation and Value Adding to Scientific and Technical Data, PV Oberpfaffenhofen, Germany
111. C.A. Goble and D.C. De Roure (2007) myExperiment: social networking for workflow-using e-scientists. Proceedings of the 2nd Workshop on Workflows in Support of Large-scale Science WORKS'07, New York, NY, USA 1-2.
112. Pegasus workflow generator. https://confluence.pegasus.isi.edu/display/pegasus/WorkflowGenerator/2014 [Online; accessed 5 December 2014]
113. D. Kondo, B. Javadi, A. Iosup and D. Epema (2010) The failure trace archive: Enabling comparative analysis of failures in diverse distributed systems. Proceedings of the 10th IEEE/ACM International Conference on Cluster, Cloud and Grid Computing CCGrid, 2010 IEEE 398-407.