Three fundamental dimensions of scientific workflow interoperability: Model of computation, language, and execution environment

Future Generation Computer Systems

Volumn 26, Issue 2, 2010, Pages 245-256

  Elmroth, Erik ^a   Hernández, Francisco ^a   Tordsson, Johan ^a  

^a UMEÅ UNIVERSITY   (Sweden)

Author keywords

Grid interoperability; Model of computation; Scientific workflows; Workflow interoperability; Workflow languages

Indexed keywords

GRID INTEROPERABILITY; MODEL OF COMPUTATION; SCIENTIFIC WORKFLOWS; WORKFLOW INTEROPERABILITY; WORKFLOW LANGUAGES;

INTEROPERABILITY; LINGUISTICS; QUERY LANGUAGES;

MANAGEMENT;

EID: 70349973875     PISSN: 0167739X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.future.2009.08.011     Document Type: Article

References (85)

1. Elmroth E., Hernández F., and Tordsson J. A light-weight Grid workflow execution engine enabling client and middleware independence. In: Wyrzykowski R., et al. (Ed). Parallel Processing and Applied Mathematics. 7th Int. Conference, PPAM 2007. Lecture notes in Computer Science vol. 4967 (2008), Springer-Verlag 259-270
2. Churches D., Gombas G., Harrison A., Maassen J., Robinson C., Shields M., Taylor I., and Wang I. Programming scientific and distributed workflow with Triana services. Concurr. Comput. Pract. Exp. 18 10 (2006) 1021-1037
3. Deelman E., Singh G., Su M., Blythe J., Gil Y., Kesselman C., Mehta G., Vahi K., Berriman G., Good J., Laity A., Jacob J., and Katz D. Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Sci. Program. 13 3 (2005) 219-237
4. Ludäscher B., Altintas I., Berkley C., Higgins D., Jaeger E., Jones M., Leen E., Tao J., and Zhao Y. Scientific workflow management and the Kepler system. Concurrency Computat.: Pract. Exper. 18 10 (2006) 1039-1065
5. Oinn T., Addis M., Ferris J., Marvin D., Senger M., Greenwood M., Carver T., Glover K., Pocock M., Wipat A., and Li P. Taverna: A tool for the composition and enactment of bioinformatics workflows. Bioinformatics 20 17 (2004) 3045-3054
6. Kacsuk P., Dozsa G., Kovcs J., Lovas R., Podhorszki N., Balaton Z., and Gombas G. P-GRADE: A grid programming environment. J. Grid Computing 1 2 (2003) 171-197
7. McGough A., Lee W., Cohen J., Katsiri E., and Darlington J. ICENI. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 395-415
8. Fahringer T., Prodan R., Duan R., Hofer J., Nadeem F., Nerieri F., Podlipnig S., Qin J., Siddiqui M., Truong H.-L., Villazon A., and Wieczorek M. ASKALON: A development and Grid computing environment for scientific workflows. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 450-471
9. Unicore, http://www.unicore.org, visited July 2009, 2009
10. von Laszewski G., and Hategan M. Workflow concepts of the Java CoG Kit. J. Grid Computing 3 3-4 (2005) 239-258
11. Foster I. Globus toolkit version 4: Software for service-oriented systems. In: Jin H., et al. (Ed). IFIP International Conference on Network and Parallel Comput. Lecture notes in Computer Science vol. 3779 (2005), Springer-Verlag 2-13
12. NSF/Mellon Workshop on Scientific and Scholarly Workflow, Improving Interoperability, Sustainability and Platform Convergence in Scientific and Scholarly Workflow, https://spaces.internet2.edu/display/SciSchWorkflow/Home, visited August 2008, 2008
13. International Organization for Standardization, ISO/IEC 2382-1 Information technology-Vocabulary-Part 1: Fundamental terms, 1993
14. Hernández F., Bangalore P., Gray J., Guan Z., and Reilly K. GAUGE: Grid automation and generative environment. Concurrency Computat.: Pract. Exper. 18 10 (2006) 1293-1316
15. Deelman E., Gannon D., Shields M., and Taylor I. Workflows and e-Science: An overview of workflow system features and capabilities. Future Gener. Comput. Syst. 25 5 (2009) 528-540
16. Shields M. Control- versus data-driven workflows. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 167-173
17. Z. Zhao, S. Booms, A. Belloum, C. de Laat, B. Hertzberger, VLE-WFBus: A scientific workflow bus for multi e-Science domains, in: 2nd IEEE International Conference on e-Science and Grid Computing, 2006, pp. 11-19
18. Gil Y. Workflow composition: Semantic representations for flexible automation. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 244-257
19. R. Armstrong, D. Gannon, A. Geist, K. Keahey, S. Kohn, L. McInnes, S. Parker, B. Smolinski, Toward a common component architecture for high-performance scientific computing, in: The Eighth International Symposium on High Performance Distributed Computing, 1999, pp. 115-124
20. K. Damevski, S.P.A. Khan, Scientific workflows and components: Together at last!, in: CBHPC 2008 - Workshop on Component-based High Performance Computing, 2008
21. Oinn T., Greenwood M., Addis M., Alpdemir M., Ferris J., Glover K., Goble C., Goderis A., Hull D., Marvin D., Li P., Lord P., Pocock M., Senger M., Stevens R., Wipat A., and Wroe C. Taverna: Lessons in creating a workflow environment for the life sciences. Concurrency Computat.: Pract. Exper. 18 10 (2006) 1067-1100
22. Kacsuk P., and Sipos G. Multi-Grid and multi-user workflows in the P-GRADE Grid portal. J. Grid Comput. 3 3-4 (2006) 221-238
23. M. Gudgin, M. Hadley, N. Mendelsohn, J.-J. Moreau, H.F. Nielsen, A. Karmarkar, Y. Lafon, SOAP Version 1.2 part 1: Messaging framework, http://www.w3.org/TR/soap12-part1/, visited June 2008, 2008
24. E. Christensen, F. Curbera, G. Meredith, S. Weerawarana, Web Services Description Language (WSDL) 1.1, http://www.w3.org/TR/wsdl, visited June 2008, 2008
25. Mateos C., Zunino A., and Campo M. A survey on approaches to gridification. Softw. Pract. Exp. 38 5 (2008) 523-556
26. K. Ballinger, D. Ehnebuske, C. Ferris, M. Gudgin, C. Liu, M. Nottingham, P. Yendluri, Basic Profile Version 1.1, http://www.ws-i.org/Profiles/BasicProfile-1.1.html, Visited July 2009, 2006
27. M. McIntosh, M. Gudgin, K. Morrison, A. Barbir, Basic Security Profile Version 1.0, http://www.ws-i.org/Profiles/BasicSecurityProfile-1.0.html, Visited July 2009, 2007
28. R. Fielding, Architectural styles and the design of network-based software architectures, Ph.D. Thesis, University of California, Irvine, 2000
29. m yExperiment virtual research environment for social sharing of workflows. Future Generation Comput. Syst. 25 (2009) 561-567
30. D. Jordan, J. E., (chairs), Web Services Business Process Execution Language Version 2.0, http://docs.oasis-open.org/wsbpel/2.0/wsbpel-v2.0.pdf, September 2008, 2007
31. Barga R., and Gannon D. Scientific versus business workflows. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 9-18
32. Elmroth E., and Tordsson J. A standards-based Grid resource brokering service supporting advance reservations, coallocation and cross-Grid interoperability. Concurrency Computat.: Pract. Exper. (2009) 10.1002/cpe.1441
33. Elmroth E., and Tordsson J. An interoperable, standards-based Grid resource broker and job submission service. In: Stockinger H., et al. (Ed). First International Conference on e-Science and Grid Computing (2005), IEEE CS Press 212-220
34. Venugopal S., Nadiminti K., Gibbins H., and Buyya R. Designing a resource broker for heterogeneous grids. Softw. Pract. Exp. 38 8 (2008) 793-825
35. Grid Interoperation Now Community Group (GIN-CG), http://forge.gridforum.org/sf/projects/gin, visited July 2009, 2009
36. Elmroth E., Gardfjäll P., Norberg A., Tordsson J., and Östberg P.-O. Designing general, composable, and middleware-independent Grid infrastructure tools for multi-tiered job management. In: Priol T., and Vaneschi M. (Eds). Towards Next Generation Grids (2007), Springer-Verlag 175-184
37. A. Anjomshoaa, F. Brisard, M. Drescher, D. Fellows, A. Ly, A.S. McGough, D. Pulsipher, A. Savva, Job Submission Description Language (JSDL) Specification, Version 1.0, http://www.ogf.org/documents/GFD.136.pdf, visited February 2009, 2008
38. I. Foster, A. Grimshaw, P. Lane, W. Lee, M. Morgan, S. Newhouse, S. Pickles, D. Pulsipher, C. Smith, M. Theimer, OGSA basic execution service version 1.0, http://www.ogf.org/documents/GFD.108.pdf, visited July 2009, 2007
39. A. McGough, A. Savva, Implementation and Interoperability Experiences with the Job Submission Description Language (JSDL), http://www.ogf.org/documents/GFD.140.pdf, visited July 2009, 2008
40. Jantsch A., and Sander I. Models of computation and languages for embedded system design. IEEE Proc.-Comput. Digit. Tech. 152 2 (2005) 114-129
41. D. Turi, P. Missier, C. Goble, D.D. Roure, T. Oinn, Taverna workflows: Syntax and semantics, in: Third International Conference on e-Science and Grid Computing, 2007, pp. 441-448
42. Hoheisel A., and Alt M. Petri Nets. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 190-207
43. Goderis A., Brooks C., Altintas I., Lee E., and Goble C. Heterogeneous composition of models of computation. Future Generation Comput. Syst. 25 5 (2009) 552-560
44. Eker J., Janneck J., Lee E., Liu J., Liu X., Ludvig J., Neuendorffer S., Sachs S., and Xiong Y. Taming heterogeneity-The Ptolemy approach. Proc. IEEE 91 1 (2003) 127-144
45. Ludäscher B., Podhorszki N., Altintas I., Bowers S., and McPhillips T. From computation models to models of provenance: The RWS approach. Concurrency Computat. Pract. Exper. 20 (2008) 507-518
46. Lee E., and Sangiovanni-Vincentelli A. A framework for comparing models of computation. IEEE Trans. Comput. Aided Des. Integr. Circuits Syst. 17 12 (1998) 1217-1229
47. Milner R. Communication and Concurrency (1989), Prentice Hall
48. Denis J. Dataflow supercomputers. Computer 13 11 (1980) 48-56
49. Rumbaugh J. A data flow multiprocessor. IEEE Trans. Comput. 26 2 (1977) 138-146
50. H. Reekie, Realtime signal processing: Dataflow, visual, and functional programming, Ph.D. Thesis, University of Technology, Sydney, 1995
51. Mc Phillips T., Bowers S., Zinn D., and Ludäscher B. Scientific workflow design for mere mortals. Future Generation Comput. Syst. 25 5 (2009) 541-551
52. Couvares P., Kosar T., Roy A., Weber J., and Wenger K. Workflow management in Condor. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 357-375
53. Wieczorek M., Hoheisel A., and Prodan R. Towards a general model of the multi-criteria workflow scheduling on the grid. Future Generation Comput. Syst. 25 3 (2009) 237-256
54. Singh G., Vahi K., Ramakrishnan A., Mehta G., Deelman E., Zhao H., Sakellariou R., Blackburn K., Brown D., Fairhurst S., Meyers D., Berriman G., Good J., and Katz D. Optimizing workflow data footprint. Sci. Program. 15 4 (2007) 249-268
55. Allen R., and Kennedy K. Optimizing Compilers for Modern Architectures (2002), Morgan Kaufman
56. Krauter K., Buyya R., and Maheswaran M. A taxonomy and survey of Grid resource management systems for distributed computing. Softw. Pract. Exp. 32 2 (2002) 135-164
57. von Laszewski G., Hategan M., and Kodeboyina D. Java CoG Kit workflow. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 340-356
58. Guan Z., Hernández F., Gray P., Skjellum J., Velusamy A., and Liu V. Grid-Flow: A Grid-enabled scientific workflow system with a Petri-net-based interface. Concurrency Computat.: Pract. Exper. 18 10 (2006) 1115-1140
59. Margo M., Yoshimoto K., Kovatch P., and Andrews P. Impact of reservations on production job scheduling. In: Frachtenberg E., and Schwiegelshohn U. (Eds). Job Scheduling Strategies for Parallel Processing. Lecture Notes in Comput. Sci. vol. 4942 (2008), Springer-Verlag 116-131
60. Smith W., Foster I., and Taylor V. Scheduling with advance reservations. 14th International Parallel and Distributed Processing Symposium (2000), IEEE 127-132
61. Snell Q., Clement M., Jackson D., and Gregory C. The performance impact of advance reservation meta-scheduling. In: Feitelson D., and Rudolph L. (Eds). Job Scheduling Strategies for Parallel Processing: IPDPS 2000 Workshop, JSSPP 2000. Lecture Notes in Comput. Sci. vol. 1911 (2000), Springer-Verlag 137-153
62. Glatard T., Sipos G., Montagnat J., Farkas Z., and Kacsuk P. Workflow-level parametric study support by MOTEUR and the P-GRADE Portal. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 279-299
63. M. Mair, J. Qin, M. Wieczorek, T. Fahringer, Workflow Conversion and Processing in the ASKALON Grid Environment, 2nd Austrian Grid Symposium, Österreichische Computer Gesellschaft, 2006, pp. 67-80. http://www.ocg.at/publikationen/books/booklist.html
64. Zhao Y., Wilde M., and Foster I. Virtual data language: A typed workflow notation for diversely structured scientific data. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 258-275
65. A.-C. Berglund, E. Elmroth, F. Hernández, B. Sandman, J. Tordsson, Combining local and grid resources in scientific workflows (for bioinformatics), in: 9th International Workshop, PARA 2008, Lecture Notes in Comput. Sci., Springer-Verlag, 2009 (in press)
66. Elmroth E., Hernández F., Tordsson J., and Östberg P.-O. Designing service-based resource management tools for a healthy Grid ecosystem. In: Wyrzykowski R., et al. (Ed). Parallel Processing and Applied Mathematics. Lecture Notes in Comput. Sci. vol. 4967 (2007), Springer-Verlag 259-270
67. Taylor I., Shields M., Wang I., and Harrison A. The Triana workflow environment: Architecture and applications. In: Taylor I., et al. (Ed). Workflows for e-Science (2007), Springer-Verlag 320-339
68. Parker S., Weinstein D., and Johnson C. The SCIRun computational steering software system. In: Arge E., et al. (Ed). Modern Software Tools in Scientific Computing (1997), Birkhauser Press 1-40
69. Pautasso C., and Alonso G. The JOpera visual composition language. J. Visual Lang. Computing 16 1-2 (2005) 119-152
70. Bahsi E., Ceyhan E., and Kosar T. Conditional workflow management: A survey and analysis. Sci. Program. 15 4 (2007) 283-297
71. C. Pautasso, G. Alonso, Parallel computing patterns for Grid workflows, in: Proc. of the HPDC2006 Workshop on Workflows in Support of Large-Scale Science, WORKS06, Paris, France, 2006
72. Bentley J. Programming pearls: Little languages. Comm. ACM 29 8 (1986) 711-721
73. Glatard T., and Montagnat J. Implementation of Turing machines with the Scufl data-flow language. Eighth IEEE International Symposium on Cluster Computing and the Grid (2008), IEEE 663-668
74. Ackerman W. Data flow languages. Computer 15 2 (1982) 15-25
75. Hoheisel A. User tools and languages for graph-based Grid workflows. Concurrency Computat. Pract. Exper. 18 10 (2006) 1001-1013
76. K. Plankensteiner, R. Prodan, T.F.A. Kertész, P. Kacsuk, Fault-tolerant behavior in state-of-the-art Grid workflow management systems, Tech. Rep., CoreGRID, http://www.coregrid.net/mambo/images/stories/TechnicalReports/tr-0091.pd f, visited August 2008, 2007
77. Kiepuszewski B., ter Hofstede A., and Bussler C. On Structured Workflow Modelling. In: Wangler B., and Bergman L. (Eds). Advanced Information Systems Engineering (Proceedings of the 12th International Conference, CAiSE 2000). Lecture Notes in Comput. Sci. vol. 1789 (2000), Springer-Verlag 431-445
78. Aho A., Sethi R., and Ullman J. Compilers: Principles, Techniques, and Tools (1986), Addison-Wesley
79. Cowell W., and Thompson C. Transforming FORTRAN DO loops to improve performance on vector architectures. ACM Trans. Math. Software (TOMS) 12 4 (1986) 324-353
80. Mosconi M., and Porta M. Iteration constructs in data-flow visual programming languages. Comput. Lang. 26 (2000) 67-104
81. CoreGRID, Deliverable D.PM.04 Basic Features of the Grid Component Model, BETA Working Paper Series, WP 47, CoreGRID - Network of Excellence, www.coregrid.net/mambo/images/stories/Deliverables/d.pm.04.pdf, visited July 2009, 2007
82. Delaitre T., Kiss T., Goyeneche A., Terstyanszky G., Winter S., and Kacsuk P. GEMLCA: Running legacy code applications as grid services. J. Grid Comput. 3 1-2 (2005) 75-90
83. Bacon D., Graham S., and Sharp O. Compiler transformations for high-performance computing. ACM Comput. Surv. (CSUR) 26 4 (1994) 345-420
84. Hillis W., and Steele G. Data parallel algorithms. Comm. ACM 29 12 (1986) 1170-1183
85. J. Qin, T. Fahringer, Advanced data flow support for scientific grid workflow applications, in: Proceedings of the ACM/IEEE Conference on Supercomputing SC 2007, ACM, 2007, pp. 1-12