A semantic framework for automatic generation of computational workflows using distributed data and component catalogues

Journal of Experimental and Theoretical Artificial Intelligence

Volumn 23, Issue 4, 2011, Pages 389-467

  Gil, Yolanda ^a   González Calero, Pedro A ^b   Kim, Jihie ^a   Moody, Joshua ^a   Ratnakar, Varun ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b UNIVERSIDAD COMPLUTENSE DE MADRID   (Spain)

Author keywords

computational workflows; distributed reasoning; OWL; planning; semantic web; semantic workflows; workflow generation; workflow systems

Indexed keywords

DISTRIBUTED REASONING; OWL; WORK-FLOW SYSTEMS; WORK-FLOWS; WORKFLOW GENERATION;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; COMPUTER SOFTWARE REUSABILITY; DATA REDUCTION; LIBRARIES; ONTOLOGY; PLANNING; SEMANTIC WEB; USER INTERFACES;

MANAGEMENT;

EID: 79960253596     PISSN: 0952813X     EISSN: 13623079     Source Type: Journal    
DOI: 10.1080/0952813X.2010.490962     Document Type: Article

References (84)

1. Adibi, J., Chalupsky, H., Melz, E., and Valente, A. (2004), 'The KOJAK Group Finder: Connecting the Dots via Integrated Knowledge-Based and Statistical Reasoning', in Proceedings of the Sixteenth Innovative Applications of Artificial Intelligence Conference (IAAI), San Jose, CA, pp. 800-807.
2. Al-Masri, E., and Mahmoud, Q.H. (2008), 'Investigating Web Services on the World Wide Web', in Proceedings of the World Wide Web Conference, Beijing, China, pp. 795-804.
3. Ambite, J.L., and Kapoor, D. (2007), 'Automatically Composing Data Workflows with Relational Descriptions and Shim Services', in Proceedings of the 6th International Semantic Web Conference (ISWC-2007), Busan, Korea, pp. 1-14.
4. Ankolekar, A., Burstein, M., Hobbs, J.R., Lassila, O., Martin, D.L., McIlraith, S.A., Narayanan, S., Paolucci, M., Payne, T., Sycara, K., and Zeng, H. (2001), 'DAML-S: Semantic Markup For Web Services', in Proceedings of the International Semantic Web Workshop, Stanford, CA, pp. 1-20.
5. Ashley, K.D., and Aleven, V. (1997), 'Reasoning Symbolically About Partially Matched Cases', in Proceedings of the Fifteenth International Joint Conference on Artificial Intelligence, San Francisco, CA: Morgan Kaufmann, pp. 335-341.
6. Asuncion, A., and Newman, D.J. (2007), UCI Machine Learning Repository Available at http:// www.ics.uci.edu/mlearn/MLRepository.html. Irvine, CA: University of California, School of Information and Computer Science.
7. Atkins, D.E., Droegemeier, K.K., Feldman, S.I., Garcia-Molina, H., Klein, M.L., Messerschmitt, D.G., Messina, P., Ostriker, J.P., and Wright, M.H. (2003), 'Revolutionizing Science and Engineering through Cyberinfrastructure', National Science Foundation Blue- Ribbon Advisory Panel on Cyberinfrastructure. http://www.nsf.gov/publications/pub-summ.jsp?ods-key=cise051203
8. Baader, F., Lutz, C., Milicic, M., Sattler, U., and Wolter, F. (2005), 'Integrating Description Logics and Action Formalisms: First Results', in Proceedings of the Twentieth National Conference on Artificial Intelligence (AAAI-05), Pittsburgh, PA, USA, pp. 572-577. (Pubitemid 43006670)
9. Baader, F., and Narendran, P. (2007), 'Unification of Concept Terms in Description Logics', Journal of Symbolic Computation, 31, 277-305.
10. Belhajjame, K., Embury, S.M., Paton, N.W., Stevens, R., and Goble, C.A. (2008), 'Automatic Annotation of Web Services based on Workflow Definitions', ACM Transactions on the Web, 2, 1-34.
11. Bergmann, R., and Stahl, A. (1998), 'Similarity Measures for Object-Oriented Case Representations', in Proceedings of the Fourth European Workshop on Case-based Reasoning, Berlin: Springer, pp. 25-36. (Pubitemid 128145873)
12. Bernstein, A., Provost, F., and Hill, S. (2005), 'An Intelligent Assistant for the Knowledge Discovery Process: An Ontology-based Approach', IEEE Transactions on Knowledge and Data Engineering, 17, 503-518. (Pubitemid 40495593)
13. Blythe, J., Deelman, E., Gil, Y., and Kesselman, C. (2003b), 'Transparent Grid Computing: A Knowledge-Based Approach', in Proceedings of the 15th International Conference on Innovative Applications of Artificial Intelligence (IAAI), Mexico: Acapulco, pp. 57-64.
14. Blythe, J., Deelman, E., Gil, Y., Kesselman, C., Agarwal, A., Mehta, G., and Vahi, K. (2003a), 'The Role of Planning in Grid Computing', in Proceedings of the 13th International Conference on Automated Planning and Scheduling (ICAPS), June 9-13, Trento, Italy.
15. Bussler, C., Fensel, D., and Maedche, A. (2002), 'A Conceptual Architecture for Semantic Web- Enabled Web Services', SIGMOD Record, 31, 24-29.
16. Cannataro, M., Comito, C., Schiavo, F.L., and Veltri, P. (2004), 'Proteus, a Grid based Problem Solving Environment for Bioinformatics: Architecture and Experiments', IEEE Computational Intelligence Bulletin, 3, 7-18.
17. Champin, P.A., and Solnon, C. (2003), 'Measuring the Similarity of Labeled Graphs', in Proceedings of the Fifth International Conference on Case-based Reasoning, Berlin: Springer, pp. 80-95. (Pubitemid 36905824)
18. Chien, S.A., and Mortensen, H.B. (1996), 'Automating Image Processing for Scientific Data Analysis of a Large Image Database', IEEE Transactions on Pattern Analysis and Machine Intelligence, 18, 854-859. (Pubitemid 126772828)
19. Deelman, E., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Blackburn, K., Lazzarini, A., Arbree, A., Cavanaugh, R., and Koranda, S. (2003), 'Mapping Abstract Workflows onto Grid Environments', Journal of Grid Computing, 1, 25-39.
20. Deelman, E., and Gil, Y. (eds.) (2006), Final Report of the NSF Workshop on Challenges of Scientific Workflows, National Science Foundation, Arlington, VA, May 1-2, 2006. Available at http://www.isi.edu/nsf-workflows06
21. Deelman, E., Singh, G., Su, M., Blythe, J., Gil, Y., Kesselman, C., Mehta, G., Vahi, K., Berriman, G.B., Good, J., Laity, A., Jacob, J.C., and Katz, D.S. (2005), 'Pegasus: A Framework for Mapping Complex Scientific Workflows onto Distributed Systems', Scientific Programming Journal, 13, 219-237. (Pubitemid 43022937)
22. DeRoure, D., Goble, C., and Stevens, R. (2009), 'The Design and Realisation of the my Experiment Virtual Research Environment for Social Sharing of Workflows', Future Generation Computer Systems, 25, 561-567.
23. Fan, J., and Kambhampati, S. (2005), 'A Snapshot of Public Web Services', ACM SIGMOD Record, 34, 24-32. (Pubitemid 40750024)
24. Fikes, R.E., and Nilsson, N.J. (1971), 'STRIPS: A New Approach to the Application of Theorem Proving to Problem Solving', Artificial Intelligence, 2, 189-208.
25. Forbus, K, Gentner, D., and Law, K. (1994), 'MAC/FAC: A Model of Similarity-based Retrieval', Cognitive Science, 19, 141-205.
26. Frakes, W., and Kang, K. (2005), 'Software Reuse Research: Status and Future', IEEE Transactions on Software Engineering, 31, 529-536. (Pubitemid 41387747)
27. Friedland, P., and Iwasaki, Y. (1985), 'The Concept and Implementation of Skeletal Plans', Journal of Automated Reasoning, 1, 161-208.
28. Gil, Y. (2006), 'Workflow Composition', in Workflows for e-Science, eds. D. Gannon, E. Deelman, M. Shields and I. Taylor, London: Springer Verlag.
29. Gil, Y. (2009), 'From Data to Knowledge to Discoveries: Scientific Workflows and Artificial Intelligence', Scientific Programming, 17, 231-246.
30. Gil, Y., Deelman, E., Ellisman, M., Fahringer, T., Fox, G., Gannon, D., Goble, C., Livny, M., Moreau, L., and Myers, J. (2007b), 'Examining the Challenges of Scientific Workflows', IEEE Computer, 40, 24-32.
31. Gil, Y., Groth, P., Ratnakar, V., and Fritz, C. (2009b), 'Expressive Reusable Workflow Templates', in Proceedings of the Fifth IEEE International Conference on e-Science, Oxford, UK, December 9-11, pp. 344-351.
32. Gil, Y., Kim, J., Florez, G., Ratnakar, V., and Gonzalez-Calero, P.A. (2009a), 'Workflow Matching using Semantic Metadata', in Proceedings of the Fifth International Conference on Knowledge Capture (K-CAP), Redondo Beach, CA, September 1-4, pp. 121-128.
33. Gil, Y., Ratnakar, V., and Deelman, E. (2005), 'Virtual Metadata Catalogs: Augmenting Metadata Catalogs with Semantic Representations', in Fourth International Semantic Web Conference (ISWC-05), Galway, Ireland, November 7-10.
34. Gil, Y., Ratnakar, V., Deelman, E., Mehta, G., and Kim, J. (2007a), 'Wings for Pegasus: Creating Large-Scale Scientific Applications using Semantic Representations of Computational Workflows', in Proceedings of the 19th Annual Conference on Innovative Applications of Artificial Intelligence (IAAI), Vancouver, British Columbia, Canada, July 22-26.
35. Gil, Y., Ratnakar, V., Kim, J., Gonzalez-Calero, P.A., Groth, P., Moody, J., and Deelman, E. (2011), 'Wings: Intelligent Workflow-based Design of Computational Experiments', IEEE Intelligent Systems, 26, 62-72.
36. Goderis, A., Li, P., and Goble, C.A. (2006), 'Workflow discovery: The Problem, a Case Study From e-science and a Graph-based Solution', ICWS, IEEE Computer Society, Los Alamitos, CA, 312-319. (Pubitemid 351209867)
37. Goderis, A., Sattler, U., and Goble, C.A. (2005b), 'Applying Description Logics for Workflow Reuse and Repurposing', in Description Logics, eds. I. Horrocks, U. Sattler, and F. Wolter, Volume 147 of CEUR Workshop Proceedings, CEUR-WS.org
38. Goderis, A., Sattler, U., Lord, P., and Goble, C. (2005a), 'Seven Bottlenecks to Workflow Reuse and Repurposing', in Proceedings of the 4th International Semantic Web Conference, Galway, Ireland, 323-337.
39. Hall, M., Gil, Y., and Lucas, R. (2008), 'Self-Configuring Applications for Heterogeneous Systems: Program Composition and Optimization using Cognitive Techniques', in Proceedings of the IEEE, Special Issue on Edge Computing, pp. 849-862.
40. Hull, D., Zolin, E., Bovykin, A., Horrocks, I., Sattler, U., and Stevens, R. (2006), 'Deciding Semantic Matching of Stateless Services', in Proceedings of the Twenty-First National Conference on Artificial Intelligence (AAAI), pp. 1319-1324. (Pubitemid 44705457)
41. Kambhampati, S., and Hendler, J.A. (1992), 'A Validation Structure-based Theory of Plan Modification and Reuse', Artificial Intelligence Journal, 55, 193-258. (Pubitemid 23565213)
42. Kim, J., Deelman, E., Gil, Y., Mehta, G., and V. Ratnakar. (2008), 'Provenance Trails in Wings/ Pegasus', Journal of Computation and Concurrency: Practice and Experience, eds. L. Moreau and B. Ludaescher, Special issue on the First Provenance Challenge.
43. Kim, J., Gil, Y., and Ratnakar, V. (2006), 'Semantic Metadata Generation for Large Scientific Workflows', in Proceedings of the Fifth International Semantic Web Conference (ISWC-06), Athens, GA, November 5-9, pp. 357-370. (Pubitemid 44892042)
44. Kim, J., Spraragen, M., and Gil, Y. (2004), 'An Intelligent Assistant for Interactive Workflow Composition', in Proceedings of the 2004 International Conference on Intelligent User Interfaces (IUI), Madeira Islands, Portugal, January 2004, pp. 125-131. (Pubitemid 40673711)
45. Krueger, C.W. (2006), 'New Methods in Software Product Line Practice', Communications of the ACM, 49, 37-40.
46. Kubica, J., Moore, A., and Schneider, J. (2003), 'Tractable Group Detection on Large Link Data Sets', in The Third IEEE International Conference on Data Mining, p. 573.
47. Langley, P., Simon, H.A., Bradshaw, G.L., and Zytkow, J.M. (1987), Scientific Discovery: Computational Explorations of the Creative Processes, Cambridge, MA: The MIT Press.
48. Leyton-Brown, K., Nudelman, E., Galen A., McFadden, J., and Shoham, Y. (2003), 'A Portfolio Approach to Algorithm Selection', in Proceedings of the International Joint Conference on Artificial Intelligence (IJCAI), pp. 1542-1543.
49. Li, L., and Horrocks, I. (2003), 'A Software Framework for Matchmaking based on Semantic Web Technology', in Proceedings of the World Wide Web Conference (WWW), pp. 331-339.
50. Lin, N., Kuter, U., and Sirin, E. (2008), 'Web Service Composition with User Preferences', in Proceedings of the Fifth European Semantic Web Conference, pp. 629-643.
51. Ludäscher, B., Altintas, I., Berkley, C., Higgins, D., Jaeger-Frank, E., Jones, M., Lee, E., Tao, J., and Zhao, Y. (2006), 'Scientific Workflow Management and the Kepler System', Concurrency and Computation: Practice and Experience, 18, 1009-1019, Special Issue on Workflow in Grid Systems.
52. McDermott, D. (1991), 'Regression Planning', International Journal of Intelligent Systems, 6, 357-416. (Pubitemid 21681456)
53. McDermott, D. (2002), 'Estimated-Regression Planning for Interactions with Web Services', in Proceedings of the AI Planning Systems Conference, pp. 142-149.
54. McIlraith, S., and Son, T. (2002), 'Adapting Golog for Composition of Semantic Web Services', in Proceedings of the Eighth International Conference on Knowledge Representation and Reasoning, pp. 482-493.
55. Medjahed, B., Bouguettaya, A., and Elmagarmid, A.K. (2003), 'Composing Web services on the Semantic Web', The International Journal on Very Large Databases, 12, 333-351. (Pubitemid 37503691)
56. Mitchell, T.M. (2006), 'The Discipline of Machine Learning', Technical Report CMU-ML-06-108, Carnegie Mellon University, Machine Learning Department.
57. Moore, R.W., Boisvert, R., and Tang, P. (2001), 'Data Management Systems for Scientific Applications', The Architecture of Scientific Software, Dordrecht: Kluwer Academic Publishers, pp. 273-284.
58. Moreau, L., and Ludascher, B. (eds.) (2008), 'Special Issue on the First Provenance Challenge', Journal of Computation and Concurrency: Practice and Experience, 20, 409-418. (Pubitemid 351428355)
59. Morik, K., and Scholz, M. (2004), 'The MiningMart Approach to Knowledge Discovery in Databases', in Intelligent Technologies for Information Analysis, eds. N. Zhong and J. Liu, Berlin: Springer, pp. 47-65.
60. Muggleton, S.H. (2006), '2020 Computing: Exceeding human limits', Nature, 440, 413-414, Special Issue on 2020 Computing.
61. Myers, K.L., Jarvis, P.A., Tyson, W.M., and Wolverton, M.J. (2003), 'A Mixed-initiative Framework for Robust Plan Sketching', in Proceedings of the 13th International Conferences on AI Planning and Scheduling, Trento, Italy, June.
62. Narayanan, S., and McIlraith, S. (2002), 'Simulation, VeriEcation and Automated Composition of Web Services', in Proceedings of the 11th International World Wide Web Conference, pp. 77-88.
63. Nature Editorial (2006), '2020 computing: Milestones in scientific computing', Nature, 440, 383-580, Special Issue on 2020 Computing.
64. Newman, M.E.J., and Girvan, M. (2004), 'Finding and Evaluating Community Structure in Networks', Physical Review, 69, 026113.
65. Oinn, T., Greenwood, M., Addis, M., Nedim Alpdemir, M., Ferris, J., Glover, K., Goble, C., Goderis, A., Hull, D., Marvin, D., Li, P., Lord, P., Pocock, M.R., Senger, M., Stevens, R., Wipat, A., and Wroe, C. (2006), 'Taverna: Lessons in Creating a Workflow Environment for the Life Sciences', Concurrency and Computation: Practice and Experience, 18, 1067-1100, Special Issue on Workflow in Grid Systems. (Pubitemid 44258498)
66. Opitz, D., and Maclin, R. (1999), 'Popular Ensemble Methods: An Empirical Study', Journal of Artificial Intelligence Research, 11, 169-198. (Pubitemid 129628763)
67. Roman, D., Keller, U., Lausen, H., de Bruijn, J., Lara, R., Stollberg, M., Polleres, A., Feier, C., Bussler, C., and Fensel, D. (2005), 'Web Service Modeling Ontology', Applied Ontology, 1, 77-106.
68. Singh, G., Bharathi, S., Chervenak, A., Deelman, E., Kesselman, C., Manohar, M., Patil, S., and Pearlman, L. (2003), 'A Metadata Catalog Service for Data Intensive Applications', in Proceedings of the Supercomputing Conference, Phoenix, AR, November 2003.
69. Sirin, E., Parsia, B., Wu, D., Hendler, J., and Nau, D. (2004), 'HTN Planning for Web Service Composition using SHOP2', Journal of Web Semantics, 1, 377-396.
70. Sonnenburg, S., Braun, M.L., Ong, C.S., Bengio, S., Bottou, L., Holmes, G., LeCun, Y., Müller, K.-R., Pereira, F., Rasmussen, C.R., Rätsch, G., Schölkopf, B., Smola, A., Vincent, P., Weston, J., and Williamson, R. (2007), 'The Need for Open Source Software in Machine Learning', Journal of Machine Learning Research, 8, 2443-2466. (Pubitemid 350046193)
71. St Amant, R., and Cohen, P. (1998), 'Intelligent Support for Exploratory Data Analysis', Journal of Computational and Graphical Statistics, 7, 545-558. (Pubitemid 128635042)
72. Stefik, M. (1981), 'Planning With Constraints', Artificial Intelligence, 16, 111-140.
73. Szalay, A., and Gray, J. (2006), '2020 Computing: Science in an Exponential World', Nature, 440, 413-414, Special Issue on 2020 Computing.
74. Talia, D., Trunfio, P., and Verta, O. (2005), 'Weka4WS: A WSRF-Enabled Weka Toolkit for Distributed Data Mining on Grids', in 9th European Conference on Principles and Practice of Knowledge Discovery in Databases (PKDD 2005), Porto, Portugal, pp. 309-320.
75. Taylor, I., Deelman, E., Gannon, D., and Shields, M. (eds.) (2006), Workflows for e-Science, New York: Springer Verlag.
76. Thain, D., Tannenbaum, T., and Livny, M. (2005), 'Distributed Computing in Practice: The Condor Experience', Concurrency and Computation: Practice and Experience, 17, 323-356. (Pubitemid 40285781)
77. Tuchinda, R., Thakkar, S., Gil, Y., and Deelman, E. (2004), 'Artemis: Integrating Scientific Data on the Grid', in Proceedings of the 16th Annual Conference on Innovative Applications of Artificial Intelligence (IAAI), San Jose, CA, July 25-29, pp. 892-899.
78. Veloso, M.M. (1994), Planning and Learning by Analogical Reasoning, Berlin, Germany: Springer Verlag.
79. Von Laszewski, G., Hategan, M., and Kodeboyina, D. (2006), 'Java CoG Kit Workflow', in Workflows for e-Science, eds. D. Gannon, E. Deelman, M. Shields and I. Taylor, Berlin: Springer Verlag, pp. 340-356.
80. Washington, W.M. (2005), 'National Science Board 2020 Vision for the NSF', National Science Board Report. Available at www.nsf.gov/publications/pub- summ.jsp?ods-key=nsb05142
81. Wieczorek, M., Prodan, R., and Fahringer, T. (2005), 'Scheduling of Scientific Workflows in the ASKALON Grid Environment', SIGMOD Record, 34, 56-62. (Pubitemid 43152533)
82. Witten, I.H., and Frank, E. (2005), Data Mining: Practical Machine Learning Tools and Techniques (2nd ed.), San Francisco: Morgan Kaufmann.
83. Wroe, C., Goble, C., Goderis, A., Lord, P., Miles, S., Papay, J., Alper, P., and Moreau, L. (2007), 'Recycling Workflows and Services through Discovery and Reuse', Concurrency and Computation: Practice and Experience, 19, 181-194. (Pubitemid 46168107)
84. Zhao, J., Goble, C., Stevens, R., and Turi, D. (2008), 'Mining Taverna's Semantic Web of Provenance', Journal of Computation and Concurrency: Practice and Experience, eds. L. Moreau and B. Ludascher, Special issue on the First Provenance Challenge.