Towards supporting the life cycle of large scale scientific experiments

International Journal of Business Process Integration and Management

Volumn 5, Issue 1, 2010, Pages 79-92

  Mattoso, Marta ^a   Werner, Cláudia ^a   Travassos, Guilherme Horta ^a   Braganholo, Vanessa ^a   Ogasawara, Eduardo ^a   De Oliveira, Daniel ^a   Da Cruz, Sérgio Manuel Serra ^a   Martinho, Wallace ^a   Murta, Leonardo ^b  

^a FEDERAL UNIVERSITY OF RIO DE JANEIRO   (Brazil)

^b FLUMINENSE FEDERAL UNIVERSITY   (Brazil)

Author keywords

E science; In silico experiment; Scientific experiment; Scientific experiment life cycle; Scientific workflow

Indexed keywords

EID: 77952150426     PISSN: 17418763     EISSN: 17418771     Source Type: Journal    
DOI: 10.1504/IJBPIM.2010.033176     Document Type: Article

References (59)

1. Abramson, D., Bethwaite, B., Enticott, C., Garic, S., Peachey, T., Michailova, A., Amirriazi, S. and Chitters, R. (2009) 'Robust workflows for science and engineering', in Proceedings of the 2nd Workshop on Many-Task Computing on Grids and Supercomputers, Portland, Oregon, pp.1-9.
2. Altintas, I., Berkley, C., Jaeger, E., Jones, M., Ludascher, B. and Mock, S. (2004) 'Kepler: an extensible system for design and execution of scientific workflows', in 16th SSDBM, Santorini, Greece, pp.423-424.
3. Barga, R.S., Fay, D., Guo, D., Newhouse, S., Simmhan, Y. and Szalay, A. (2008) 'Efficient scheduling of scientific workflows in a high performance computing cluster', in 6th International Workshop On Challenges Of Large Applications In Distributed Environments, Boston, MA, USA, pp.63-68.
4. Berriman, G.B., Deelman, E., Good, J., Jacob, J.C., Katz, D.S., Laity, A.C., Prince, T.A., Singh, G. and Su, M. (2007) 'Generating complex astronomy workflows', Workflows for e-Science, Springer, pp.19-38.
5. Bose, R. and Frew, J. (2005) 'Lineage retrieval for scientific data processing: a survey', ACM Computing Surveys, Vol.37, No.1, pp.1-28.
6. Callahan, S.P., Freire, J., Santos, E., Scheidegger, C.E., Silva, C.T. and Vo, H.T. (2006) 'VisTrails: visualization meets data management', in Proceedings of the 2006 ACM SIGMOD, Chicago, IL, USA, pp.745-747.
7. Cavalcanti, M.C., Targino, R., Baião, F., Rössle, S. ., Bisch, P.M., Pires, P.F., Campos, M.L.M. and Mattoso, M. (2005) 'Managing structural genomic workflows using web services', Data & Knowledge Engineering, Vol.53, No.1, pp.45-74.
8. Conradi, R. and Westfechtel, B. (1998) 'Version models for software configuration management', ACM Computing Surveys, Vol.30, No.2.
9. Cruz, S.M.S.D., Campos, M. and Mattoso, M. (2009) 'Towards a taxonomy of provenance in scientific workflow management systems', in IEEE International Workshop on Scientific Workflows, Los Angeles, California, USA.
10. Dart, S. (1991) 'Concepts in configuration management systems', in Proceedings of the 3rd International Workshop on Software Configuration Management, Trondheim, Norway, pp.1-18.
11. Davidson, S.B. and Freire, J. (2008) 'Provenance and scientific workflows: challenges and opportunities', in Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, Canada, pp.1345-1350.
12. Dávila, A.M.R., Mendes, P.N., Wagner, G., Tschoeke, D.A., Cuadrat, R.R.C., Liberman, F., Matos, L., Satake, T., Ocaña, K.A.C.S., et al., (2008) 'ProtozoaDB: dynamic visualization and exploration of protozoan genomes', Nucleic Acids Research, January, Database issue, Vol.36, pp.D547-D552.
13. Den, J. and Ghemawat, S. (2008) 'MapReduce: simplified data processing on large clusters', Commun. ACM, Vol.51, No.1, pp.107-113.
14. Deelman, E., Gannon, D., Shields, M. and Taylor, I. (2009) 'Workflows and e-science: an overview of workflow system features and capabilities', Future Generation Computer Systems, Vol.25, No.5, pp.528-540.
15. Deelman, E., Mehta, G., Singh, G., Su, M. and Vahi, K. (2007) 'Pegasus: mapping large-scale workflows to distributed resources', Workflows for e-Science, Springer, pp.376-394.
16. Del Rio, N. and da Silva, P. (2007) 'Probe-it! Visualization support for provenance', Advances in Visual Computing, pp.732-741.
17. Frakes, W. and Kang, K. (2005) 'Software reuse research: status and future', IEEE Transactions on Software Engineering, Vol.31, No.7, pp.529-536.
18. Freire, J., Koop, D., Santos, E. and Silva, C.T. (2008) 'Provenance for computational tasks: a survey', Computing in Science and Engineering, Vol.10, No.3, pp.11-21.
19. Gannon, D., Plale, B., Marru, S., Kandaswamy, G., Simmhan, Y. and Shirasuna, S. (2007) 'Dynamic, adaptive workflows for mesoscale meteorology', Workflows for e-Science, Springer, pp.126-142.
20. GExp (2009) Large Scale Management of Scientific Experiments, available at http://gexp.nacad.ufrj.br/.
21. Goble, C., Wroe, C. and Stevens, R. (2003) 'The myGrid project: services, architecture and demonstrator', in Proc. of the UK e-Science All Hands Meeting.
22. Goderis, A., De Roure, D., Goble, C., Bhagat, J., Cruickshank, D., Fisher, P., Michaelides, D. and Tanoh, F. (2008) 'Discovering scientific workflows: the myExperiment benchmarks', IEEE Transactions on Automation Science and Engineering.
23. Holland, D., Braun, U., Maclean, D., Muniswamy-Reddy, K. and Seltzer, M. (2008) 'Choosing a data model and query language for provenance', in Second International Provenance and Annotation Workshop - IPAW, Salt Lake City, UT, USA.
24. Hull, D., Wolstencroft, K., Stevens, R., Goble, C., Pocock, M.R., Li, P. and Oinn, T. (2006) 'Taverna: a tool for building and running workflows of services', Nucleic Acids Research, Web server issue, Vol.34, pp.729-732.
25. Ioannidis, Y.E. and Wong, E. (1987) 'Query optimization by simulated annealing', in Proceedings of the 1987 ACM SIGMOD International Conference on Management of Data, San Francisco, California, USA, pp.9-22.
26. Jarrard, R.D. (2001) Scientific Methods. Online book, available at http://emotionalcompetency.com/sci/booktoc.html.
27. Koop, D., Scheidegger, C., Callahan, S., Freire, J. and Silva, C. (2008) 'VisComplete: automating suggestions for visualization pipelines', IEEE Transactions on Visualization and Computer Graphics, Vol.14, No.6, pp.1691-1698.
28. Lin, C., Lu, S., Fei, X., Pai, D. and Hua, J. (2009) 'A task abstraction and mapping approach to the shimming problem in scientific workflows', in Proceedings of the 2009 IEEE International Conference on Services Computing, Vol.00, pp.284-291.
29. Livny, I., Ioannidis, Y., Livny, M., Haber, E., Miller, R., Tsatalos, O. and Wiener, J. (1994) 'Desktop experiment management', IEEE Data Engineering Bulletin, Vol.16.
30. Martinho, W., Ogasawara, E., Oliveira, D., Chirigati, F., Santos, I., Travassos, G. and Mattoso, M. (2009) 'A conception process for abstract workflows: an example on deep water oil exploitation domain', in 5th IEEE International Conference on e-Science, Oxford, UK.
31. McGough, A.S., Lee, W., Cohen, J., Katsiri, E. and Darlington, J. (2007) 'ICENI', Workflows for e-Science, Springer, pp.395-415.
32. Medeiros, C., Vossen, G. and Weske, M. (1995) 'WASA: a workflow-based architecture to support scientific database applications', Database and Expert Systems Applications, pp.574-583.
33. Moreau, L., Freire, J., Futrelle, J., McGrath, R., Myers, J. and Paulson, P. (2008) 'The open provenance model: an overview', Provenance and Annotation of Data and Processes, pp.323-326.
34. Northrop, L. (2002) 'SEI's software product line tenets', IEEE Software, Vol.19, No.4, pp.32-40.
35. Ogasawara, E., Oliveira, D., Chirigati, F., Barbosa, C., Elias, R.N., Braganholo, V. and Mattoso, M. (2009a) 'Exploring many task computing in scientific workflows', in 2nd Workshop on Many-Task Computing on Grids and Supercomputers, pp.1-10.
36. Ogasawara, E., Paulino, C., Murta, L., Werner, C. and Mattoso, M. (2009b) 'Experiment line: software reuse in scientific workflows', in 21th SSDBM, New Orleans, LA, pp.264-272.
37. Ogasawara, E., Rangel, P., Murta, L., Werner, C. and Mattoso, M. (2009c) 'Comparison and versioning of scientific workflows', in International Workshop on Comparison and Versioning of Software Models, Vancouver, Canada, pp.25-30.
38. Oinn, T., Li, P., Kell, D.B., Goble, C., Goderis, A. and Greenwood, M., Hull, D., Stevens, R., Turi, D., et al. (2007) 'Taverna/myGrid: aligning a workflow system with the life sciences community', Workflows for e-Science, Springer, pp.300-319.
39. Oliveira, D., Cunha, L., Tomaz, L., Pereira, V. and Mattoso, M. (2009a) 'Using ontologies to support deep water oil exploration scientific workflows', in IEEE International Workshop on Scientific Workflows, Los Angeles, California, USA.
40. Oliveira, D., Ogasawara, E., Baião, F. and Mattoso, M., (2009b) 'Using ontologies to provide different levels of abstraction in scientific workflows', in 5th IEEE International Conference on e-Science, Oxford, UK.
41. Oliveira, F., Murta, L., Werner, C. and Mattoso, M. (2008) 'Using provenance to improve workflow design', in 2nd International Provenance and Annotation Workshop - IPAW, Salt Lake City, UT, USA, pp.136-143.
42. Pennington, D.D., Higgins, D., Peterson, A.T., Jones, M.B., Ludäscher, B. and Bowers, S. (2007) 'Ecological niche modeling using the Kepler workflow system', Workflows for e-Science, Springer, pp.91-108.
43. Pressman, R.S. (2004) Software Engineering Software Engineering: A Practitioner's Approach, 6th ed., McGraw-Hill.
44. Qin, J., Fahringer, T. and Pllana, S. (2007) 'UML based grid workflow modeling under ASKALON', Distributed and Parallel Systems, pp.191-200.
45. Raicu, I., Foster, I. and Zhao, Y. (2008) 'Many-task computing for grids and supercomputers', in Workshop on Many-Task Computing on Grids and Supercomputers, pp.1-11.
46. Raicu, I., Zhao, Y., Dumitrescu, C., Foster, I. and Wilde, M. (2007) 'Falkon: a fast and light-weight task execution framework', in 2007 ACM/IEEE Conference on Supercomputing, Reno, Nevada, pp.1-12.
47. Robertson, G.G., Card, S.K. and Mackinlay, J.D. (1993) 'Information visualization using 3D interactive animation', Communications of the ACM, Vol.36, No.4, pp.57-71.
48. Scheidegger, C.E., Vo, H.T., Koop, D., Freire, J., Silva, C.T., (2008) 'Querying and re-using workflows with VsTrails', in Proceedings of the 2008 ACM SIGMOD International Conference on Management of Data, Vancouver, Canada, pp.1251-1254.
49. Simmhan, Y.L., Plale, B. and Gannon, D. (2005) 'A survey of data provenance in e-science', ACM SIGMOD Record, Vol.34, No.3, pp.31-36.
50. Soanes, C. and Stevenson, A. (2003) Oxford Dictionary of English, 2nd ed., Oxford University Press.
51. Stevens, R.D., Tipney, H.J., Wroe, C.J., Oinn, T.M., Senger, M., Lord, P.W., Goble, C.A., Brass, A. and Tassabehji, M. (2004) 'Exploring Williams-Beuren syndrome using myGrid', Bioinformatics, August, suppl-1, Vol.20, pp.i303-310.
52. Stevens, R., Glover, K., Greenhalgh, C., Jennings, C., Pearce, S., Li, P., Radenkovic, M., Wipat, A., Tower, C., et al. (2003) 'Performing in silico experiments on the grid: a users perspective', in Proc UK e-Science Programme All Hands Conference, Nottingham, UK, pp.2-4.
53. Taylor, I., Shields, M., Wang, I. and Harrison, A. (2007) 'The Triana workflow environment: architecture and applications', Workflows for e-Science, Springer, pp.320-339.
54. Travassos, G.H. and Barros, M.O. (2003) 'Contributions of in virtuo and in silico experiments for the future of empirical studies in software engineering', in Proc. of 2nd Workshop on Empirical Software Engineering the Future of Empirical Studies in Software Engineering, Roma.
55. Verdi, K.K., Ellis, H.J. and Gryk, M.R. (2007) 'Conceptual-level workflow modeling of scientific experiments using NMR as a case study', BMC Bioinformatics, Vol.8, p.31.
56. Walker, E. and Guiang, C. (2007) 'Challenges in executing large parameter sweep studies across widely distributed computing environments', in 5th IEEE Workshop on Challenges of Large Applications in Distributed Environments, Monterey, California, USA, pp.11-18.
57. Wieczorek, M., Prodan, R. and Fahringer, T. (2005) 'Scheduling of scientific workflows in the ASKALON grid environment', SIGMOD Rec., Vol.34, No.3, pp.56-62. (Pubitemid 43152533)
58. Yu, J. and Buyya, R. (2005) 'A taxonomy of workflow management systems for grid computing', Journal of Grid Computing, Vol.34, Nos. 3-4, pp.171-200. (Pubitemid 43280301)
59. Zhao, Y., Dobson, J., Foster, I., Moreau, L. and Wilde, M. (2005) 'A notation and system for expressing and executing cleanly typed workflows on messy scientific data', ACM SIGMOD Record, Vol.34, No.3, pp.37-43.