A framework for efficient data analytics through automatic configuration and customization of scientific workflows

Proceedings - 2011 7th IEEE International Conference on eScience, eScience 2011

Volumn , Issue , 2011, Pages 379-386

  Hauder, Matheus ^a   Gil, Yolanda ^b   Liu, Yan ^c  

^a UNIVERSITY OF AUGSBURG   (Germany)

^b UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^c NONE   (United States)

Author keywords

Data Analytics; Scientific Workflows

Indexed keywords

AUTOMATIC CONFIGURATION; COMPUTATIONAL EXPERIMENT; DATA ANALYTICS; DESIGN SPACES; SCIENTIFIC WORKFLOWS; SEMANTIC CONSTRAINTS; WORK-FLOW SYSTEMS; WORK-FLOWS;

SEMANTICS;

ALGORITHMS;

EID: 84863019411     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/eScience.2011.59     Document Type: Conference Paper

References (25)

1. I. J. Taylor, E. Deelman, D. Gannon, and M. Shields, Workflows for e-Science: Scientific Workflows for Grids. Springer-Verlag, 2006.
2. Y. Gil, "From Data to Knowledge to Dicoveries: Scientific Workflows and Artificial Intelligence," Scientific Programming, vol. 17, 2009.
3. D. De Roure, C. Goble, and R. Stevens, "The design and realisation of the Virtual Research Environment for social sharing of workflows,"Future Generation Computer Systems, vol. 25, no. 5, pp. 561-567, 2009.
4. S. P. Callahan, J. Freire, E. Santos, C. E. Scheidegger, C. T. Silva, and H. T. Vo, "VisTrails: Visualization meets Data Management," in ACM SIGMOD, 2006, pp. 745-747.
5. C. Wroe, C. A. Goble, A. Goderis, P. W. Lord, S. Miles, J. Papay, P. Alper, and L. Moreau, "Recycling workflows and services through discovery and reuse," Concurrency and Computation: Practice and Experience, vol. 19, pp. 181-194, 2007. (Pubitemid 46168107)
6. Y. Gil, V. Ratnakar, J. Kim, P. A. González-Calero, P. Groth, J. Moody, and E. Deelman, "WINGS: Intelligent Workflow-Based Design of Computational Experiments," in IEEE Intelligent Systems (IS'11), London, UK, 2011.
7. Y. Gil, P. Groth, V. Ratnakar, and C. Fritz, "Expressive Reusable Workflow Templates," in Proceedings of the Fith IEEE International Conference on e-Science, Oxford, UK, 2009.
8. Y. Gil, P. González-Calero, J. Moody, and V. Ratnakar, "A Semantic Framework for Automatic Generation of Computational Workflows Using Distributed Data and Component Catalogs," To appear in the Journal of Experimental and Theoretical Artificial Intelligence, 2011.
9. K. Patel, N. Bancroft, S. Drucker, J. Fogarty, A. Ko, and J. A. Landay, "Gestalt: Integrated Support for Implementation and Analysis in Machine Learning Processes," in Proceedings of the ACM Symposium on User Interface Software and Technology UIST, 2010.
10. M. Hall, Y. Gil, and R. Lucas, "Self-Configuring Applications for Heterogeneous Systems: Program Composition and Optimization Using Cognitive Techniques," in Proceedings of the IEEE, Special Issue on Cutting-Edge Computing: Using New Commodity Architectures, vol. 96, no. 5, 2008.
11. A. W. Brown, Large Scale Component Based Development. Prentice Hall PTR; 1st edition, 2000.
12. E. Deelman, J. Blythe, Y. Gil, C. Kesselman, G. Mehta, K. Vahi, K. Blackburn, A. Lazzarini, A. Arbree, R. Cavanaugh, and S. Koranda, "Mapping Abstract Workflows onto Grid Environments," Journal of Grid Computing, vol. 1, no. 1, 2003. [Online]. Available: papers/deelman-etal-jogc03.pdf
13. Y. Gil, V. Ratnakar, and C. Fritz, "Assisting Scientists with Complex Data Analysis Tasks through Semantic Workflows," in In Proceedings of the AAAI Fall Symposium on Proactive Assistant Agents, Arlington, VA, Nov. 2010.
14. T. Oinn, M. Greenwood, M. Addis, N. Alpdemir, J. Ferris, K. Glover, C. Goble, A. Goderis, D. Hull, D. Marvin, P. Li, P. Lord, M. Pocock, M. Senger, R. Stevens, A. Wipat, and C. Wroe, "Taverna: Lessons in creating a workflow environment for the life sciences," Concurrency and Computation: Practice and Experience, vol. 18, iss. 10, pp. 1067-1100, 2006. (Pubitemid 44258498)
15. M. Reich, T. Liefeld, J. Gould, J. Lerner, and J. P. Mesirov, "GenePattern 2.0," Nature Genetics 38, vol. 5, doi:10.1038/ng0506-500, pp. 500-501, 2006.
16. (1998, Jan.) The 4 Universities Data Set. Carnegie Mellon University. [Online]. Available: http://www.cs.cmu.edu/afs/cs/project/theo-20/www/data/
17. (2008, Jan.) The 20 Newsgroups data set. [Online]. Available: http://people.csail.mit.edu/jrennie/20Newsgroups/
18. (2004, May) Reuters-21578. Carnegie Group, Inc. and Reuters, Ltd. [Online]. Available: http://www.daviddlewis.com/resources/testcollections/ reuters21578/
19. I. H. Witten, E. Frank, L. Trigg, M. Hall, G. Holmes, and S. J. Cunningham, "Weka: Practical Machine Learning Tools and Techniques with Java Implementations," ICONIP/ANZIIS/ANNES, pp. 192-196, 1999.
20. R.-E. Fan, K.-W. Chang, C.-J. Hsieh, X.-R. Wang, and C.-J. Lin, "LIBLINEAR: A library for large linear classification," Journal of Machine Learning Research, vol. 9, pp. 1871-1874, Dec. 2008.
21. Y. Yang and J. O. Pedersen, "A Comparative Study on Feature Selection in Text Categorization," in International Conference on Machine Learning (IDCML'97). Morgan Kaufmann Publishers, 1997, pp. 412-420.
22. G. Karypis. (2006, Oct.) CLUTO - Software for Clustering High- Dimensional Datasets. Karypis Lab, University of Minnesota. [Online]. Available: http://glaros.dtc.umn.edu/gkhome/views/cluto
23. (2011, Jun.) Jena: Semantic web framework. HP-Lab. [Online]. Available: http://jena.sourceforge.net/documentation.html
24. S. Sonnenburg, S. Bengio, L. Bottou, Y. LeCun, and K.-R. Müller, "The Need for Open Source Software in Machine Learning," Journal of Machine Learning Research, 2007.
25. D. Ferrucci and A. Lally, "UIMA: An architectural approach to unstructured information processing in the corporate research environment,"Nat. Lang. Eng., vol. 10, pp. 327-348, 2004.