WORKEM: Representing and emulating distributed scientific workflow execution state

CCGrid 2010 - 10th IEEE/ACM International Conference on Cluster, Cloud, and Grid Computing

Volumn , Issue , 2010, Pages 283-292

  Ramakrishnan, Lavanya ^a   Gannon, Dennis ^b   Plale, Beth ^c  

^a LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

^b MICROSOFT RESEARCH   (United States)

^c INDIANA UNIVERSITY   (United States)

Author keywords

Distributed systems; Scientific workflows; Workflow emulator

Indexed keywords

CUSTOMIZABLE; CYBER INFRASTRUCTURES; DATA SIZE; DISTRIBUTED INFRASTRUCTURE; DISTRIBUTED SYSTEMS; EXTENSIBLE FRAMEWORK; INTEGRAL PART; RIGHT MANAGEMENT; SCIENTIFIC WORKFLOWS; SHORT DURATIONS; WORK-FLOWS; WORKFLOW ENGINES; WORKFLOW EXECUTION;

CLUSTER COMPUTING; COMPUTATIONAL COMPLEXITY; DATA FLOW ANALYSIS; DESIGN; GRID COMPUTING;

MANAGEMENT;

EID: 77954898604     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CCGRID.2010.89     Document Type: Conference Paper

References (24)

1. D. Atkins, A Report from the U.S. National Science Foundation Blue Ribbon Panel on Cyberinfrastructure. CCGRID '02: Proceedings of the 2nd IEEE/ACM International Symposium on Cluster Computing and the Grid, 2002: p. 16.
2. L. Ramakrishnan et al., Toward a Doctrine of Containment: Grid Hosting with Adaptive Resource Control. Proceedings of the ACM/IEEE Conf. on High Performance Computing, Networking, Storage and Analysis, 2006.
3. K.K. Droegemeier et. al, Service-Oriented Environments for Dynamically Interacting with Mesoscale Weather. Computing in Science and Engg., 2005. 7(6): p. 12-29.
4. Apache ODE - http://ode.apache.org/.
5. Web Services Business Process Execution Language Ver. 2.0, Public review draft. 2006.
6. S. Shirasuna, A Dynamic Scientific Workflow System for Web Services Architecture. Department of Computer Science, Indiana University, 2007.
7. J.Schopf and F. Berman, Performance Prediction in Production Environments, 12th. International Parallel Processing Symposium, 1998.
8. L. Ramakrishnan and D.A. Reed, Performability Modeling for Scheduling and Fault Tolerance Strategies for Grid Workflows. ACM/IEEE International Symposium on High Performance Distributed Computing, 2008.
9. W. Kramer and C. Ryan, Performance Variability of Highly Parallel Architectures, Computational Science - ICCS, 2003.
10. Y. Huang, et al., WS-Messenger: A Web Services-Based Messaging System for Service- Oriented Grid Computing. Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid, 2006: p. 166-173.
11. D. Leake and K.-M. Joseph, Towards Case- Based Support for e-Science Workflow Generation by Mining Provenance, in Proc of the 9th European conference on Advances in Case- Based Reasoning. 2008.
12. G. Kandaswamy and D. Gannon. A Mechanism for Creating Scientific Application Services On demand from Workflows. Proceedings of the 2006 International Conference Workshops on Parallel Processing, pages 25-32, 2006.
13. S. Krishnan et al. Design and Evaluation of Opal2: A Toolkit for Scientific Software as a Service. IEEE Congress on Services (SERVICES-1 2009), July, 2009.
14. J. Wilkening et al. "Using Clouds for Metagenomics: A Case Study, " Preprint ANL/MCS-P1665-0809, Aug 2009.
15. Apache Hadoop http://hadoop.apache.org/.
16. Digital Data Provenance Project Website http://www.dataandsearch.org/ provenance/.
17. L. Ramakrishnan and et al. VGrADS: Enabling e-Science Workflows on Grids and Clouds with Fault Tolerance, The International Conference for High Performance Computing, Networking, Storage and Analysis, 2009.
18. J. Dean and S. Ghemawat, "MapReduce: Simplified Data Processing on Large Clusters, " in Proceedings of OSDI '04: 6th Symposium on Operating System Design and Implemention, San Francisco, CA, Dec. 2004.
19. L. Ramakrishnan, D. Gannon, "A Survey of Distributed Workflow Characteristics and Resource Requirements", Technical Report TR671, Department of Computer Science, Indiana University, Bloomington, Sept 2008, .
20. I.J. Taylor et al., eds. Workflows for e-Science: Scientific Workflows for Grids, Springer-Verlag, 2006.
21. R. Buyya and M. Murshed, GridSim: A Toolkit for the Modeling and Simulation of Distributed Resource Management and Scheduling for Grid Computing, The J. of Concurrency and Computation: Practice and Experience, Volume 14, Issue 13-15, Wiley Press, Nov.-Dec., 2002.
22. H. Casanova, Simgrid: A toolkit for the simulation of application scheduling. Proc. 1st IEEE/ACM International Symposium on Cluster Computing and the Grid May, 2001.
23. R. N. Calheiros, R. Ranjan, C. A. F. De Rose, and R. Buyya, CloudSim: A Novel Framework for Modeling and Simulation of Cloud Computing Infrastructures and Services, Tech. Report, GRIDS-TR-2009-1, The University of Melbourne, Australia, March, 2009.
24. Bin Cao, Beth Plale, Girish Subramanian, Ed Robertson, Yogesh Simmhan, "Provenance Information Model of Karma Version 3, " Services, IEEE Congress on, pp. 348-351, 2009 Congress on Services - I, 2009.