Pegasus: A framework for mapping complex scientific workflows onto distributed systems

Scientific Programming

Volumn 13, Issue 3, 2005, Pages 219-237

  Deelman, Ewa ^a   Singh, Gurmeet ^a   Su, Mei Hui ^a   Blythe, James ^a   Gil, Yolanda ^a   Kesselman, Carl ^a   Mehta, Gaurang ^a   Vahi, Karan ^a   Berriman, G Bruce ^b   Good, John ^b   Laity, Anastasia ^b   Jacob, Joseph C ^c   Katz, Daniel S ^c  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

^c CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER APPLICATIONS; DISTRIBUTED COMPUTER SYSTEMS; MATHEMATICAL TECHNIQUES;

DISTRIBUTED RESOURCES; MAPPING APPLICATIONS; SCIENTIFIC WORKFLOWS; TARGET EXECUTION;

MAPPING;

EID: 29644434815     PISSN: 10589244     EISSN: None     Source Type: Journal    
DOI: 10.1155/2005/128026     Document Type: Article

References (39)

1. E. Deelman et al., Mapping abstract, complex workflows onto grid environments, Journal of Grid Computing 1 (2003), 25-39.
2. E. Deelman et al., GriPhyNand LIGO, Building a Virtual Data Grid for Gravitational Wave Scientists, Proceedings of 11th Intl Symposium on High Performance Distributed Computing, 2002.
3. G.B. Berriman et al., Montage: A Grid Enabled Engine for Delivering Custom Science-Grade Mosaics On Demand, Proceedings of SPIE Conference 5487: Astronomical Telescopes, 2004.
4. E. Deelman et al., Pegasus: Mapping Scientific Workflows onto the Grid, Proceedings of 2nd EUROPEAN ACROSS GRIDS CONFERENCE, Nicosia, Cyprus, 2004.
5. Southern California Earthquake Center (SCEC), 2004. http://www.scec.org/.
6. P. Bruneman et al., Why and where: A characterization of data provenance, Proceedings of 8th International Conference on Database Theory, 2001.
7. I. Foster et al., Chimera: A Virtual Data System for Representing, Querying, and Automating Data Derivation, Proceedings of Scientific and Statistical Database Management, 2002.
8. J. Kim et al., A Knowledge-Based Approach to Interactive Workflow Composition, Proceedings of Workshop: Planning and Scheduling for Web and Grid Services at the 14th International Conference on Automatic Planning and Scheduling (ICAPS 04), Whistler, Canada, 2004.
9. J. Kim et al., An Intelligent Assistant for Interactive Workflow Composition, Proceedings of 2004 International Conference on Intelligent User Interfaces (IUI-2004), Madeira Islands, Portugal, 2004.
10. G. Singh et al., A Metadata Catalog Service, for Data Intensive Applications, Proceedings of Supercomputing (SC), 2003.
11. E. Deelman et al., Grid-Based Metadata Services, Proceedings of Statistical and Scientific Database Management (SSDBM), Santorini, Greece, 2004.
12. D. Sundaram-Stukel and M.K. Vernon, Predictive Analysis of a Wavefront Application Using LogGP, Proceedings of 7th ACM SIGPLAN Symp. on Principles and Practices of Parallel Programming (PPoPP '99), Atlanta, GA, 1999.
13. V. Taylor et al., Using Kernel Couplings to Predict Parallel Application Performance, Proceedings of 11th IEEE International Symposium on High-Performance Distributed Computing (HPDC 2002), Edinburgh, Scotland, 2002.
14. V.S. Adve et al., POEMS: End-to-end performance design of large parallel adaptive computational systems, IEEE Transactions on Software Engineering 26 (2000), 1027-1048.
15. I. Foster and C. Kesselman, The Grid: Blueprint for a New Computing Infrastructure, (2nd ed.), Morgan Kauffmann, 2004.
16. E. Deelman et al., Workflow Management in GriPhyN, in: Grid Resource Management, J. Nabrzyski, J. Schopf and J. Weglarz, eds, Kluwer, 2003.
17. "Globus", http://www.globus.org/.
18. K. Czajkowski et al., A Resource Management Architecture for Metacomputing Systems, in 4th Workshop on Job Scheduling Strategies for Parallel Processing: Springer-Verlag, 1998, 62-82.
19. W. Allcock et al., Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing, Proceedings of Mass Storage Conference, 2001.
20. K. Czajkowski et al., Grid Information Services for Distributed Resource Sharing, Proceedings of 10th IEEE International Symposium on High Performance Distributed Computing, 2001.
21. A. Chervenak et al., Giggle: A Framework for Constructing Sclable Replica Location Services, Proceedings of Proceedings of Supercomputing 2002 (SC2002), 2002.
22. J. Frey et al., Condor-G: A computation management agent for multi-institutional grids, Cluster Computing 5 (2002), 237-246.
23. E. Deelman et al., Transformation Catalog Design for GriPhyN, Technical Report GriPhyN-2001-17, 2001.
24. MPI: A Message-Passing Interface Standard, May 1994.
25. "Montage", http://montage.ipac.caltech.edu.
26. R. Henderson and D. Tweten, Portable Batch System; External Reference Specification, 1996.
27. S. Zhou, LSF: Load Sharing in Large-Scale Heterogeneous Distributed Systems, in Proc. Workshop on Cluster Computing, 1992.
28. B. Bode et al., The Portable Batch Scheduler and the Maui Scheduler on Linux Clusters, Proceedings of 4th Annual Linux Showcase & Conference, Atlanta, 2000.
29. E. Akarsu et al., WebFlow - High-Level Programming Environment and Visual Authoring Toolkit for High Performance Distributed Computing, 1998. http://www.supercomp. org/sc98/TechPapers/sc98.FullAbstracts/Akarsu809/Index. htm.
30. G. v. Laszewski et al., A java commodity grid toolkit, Concurrency: Practice and Experience 13 (2001), 643-662.
31. J. Cao et al., GridFlow: WorkFlow Management for Grid Computing, Proceedings of 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CC-GRID'03), 2003.
32. G. v. Laszewski et al., GridAnt - Client Side Grid Workflow Management with Ant, 2003. http://www-unix. globus.org/cog/projects/gridant/gridant- whitepaper.pdf.
33. "ANT." http://ant.apache.org.
34. R. Buyya et al., Nimrod-G: An Architecture for a Resource Management and Scheduling System in a Global Computational Grid, Proceedings of HPC ASIA'2000, 2000.
35. J. Beiriger et al., Constructing the ASCI Grid, Proceedings of Proc. 9th IEEE Symposium on High Performance Distributed Computing, 2000.
36. "Globus Toolkit 3". http://www.globus.org/ogsa/.
37. V. Welch et al., Security for Grid Services, Proceedings of Twelfth International Symposium on High Performance Distributed Computing (HPDC-12), 2003.
38. E. Deelman et al., Pegasus and the Pulsar Search: From Metadata to Execution on the Grid, Proceedings of Applications Grid Workshop, PPAM 2003, Czestochowa, Poland, 2003.
39. "Pegasus", http://pegasus.isi.edu.