Pegasus on the virtual grid: A case study of workflow planning over captive resources

2008 3rd Workshop on Workflows in Support of Large-Scale Science, WORKS 2008

Volumn , Issue , 2008, Pages

  Kee, Yang Suk ^a   Byun, Eunkyu ^b   Deelman, Ewa ^c   Vahi, Karan ^c   Kim, Jin Soo ^d  

^a Oracle USA Inc   (United States)

^b Korea Advanced Institute of Science and Technology (KAIST)   (South Korea)

^c UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^d Sungkyunkwan University   (South Korea)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTING ENVIRONMENTS; PEGASUS; RESEARCH OPPORTUNITIES; RESOURCE CAPACITIES; RESOURCE CONFIGURATIONS; RESOURCE DESCRIPTIONS; SCIENTIFIC APPLICATIONS; SITE INFORMATIONS; VIRTUAL GRIDS; WORK-FLOWS;

ENTERPRISE RESOURCE MANAGEMENT;

APPLICATIONS;

EID: 78650758987     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/WORKS.2008.4723961     Document Type: Conference Paper

References (32)

1. B. Plale, D. Gannon, et al., "CASA and LEAD: Adaptive Cyberinfřastructure for Real-Time Multiscale Weather Forecasting," IEEE Computer, vol. 39, pp. 56-64, 2006.
2. W. W. Li, R. W. Byrnes, et al., "The Encyclopedia of Life Project: Grid Software and Deployment," New Generation Computing, vol. 22, pp. 127-136, 2004.
3. W. Chrabakh and R. Wolski, "GridSAT: A Chaff-based Distributed SAT Solver for the Grid," in IEEE International Conference on High Performance Computing and Communication (SC03): IEEE, 2003.
4. S. J. Ludtke, P. R. Baldwin, and W. Chiu, "EMAN: Semiautomated Software for High-Resolution Single-Particle Reconstructions," Journal of Structural Biology, vol. 128, pp. 82-97, 1999.
5. G. B. Berriman, E. Deelman, et al., "Montage: a Grid Enabled Engine for Delivering Custom Science-Grade Image Mosaics on Demand," in SPIE Conference on Astronomical Telescopes and Instrumentation, vol. 5493: SPIE, 2004.
6. E. Deelman, G. Singh,et al., "Pegasus: a Framework for Mapping Complex Scientific Workflows onto Distributed Systems," Scientific Programming Journal, vol. 13, pp. 219-237, 2005.
7. T. Fahringer, A. Jugravu, et al., "ASKALON: a Tool Set for Cluster and Grid Computing," Concurrency and Computation: Practice and Experience, vol. 17, pp. 143-169, 2005.
8. D. Churches, G. Gombas, et al., "Programming Scientific and Distributed Workflow with Triana Services," Concurrency and Computation: Practice and Experience, vol. 18, pp. 1021-1037, 2006.
9. Y.-S, Kee and C. Kesselman, "Grid Resource Abstraction, Virtualization, and Provisioning for Time-targeted Applications," in ACM/IEEE International Symposium on Cluster Computing and the Grid (CCGRID'08): IEEE, 2008.
10. D. Irwin, J. Chase, et al., "Sharing Networked Resources with Brokered Leases," in USENIX Annual Technical Conference (USENlX): Usenix, 2006.
11. "Amazon Elastic Compute Cloud."
12. J. Frey, T. Tannenbaum, et al., "Condor-G: A Computation Management Agent for Multi-Institutional Grids," in IEEE International Symposium on High Performance Distributed Computing (HPDC-10): IEEE, 2001, pp. 55-63.
13. I. Foster and C. Kesselman, "Globus: A Metacomputing Infrastructure Toolkit," International Journal of Supercomputer Applications, vol. 11, pp. 115-128, 1997.
14. Y. Gil, V. Ratnakar, et al., " Wings for Pegasus: Creating Large-Scale Scientific Applications Using Semantic Representations of Computational Workflows," in The 19th Annual Conference on Innovative Applications of Artificial Intelligence (IAAI). Vancouver, British Columbia, Canada, 2007.
15. S. Fitzgerald, I. Foster, et al., "A directory service for configuring high-performance distributed computations," in International Symposium on High Performance Distributed Computing (HPDC '97). IEEE Computer Society Press, 1997, pp. 365-375.
16. A. L. Chervenak, N. Palavalli,et al., "Performance and Scalability of a Replica Location Service," in Proceedings of the International IEEE Symposium on High Performance Distributed Computing (HPDC-13): IEEE, 2004.
17. Y.-S. Kee, D. Logothetis,et al., "Efficient Resource Description and High Quality Selection for Virtual Grids," in ACM/IEEE International Symposium on Cluster Computing and the Grid (CCGRID'05). Cardiff, United Kingdom: IEEE, 2005, pp. 598-606.
18. Y.-S. Kee, K. Yocum, et al., "Improving Grid Resource Allocation via Integrated Selection and Binding," in ACM/IEEE International Conference on High Performance Computing and Communication (SC'06). Tampa, United States: IEEE, 2006.
19. C. Liu and I. Foster, "A Constraint Language Approach to Matchmaking," in IEEE International Workshop on Research Issues on Data Engineering: Web Services for E-Commerce and E-Govemment Applications (RIDE'04): IEEE, 2004, pp. 7-14.
20. Y.-S. Kee, C. Kesselman, et al.i, "Enabling Personal Clusters on Demand for Batch Resources Using Commodity Software," in International Heterogeneity Computing Workshop (HCW'08) in conjunction with IEEE IPDPS'08,2007.
21. R. L. Henderson, "Job Scheduling Under the Portable Batch System," in Lecture Notes in Computer Science, vol. 949, IPPS '95 Workshop on Job Scheduling Strategies for Parallel Processing: Springer, 1995, pp. 279-294.
22. I. Foster, "Globus Toolkit Version 4: Software for Service-Oriented Systems," in Lecture Notes in Computer Science, vol. 3779, IFIP International Conference on Network and Parallel Computing: Springer, 2005, pp. 2-13.
23. R. Huang, H. Casanova, and A. A. Chien, "Automatic Resource Specification Generation for Resource Selection," in ACM/IEEE conference on Supercomputing (SC07): IEEE, 2007.
24. E.-K. Byun, Y.-S. Kee, et al., "Efficient Resource Capacity Estimate of Workflow Applications for Provisioning Resources," in IEEE International Conference on e-Science (e-Science08). Indiana: IEEE, 2008.
25. E. Deelman, S. Callaghan, et al., "Managing Large-Scale Workflow Execution from Resource Provisioning to Provenance tracking: The CyberShake Example," in IEEE International Conference on e-Science and Grid Computing (e-Science'06): IEEE, 2006.
26. I. Foster, C. Kesselman, and S. Tuecke, "The Anatomy of the Grid: Enabling Scalable Virtual Organizations," International Journal of High Performance Computing Applications, vol. 15, pp. 200-222, 2001.
27. M. Litzkow, M. Livny, and M. Mutka, "Condor - A Hunter of Idle Workstations," in IEEE International Conference on Distributed Computing Systems (ICDCS-8): IEEE, 1988, pp. 104-111.
28. L. C. Wolf and R. Steinmetz, "Concepts for Resource Reservation in Advance," Multimedia Tools and Applications, vol. 4, pp. 255-278, 1997.
29. G. Singh, C. Kesselman, and E. Deelman, "Adaptive Pricing for Resource Reservations," in IEEE/ACM International Conference on Grid Computing (Grid 2007). Austin, Texas, 2007.
30. G. Singh, C. Kesselman, and E. Deelman, "Performance Impact of Resource Provisioning on Workflows," University of Southern California, Technical Report CS05-850, 2005.
31. R. Huang, H. Casanova, and A. A. Chien, "Using Virtual Grids to Simplify Application Scheduling," in IEEE International Parallel & Distributed Processing Symposium (IPDPS'06): IEEE, 2006.
32. Y. Zhang, A. Mandal, H. Casanova, Y.-S. Kee, A. A. Chien, C. Koelbel, and K. Kennedy, "Scalable Grid Application Scheduling via Decoupled Resource Selection and Scheduling," in ACM/IEEE International Symposium on Cluster Computing and the Grid (CCGRID'06). Singapore: IEEE, 2006.