Batch queue resource scheduling for workflow applications

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2009, Pages

  Zhang, Yang ^a   Koelbe, Charles ^a   Cooper, Keith ^a  

^a Rice University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTATIONAL RESOURCES; HIGH PERFORMANCE COMPUTING; JOB SUBMISSION; PROGRAMMING PARADIGMS; RESOURCE MANAGEMENT POLICY; RESOURCE PROVISIONING; RESOURCE-SCHEDULING; SCHEDULING TECHNIQUES; SCIENTIFIC APPLICATIONS; SPACE-SHARING; TRADITIONAL TECHNIQUES; WORKFLOW APPLICATIONS;

CLUSTER COMPUTING; COMPUTER SCIENCE; QUEUEING THEORY; RESOURCE ALLOCATION; SCHEDULING; TECHNICAL PRESENTATIONS;

SCHEDULING ALGORITHMS;

EID: 72049118851     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2009.5289186     Document Type: Conference Paper

References (23)

1. Brett Bode, David M. Halstead, Ricky Kendall, Zhou Lei, and David Jackson. The portable batch scheduler and the maui scheduler on linux clusters. In ALS'00: Proceedings of the 4th annual Linux Showcase & Conference, pages 27-27, Berkeley, CA, USA, 2000. USENIX Association.
2. John Brevik, Daniel Nurmi, and Rich Wolski. Predicting bounds on queuing delay for batch-scheduled parallel machines. In PPoPP '06, pages 110-118, New York, NY, USA, 2006. ACM.
3. Ewa Deelman, Callaghan Scott, and et al. Managing largescale workflow execution from resource provisioning to provenance tracking: The cybershake example. In E-SCIENCE '06, page 14, Washington, DC, USA, 2006. IEEE Computer Society.
4. James Frey, Todd Tannenbaum, Miron Livny, Ian Foster, and Steven Tuecke. Condor-g: A computation management agent for multiinstitutional grids. Cluster Computing, 5(3):237-246, 2002.
5. Bill Howe, Peter Lawson, and et al. End-to-end escience: Integrating workflow, query, visualization, and provenance at an ocean observatory. In ESCIENCE '08, pages 127-134, Washington, DC, USA, 2008. IEEE Computer Society.
6. Cluster Resources Inc. http://clusterresources.com/.
7. David B. Jackson, Quinn Snell, and Mark J. Clement. Core algorithms of the maui scheduler. In JSSPP '01, pages 87-102, London, UK, 2001. Springer-Verlag.
8. Gideon Juve and Ewa Deelman. Resource provisioning options for large-scale scientific workflows. eScience, IEEE International Conference on, 0:608-613, 2008.
9. Yang-Suk Kee, C. Kesselman, D. Nurmi, and R. Wolski. Enabling personal clusters on demand for batch resources using commodity software. In Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, pages 1-7, April 2008.
10. Arun Krishnan. Gridblast: a globus-based high-throughput implementation of blast in a grid computing framework: Research articles. Concurr. Comput. : Pract. Exper., 17(13):1607-1623, 2005.
11. Load Sharing Facility (LSF). http://www.platform.com/.
12. S. Ludtke, P. Baldwin, and W. Chiu. EMAN: Semiautomated software for high resolution single-particle reconstructions. J. Struct. Biol, pages 82-97, 1999.
13. W. Gentzsch (Sun Microsystems). Sun grid engine: Towards creating a compute power grid. In CCGRID '01, page 35, Washington, DC, USA, 2001. IEEE Computer Society.
14. Daniel Nurmi and Anirban Mandal et al. Evaluation of a workflow scheduler using integrated performance modelling and batch queue wait time prediction. In SC '06, page 119, New York, NY, USA, 2006. ACM.
15. Daniel Charles Nurmi, Rich Wolski, and John Brevik. Varq: virtual advance reservations for queues. In HPDC '08: Proceedings of the 17th international symposium on High performance distributed computing, pages 75-86, New York, NY, USA, 2008. ACM.
16. Open PBS. http://www.openpbs.org/.
17. Condor Research Project. http://www.cs.wisc.edu/condor.
18. G. Singh, E. Deelman, and G. Bruce Berriman et al. Montage: a Grid enabled image mosaic service for the National Virtual Observatory. Astronomical Data Analysis Software and Systems, 2003.
19. Gurmeet Singh, Mei-Hui Su, and et al. Workflow task clustering for best effort systems with pegasus. In MG '08: Proceedings of the 15th ACM Mardi Gras conference, pages 1-8, New York, NY, USA, 2008. ACM.
20. Quinn Snell, Mark J. Clement, and et al. The performance impact of advance reservation meta-scheduling. In IPDPS '00/JSSPP '00, pages 137-153, London, UK, 2000. Springer-Verlag.
21. TeraGrid. http://www.teragrid.org/about.
22. Texas Advanced Supercomputing Center. http://www.tacc.utexas.edu/.
23. E. Walker, J.P. Gardner, V. Litvin, and E.L. Turner. Creating personal adaptive clusters for managing scientific jobs in a distributed computing environment. In Challenges of Large Applications in Distributed Environments, 2006 IEEE, pages 95-103, 2006.