Predicting bounds on queuing delay for batch-scheduled parallel machines

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn 2006, Issue , 2006, Pages 110-118

  Brevik, John ^a   Nurmi, Daniel ^a   Wolski, Rich ^a  

^a University of California   (United States)

Author keywords

Batch queue systems; Grid computing; High performance computing; Queue wait time analysis; Scheduling

Indexed keywords

CODES (SYMBOLS); DATA STORAGE EQUIPMENT; DISTRIBUTED DATABASE SYSTEMS; QUEUEING NETWORKS; SCHEDULING; STORAGE ALLOCATION (COMPUTER);

BATCH-QUEUING SYSTEMS; DISTRIBUTED-MEMORY PARALLEL MACHINES; JOB SUBMISSION; QUEUING DELAY;

PARALLEL PROCESSING SYSTEMS;

EID: 33751055576     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1122971.1122989     Document Type: Conference Paper

References (30)

1. IBM LoadLeveler User's Guide. Technical report, International Business Machines Corporation, 1993.
2. F. Berman, O. Fox, and T. Hey. Grid Computing: Making the Global Infrastructure a Reality. Wiley and Sons, 2003.
3. G. Box, G. Jenkins, and G. Reinsel. Time Series Analysis, Forecasting, and Control, 3rd edition. Prentice Hall, 1994.
4. J. Brevik, D. Nurmi, and R. Wolski. Quantifying machine availability in networked and desktop grid systems. In Proceedings of CCGrid04, April 2004.
5. S.-H. Chiang and M. K. Vernon. Dynamic vs. Static Quantum-based Processor Allocation. Springer-Verlag, 1996.
6. S. Clearwater and S. Kleban. Heavy-tailed distributions in supercomputer jobs. Technical Report SAND2002-2378C, Sandia National Labs, 2002.
7. A. Downey. Predicting queue times on space-sharing parallel computers. In Proceedings of the 11th International Parallel, Processing Symposium, April 1997.
8. A. Downey. Using queue time predictions for processor allocation. In Proceedings of the 3rd Workshop on Job Scheduling Strategies for Parallel Processing, April 1997.
9. The Dror Feitelson's Parallel Workload Page, http://www.cs.huj1.ac.il/ labs/parallel/workload.
10. D. G. Feitelson and B. Nitzberg. Job characteristics of a production parallel scientific workload on the NASA Ames iPSC/860. Springer-Verlag, 1996.
11. D. G. Feitelson and L. Rudolph. Parallel Job Scheduling: Issues and Approaches. Springer-Verlag, 1995.
12. D. O. Feitelson and L. Rudolph. Towards Convergence in Job Schedulers for Parallel Supercomputers. Springer-Verlag, 1996.
13. I. Foster and C. Kesselman. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, Inc., 1998.
14. E. Frachtenberg, D. G. Feitelson, J. Fernandez, and F. Petrini. Parallel Job Scheduling Under Dynamic Workloads, Springer-Verlag, 2003.
15. C. Granger and P. Newbold. Forecasting Economic Time Series, Academic Press, 1986.
16. Gridengine home page - http://gridengine.sunsource.net/.
17. M. Harchol-Balter. The effect of heavy-tailed job size distributions on computer system design. In Proceedings of ASA-IMS Conference on Applications of Heavy Tailed Distributions in Economics, Engineering and Statistics, June 1999.
18. D.Lifka. The ANL/IBM SP scheduling system, volume 949. Springer-Verlag, 1995.
19. D. Lifka, M. Henderson, and K. Rayl. Users guide to the argonne SP scheduling system. Technical Report TM-201, Argonne National Laboratory, Mathematics and Computer Science Division, May 1995.
20. B. Lindgren. Statistical Theory. MacMillan, 3 edition, 1968.
21. Maui scheduler home page - http://www.clusterresources.com/products/maui/ .
22. D.Moore. The Basic Practice of Statistics. W.H. Freeman, 2 edition, 2000.
23. Cray NQE User's Guide - http://docs.cray.com/books/2148.3.3/html-2148.3. 3.
24. NSF TeraGridProject, http://www.teragrid.org/.
25. D. Nurmi, J. Brevik, and R. Wolski. Modeling machine availability in enterprise and wide-area distributed computing environments. In Proceedings of Europar 2005, August 2005.
26. D. Nurmi, R. Wolski, and J. Brevik. Model-based checkpoint scheduling for volatile resource environments. In Proceedings of Cluster 2005, September 2004.
27. The network weather service home page - http://www.cs.ucsb.edu.
28. Pbspro home page - http://www.altair.com/software/pbspro.htm.
29. W. Smith, V. E. Taylor, and I. T. Foster. Using run-time predictions to estimate queue wait times and improve scheduler performance. In IPPS/SPDP '99/JSSPP '99: Proceedings of the Job Scheduling Strategies for Parallel Processing, pages 202-219, London, UK, 1999. Springer-Verlag.
30. R. Wolski, N. Spring, and J. Hayes. The network weather service: A distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems, 15(5-6):757-768, October 1999.