Evaluation of a workflow scheduler using integrated performance modelling and batch queue wait time prediction

Proceedings of the 2006 ACM/IEEE Conference on Supercomputing, SC'06

Volumn , Issue , 2006, Pages

  Nurmi, Daniel ^a   Mandal, Anirban ^b   Brevik, John ^a   Koelbel, Chuck ^b   Wolski, Rich ^a   Kennedy, Ken ^b  

^a University of California

^b Rice University

Author keywords

[No Author keywords available]

Indexed keywords

BATCH QUEUE WAIT TIME PREDICTION; COMPUTATIONAL POWER; INTEGRATED PERFORMANCE MODELING; WORKFLOW SCHEDULER;

ALGORITHMS; COMPUTATIONAL METHODS; COMPUTER SOFTWARE; LARGE SCALE SYSTEMS; MATHEMATICAL MODELS; SUPERCOMPUTERS;

DISTRIBUTED COMPUTER SYSTEMS;

EID: 34548293317     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1188455.1188579     Document Type: Conference Paper

References (23)

1. BLYTHE, J., JAIN, S., DEELMAN, E., GIL, Y., VAHI, K., MANDAL, A., AND KENNEDY, K. 2005. Task Scheduling Strategies for Workflow-based Applications in Grids. In IEEE International Symposium on Cluster Computing and the Grid (CCGrid 2005), IEEE Press.
2. BREVIK, J., NURMI, D., AND WOLSKI, R. 2006. Predicting bounds on queuing delay for batch-scheduled parallel machines. In Proceedings of PPoPP 2006.
3. DEELMAN, E., BLYTHE, J., GIL, Y., KESSELMAN, C., MEHTA, G., PATIL, S., SU, M.-H., VAHI, K., AND LIVNY, M. 2004. Pegasus: Mapping scientific workflows onto the grid. In Proceedings of the 2nd European Across Grids Conference.
4. DOWNEY, A. 1997. Predicting queue times on spacesharing parallel computers. In Proceedings of the 11th International Parallel Processing Symposium.
5. DOWNEY, A. 1997. Using queue time predictions for processor allocation. In Proceedings of the 3rd Workshop on Job Scheduling Strategies for Parallel Processing.
6. GAREY, M. R., AND JOHNSON, D. S. 1979. Computers and Intractability: A Guide to the Theory of Np-Completeness.
7. KERBYSON, D. J., ALME, H. J., HOISIE, A., PETRINI, F., WASSERMAN, H. J., AND GITTINGS, M. 2001. Predictive performance and scalability modeling of a largescale application.
8. KWOK, Y.-K., AND AHMAD, I. 1999. Static scheduling algorithms for allocating directed task graphs to multiprocessors. ACM Computing Surveys 31, 4, 406-471.
9. LIFKA, D., HENDERSON, M., AND RAYL, K. 1995. Users guide to the argonne SP scheduling system. Tech. Rep. TM-201, Argonne National Laboratory, Mathematics and Computer Science Division, May.
10. LUDTKE, S., BALDWIN, P., AND CHIU, W. 1999. Eman: Semiautomated software for high-resolution single-particle reconstructions. J. Struct. Biol. 128, 82-97.
11. MANDAL, A., KENNEDY, K., KOELBEL, C., MARIN, G., MELLOR-CRUMMEY, J., LIU, B., AND JOHNSSON, L. 2005. Scheduling Strategies for Mapping Application Workflows onto the Grid. In 14-th IEEE Symposium on High Performance Distributed Computing (HPDC14), 125-134.
12. MARIN, G., AND MELLOR-CRUMMEY, J. 2004. Cross-architecture performance predictions for scientific applications using parameterized models. In Proceedings of Joint International Conference on Measurement and Modeling of Computer Systems - Sigmetrics 2004, 2-13.
13. NSF TeraGrid Project. http://www.teragrid.org/.
14. OH, H., AND HA, S. 1996. A static scheduling heuristic for heterogeneous processors. In Euro-Par, Vol. II, 573-577.
15. PLLANA, S., AND FAHRINGER, T. 2005. Performance prophet: A performance modeling and prediction tool for parallel and distributed programs. In Proceedings of The 2005 International Conference on Parallel Processing (ICPP-05).
16. SIH, G., AND LEE, E. 1993. A compile-time scheduling heuristic for interconnection-constrained heterogeneous processor architecture. IEEE Transactions on Parallel and Distributed Systems 4, 2, 175-186.
17. SMITH, W., TAYLOR, V. E., AND FOSTER, I. T. 1999. Using run-time predictions to estimate queue wait times and improve scheduler performance. In IPPS/SPDP '99/JSSPP '99: Proceedings of the Job Scheduling Strategies for Parallel Processing, Springer-Verlag, London, UK, 202-219.
18. SUNDARAM-STUKEL, D., AND VERNON, M. K. 1999. Predictive analysis of a wavefront application using LogGP. ACM SIGPLAN Notices 34, 8, 141-150.
19. TAYLOR, V., WU, X., AND STEVENS, R. 2003. Prophesy: an infrastructure for performance analysis and modeling of parallel and grid applications. SIGMETRICS Perform. Eval. Rev. 30, 4, 13-18.
20. TOPCUOGLU, H., HARIRI, S., AND WU, M.-Y. 2002. Performance-effective and low-complexity task scheduling for heterogeneous computing. IEEE Transactions on Parallel and Distributed Systems 13, 3, 260-274.
21. TRACY D. BRAUN ET AL. 2001. A comparison of eleven static heuristics for maping a class of independent tasks onto heterogeneous distributed computing systems. Journal of Parallel and Distributed Computing 61, 810-837.
22. WOLSKI, R., SPRING, N., AND HAYES, J. 1999. The network weather service: A distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems 15, 5-6 (October), 757-768.
23. WOLSKI, R., SPRING, N., AND HAYES, J. 1999. Predicting the cpu availability of time-shared unix systems on the computational grid. In Proceedings 8th IEEE Symp. on High Performance Distributed Computing.