Scheduling batch and heterogeneous jobs with runtime elasticity in a parallel processing environment

Proceedings of the 2012 IEEE 26th International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2012

Volumn , Issue , 2012, Pages 65-78

  Kumar, Dinesh ^a   Shae, Zon Yin ^a   Jamjoom, Hani ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

cloud computing; high performance computing; runtime elasticity; scheduling

Indexed keywords

BATCH JOBS; EXTENSIVE SIMULATIONS; GRIDSIM; HIGH PERFORMANCE COMPUTING; NOVEL SCHEDULING ALGORITHMS; PARALLEL PROCESSING; RESOURCE REQUIREMENTS; RUNTIMES; SUBMISSION TIME; WORK-LOAD MODELS;

CLOUD COMPUTING; DISTRIBUTED PARAMETER NETWORKS; ELASTICITY; SCHEDULING;

SCHEDULING ALGORITHMS;

EID: 84867435908     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2012.10     Document Type: Conference Paper

References (22)

1. Buyya, R.: High Performance Cluster Computing: Architectures and Systems. Prentice Hall PTR, Upper Saddle River, NJ, USA (1999)
2. Feitelson, D.: Job scheduling in multiprogrammed parallel systems. In: RC 19790 IBM. (1997)
3. Krakowiak, S.: Priciples of Operating Systems. MIT Press (1988)
4. Devarakonda, M.V., Iyer, R.K.: Predictability of process resource usage: a measurement based study on unix. In: IEEE Trans. Software Eng. (DEC 1989) 1579-1586
5. Krueger, P., Lai, T.H., Dixit-Radiya, V.A.: Job acheduling is more important than processor allocation for hypercube computers. In: IEEE Trans. Parallel and Distributed Syst. (MAY 1994) 488-497
6. Mu'alem, A., Feitelson, D.: Utilization, predictability, workloads, and user runtime estimates in scheduling the ibm sp2 with backfilling. In: IEEE J. Parallel and Distributed Comput. (NOV 2001) 529-543
7. Shmueli, E., Feitelson, D.: Backfilling with lookahead to optimize the packing of parallel jobs. In: IEEE J. Parallel and Distributed Comput. (SEP 2005) 1090-1107
8. Krevat, E., Castanos, J.G., Moreira, J.E.: Job scheduling for the bluegene/l system. In: Euro-Par. (2002) 207-211
9. Sarkar, V.: Determining avearage program execution times and their variance. In: Proc. SIGPLAN Conf. Prog. lang. Design and implementation. (JUN 1989) 298-312
10. Majumdar, S., Eager, D., Bunt, R.: Scheduling in multiprogrammed parallel systems. In: SIGMETRICS Conf Measurement and Modeling of Comput. Syst. (May 1988) 104-113
11. Li, K., Cheng, K.H.: Job scheduling in a partitionable mesh using a two-dimensional buddy system partitioning scheme. In: IEEE Trans. Parallel and Distributed System. (OCT 1991) 413-422
12. Coffman, E.G., Garey, J.M.R., Johson, D.S.: Performance bounds for level-oriented two-dimensioanl packing algoritthms. In: SIAM J. Comput. (NOV 1980) 808-826
13. Krueger, P., Lai, T.H., Radiya, V.: processor allocation vs. job scheduling on hypercube computers. In: iith Intl. Conf. Distributed Comput. Syst. (MAY 1991) 394-401
14. Skovira, J., Chen, W., Zhou, H.: The easy-loadleveler api project. In: IPPS'96 Workshop on Job Scheduling Strategies for Parallel Processing, Volume 1162 of Lecture Notes in Computer Science, Springer-Verlag. (APR 1996) 41-47
15. Zhang, Y., Franke, H., Moreira, J.: The impact of migration on parallel job scheduling for distributed systems. In: 6th Euro-Par. (AUG 2000) 242-251
16. Netto, M., Bubendorfer, K., Buyya, R.: Sla-based advance reservations with flexible and adaptive time qos parameters. In: Proceedings of the International Conference on Service oriented Computing (ICSOC'07). (2007) 119-131
17. Lublin, U., Feitelson, D.: The workload on parallel supercomputers: modeling the characteristics of grid jobs. In: IEEE J. Parallel and Distributed Comput. (NOV 2003) 1105-1122
18. Buyya, R., Garg, S.K.: Gridsim: A grid simulation toolkit for resource modeling and application scheduling for parallel and distributed computing. In: http://www.cloudbus.org/gridsim/
19. Carlos Sosa, B.K.: Ibm system bluegene solution: Bluegene/p application development. In: http://www.redbooks.ibm.com/redbooks/pdfs/sg247287.pdf
20. Dalibor Klusáček, H.R.: Alea 2 - job scheduling simulator. In: Proceedings of the 3rd International ICST Conference on Simulation Tools and Techniques (SIMUTools 2010), ICST (2010)
21. Chapin, S.J., Cirne, W., Feitelson, D.G., Jones, J.P., Leutenegger, S.T., Schwiegelshohn, U., Smith,W., Talby, D.: Benchmarks and standards for the evaluation of parallel job schedulers. In: Job Scheduling Strategies for Parallel Processing, D. G. Feitelson and L. Rudolph (Eds.), Lect. Notes Comput. Sci. vol. 1659, Springer-Verlag. (1999) 66-89
22. Feitelson, D.: Parallel workloads archive. In: http://www.cs.huji.ac.il/ labs/parallel/workload/