Performance implications of failures in large-scale cluster scheduling

Lecture Notes in Computer Science

Volumn 3277, Issue , 2005, Pages 233-252

  Zhang, Yanyong ^a   Squillante, Mark S ^b   Sivasubramaniam, Anand ^c   Sahoo, Ramendra K ^b  

^a RUTGERS UNIVERSITY   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

^c PENNSYLVANIA STATE UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER SYSTEM RECOVERY; INFORMATION RETRIEVAL; JOB ANALYSIS; LARGE SCALE SYSTEMS; PARALLEL PROCESSING SYSTEMS; PROBLEM SOLVING;

COMPUTING ENGINES; LARGE-SCALE PARALLEL SYSTEMS; PERFORMANCE ANALYSIS; SCHEDULING POLICIES;

SCHEDULING;

EID: 23944448107     PISSN: 03029743     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1007/11407522_13     Document Type: Conference Paper

References (44)

1. S. Albers and G. Schmidt. Scheduling with unexpected machine breakdowns. Discrete Applied Mathematics, 110(2-3):85-99, 2001.
2. S. M. andD. Andrews. On the reliability of the ibm mvs/xa operating system. In IEEE Trans. Software Engineering, volume October, 1987.
3. M. Arlitt and T. Jin. Workload Characterization of the 1998 World Cup E-Commerce Site. Technical Report Technical Report HPL-1999-62, HP, May 1999.
4. J. L. Bruno and E. G. Coffman. Optimal Fault-Tolerant Computing on Multiprocess Systems. Acta Informatica, 34:881-904, 1997.
5. M. F. Buckley and D. P. Siewiorek. Vax/vms event monitoring and analysis. In FTCS-25, Computing Digest of Papers, pages 414-423, June 1995.
6. M. F. Buckley and D. P. Siewiorek. Comparative analysis of event tupling schemes. In FTCS-26, Computing Digest of Papers, pages 294-303, June 1996.
7. X. Castillo and D. P. Siewiorek. A workload dependent software reliability prediction model. In Proc. 12th. Intl. Symp. Fault-Tolerant Computing, pages 279-286, June 1982.
8. D. Feitelson. A survey of scheduling in multiprogrammed parallel systems. IBM Research Technical Report, RC 19790, 1994.
9. K. Flautner, N. Kim, S. Martin, D. Blaauw, and T. Mudge. Drowsy Caches: Simple Techniques for Reducing Leakage Power. In Proceedings of the International Symposium on Computer Architecture (ISCA), pages 148-157, 2002.
10. H. Franke, J. Jann, J. E. Moreira, and P. Pattnaik. An evaluation of parallel job scheduling for asci blue-pacific. In Proc. of SC'99. Portland OR, IBM Research Report RC 21559, IBM TJ Watson Research Center, November 1999.
11. H. Franke, J. Jann, J. E. Moreira, P. Pattnaik, and M. A. Jette. Evaluation of Parallel Job Scheduling for ASCI Blue-Pacific. In Proceedings of Supercomputing, November 1999.
12. B. Gorda and R. Wolski. Time sharing massively parallel machines. In Proc. of ICPP'95. Portland OR, pages 214-217, August 1995.
13. T. Heath, R. P. Martin, and T. D. Nguyen. Improving cluster availability using workstation validation. In Proceedings of the ACM SIGMETRICS 2002 Conference on Measurement and Modeling of Computer Systems, pages 217-227, 2002.
14. M. C. Hsueh, R. K. Iyer, and K. S. Trivedi. A measurement-based performability model for a multiprocessor system. In Computer Performance and Reliability, pages 337-352, 1987.
15. R. K. Iyer and D. J. Rossetti. Effect of system workload on operating system reliability: A study on ibm 3081. In IEEE Trans. Software Engineering, volume SE-11, pages 1438-1448, 1985.
16. B. Kalyanasundaram and K. R. Pruhs. Fault-tolerant scheduling. In 26th Annual ACM Symposium on Theory of Computing, pages 115-124, 1994.
17. S. Kartik and C. S. R. Murthy. Task allocation algorithms for maximizing reliability of distributed computing systems. In IEEE Transactions on Computer Systems, volume 46, pages 719-724, 1997.
18. E. Krevat, J. G. Castanos, and J. E. Moreira. Job scheduling for the bluegene/l system. In JSPP, 2003.
19. I. Lee and R. K. Iyer. Analysis of software halts in tandem system. In Proceedings 3rd Intl. Software Reliability Engineering, pages 227-236, October 1992.
20. T. Y. Lin and D. P. Siewiorek. Error log analysis: Statistical modelling and heuristic trend analysis. IEEE Trans. on Reliability, 39(4):419-432, October 1990.
21. Y. Ling, J. Mi, and X. Lin. A Variational Calculus Approach to Optimal Checkpoint Placement. IEEE Transactions on Computer Systems, 50(7): 699-708, July 2001.
22. G. M. Lohman and J. A. Muckstadt. Optimal Policy for Batch Operations: Backup, Checkpointing, Reorganization, and Updating. ACM Transactions on Database Systems, 2(3):209-222, 1977.
23. M. Lyu and V. Mendiratta. Software Fault Tolerance in a Clustered Architecture: Techniques and Reliability Modeling. In Proceedings 1999 IEEE Aerospace Conference, pages 141 -150, 1999.
24. J. Meyer and L. Wei. Analysis of workload influence on dependability. In Proceedings of the International Symposium on Fault-Tolerant Computing, pages 84-89, 1988.
25. S. Mukherjee, C. Weaver, J. Emer, S. Reinhardt, and T. Austin. A Systematic Methodology to Compute the Architectural Vulnerabilityi Factors for a High-Performance Microprocessor. In Proceedings of the International Symposium on Microarchitecture (MICRO), pages 29-40, 2003.
26. J. S. Plank and M. G. Thomason. Processor allocation and checkpoint interval selection in cluster computing systems. Journal of Parallel and Distributed Computing, 61(11):1570-1590, November 2001.
27. X. Qin, H. Jiang, and D. R. Swanson. An efficient fault-tolerant scheduling algorithm for real-time tasks with precedence constraints in heterogeneous systems, citeseer.nj.nec.com/qin02efficient.html.
28. R. Sahoo, A. Sivasubramaniam, M. Squillante, and Y. Zhang. Failure Data Analysis of a Large-Scale Heterogeneous Server Environment. In Proceedings of the 2004 International Conference on Dependable Systems and Networks, pages 389-398, 2004, to appear.
29. R. K. Sahoo, A. J. Oliner, I. Rish, M. Gupta, J. E. Moreira, S. Ma, R. Vilalta, and A. Sivasubramaniam. Critical event prediction for proactive management in large-scale computer clusters. In KDD, pages 426-435, August 2003.
30. S. M. Shaltz, J. P. Wang, and M. Goto. Task allocation for maximizing reliability of distributed computer systems. In IEEE Transactions on Computer Systems, volume 41, pages 1156-1168, 1992.
31. P. Shivakumar, M. Kistler, S. Keckler, D. Burger, and L. Alvisi. Modeling the effect of technology trends on soft error rate of combinational logic. In Proceedings of the 2002 International Conference on Dependable Systems and Networks, pages 389-398, 2002.
32. M. S. Squillante. Matrix-Analytic Methods in Stochastic Parallel-Server Scheduling Models. Advances in Matrix-Analytic Methods for Stochastic Models, Notable Publications, 1998.
33. M. S. Squillante, F. Wang, and M. Papaefthymiou. Stochastic Analysis of Gang Scheduling in Parallel and Distributed Systems. Technical Report, IBM Research Division, 1996.
34. M. S. Squillante, Y. Zhang, A. Sivasubramanian, N. Gautam, J. E. Moreira, and H. Franke. Modeling and analysis of dynamic coscheduling in parallel and distributed environments. Performance Evaluation Review, 30(1):43-54, June 2002.
35. M. Sullivan and R. Chillarege. Software Defects and Their Impact on System Availability - A Study of Field Failures in Operating Systems. In Proceedings of The 21st International Symposium on Fault Tolerant Computer Systems (FTCS), pages 2-9, 1991.
36. D. Tang and R. K. Iyer. Impact of correlated failures on dependability in a vaxcluster system. In IFIP Working Conference on Dependable Computing for Critical Applications, 1991.
37. D. Tang, R. K. Iyer, and S. S. Subramani. Failure analysis and modelling of a vaxcluster system. In Proceedings 20th. Intl. Symposium on Fault-tolerant Computing, pages 244-251, 1990.
38. K. Vaidyanathan, R. E. Harper, S. W. Hunter, and K. S. Trivedi. Analysis and Implementation of Software Rejuvenation in Cluster Systems. In Proceedings of the ACM SIGMETRICS 2001 Conference on Measurement and Modeling of Computer Systems, pages 62-71, June 2001.
39. K. Vaidyanathan, R. E. Harper, S. W. Hunter, and K. S. Trivedi. Analysis and implementation of software rejuvenation in cluster systems. In SIGMETRICS 2001, pages 62-71, 2001.
40. J. Xu, Z. Kallbarczyk, and R. K. Iyer. Networked windows nt system field failure data analysis. Technical Report CRHC 9808 University of Illinois at Urbana- Champaign, 1999.
41. J. Zeigler. Terrestrial Cosmic Rays. IBM Journal of Research and Development, 40(1):19-39, January 1996.
42. Y. Zhang, H. Franke, J. Moreira, and A. Sivasubramaniam. The Impact of Migration on Parallel Job Scheduling for Distributed Systems. In Proceedings of 6th International EuroPar Conference Lecture Notes in Computer Science 1900, pages 245-251, Aug/Sep 2000.
43. Y. Zhang, H. Franke, J. Moreira, and A. Sivasubramaniam. Improving parallel job scheduling by combining gang scheduling and backfilling techniques. In Proceedings of the International Parallel and Distributed Processing Symposium, pages 133-142, May 2000.
44. Y. Zhang, H. Franke, J. Moreira, and A. Sivasubramaniam. An integrated approach to parallel scheduling using gang- scheduling backfilling and migration. IEEE Transactions on Parallel and Distributed Systems, 14(3):236-247, March 2003.