Performance implications of periodic checkpointing on large-scale cluster systems

Proceedings - 19th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2005

Volumn 2005, Issue , 2005, Pages

  Oliner, A J ^a   Sahoo, R K ^b   Moreira, J E ^b   Gupta, M ^b  

^a USA   (United States)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

BLUEGENE/L; CHECKPOINT; LARGE-SCALE CLUSTER SYSTEMS; TOROIDAL INTERCONNECT ARCHITECTURE;

COMPUTER SIMULATION; COMPUTER SOFTWARE; COMPUTER SYSTEM RECOVERY; FAILURE ANALYSIS; PARAMETER ESTIMATION; SYSTEMS ANALYSIS;

LARGE SCALE SYSTEMS;

EID: 33746286070     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2005.337     Document Type: Conference Paper

References (23)

1. N. Adiga and et. al. An overview of the bluegene/1 super-computer. In Supercomputing (SC2002) Technical. Papers, November 2002.
2. S. Agarwal, R. Garg, M. S. Gupta, and J. E. Moreira. Adaptive incremental checkpointing for massively parallel systems. In ICS 2004, pages 277-286, 2004.
3. S. Albers and G. Schmidt. Scheduling with unexpected machine breakdowns. Discrete Applied Mathematics, 110(2-3):85-99, 2001.
4. M. F. Buckley and D. P. Siewiorek. Vax/vms event monitoring and analysis. In FTCS-25, Computing Digest of Papers, pages 414-423, June 1995.
5. M. F. Buckley and D. P. Siewiorek. Comparative analysis of event tupling schemes. In FTCS-26, Computing Digest of Papers, pages 294-303, June 1996.
6. D. Feitelson and M. A. Jette. Improved utilization and responsiveness with gang scheduling. In In IPPS 97 Workshop on Job Scheduling Strategies for Parallel Processing, volume 1291, April 1997.
7. D. G. Feitelson. Parallel workloads archive. http://cs.huji.ac.il/labs/parallel/workload/index.html, 2001.
8. H. Franke, J. Jann, J. E. Moreira, and P. Pattnaik. An evaluation of parallel job scheduling for asci blue-pacifi c. In Proc. of SC'99. Portland OR, IBM Research Report RC 21559, IBM TJ Watson Research Center, November 1999.
9. B. Gorda and R. Wolski. Time sharing massively parallel machines. In Proc. of ICPP'95. Portland OR, pages 214-217, August 1995.
10. E. Krevat, J. G. Castanos, and J. E. Moreira. Job scheduling for the bluegene/1 system. In JSSPP, pages 38-54, 2002.
11. I. Lee, R. K. Iyer, and D. Tang. Error/failure analysis using event logs from fault tolerant systems. In Proceedings 21st Intl. Symposium on Fault-Tolerant Computing, pages 10-17, June 1991.
12. Y. Liang, Y. Zhang, R. K. Sahoo, J. E. Moreira, and M. Gupta. Filtering failure logs for a bluegene/l prototype. In Intl Conf. on Dependable Systems and Networks (DSN-2005) (submitted), 2005.
13. A. J. Oliner, R. K. Sahoo, J. E. Moreira, M. Gupta, and A. Sivasubramaniam. Fault-aware job scheduling for bluegene/l systems. In IEEE IPDPS, Intl. Parallel and Distributed Processing Symposium, Apr. 2004.
14. J. S. Plank and W. R. Elwasif. Experimental assessment of workstation failures and their impact on checkpointing systems. In The 28th Intl. Symposium on Fault-tolerant Computing, June 1998.
15. J. S. Plank and M. G. Thomason. Processor allocation and checkpoint interval selection in cluster computing systems. Journal of Parallel and Distributed Computing, 61(11):1570-1590, November 2001.
16. X. Qin, H. Jiang, and D. R. Swanson. An efficient faulttolerant scheduling algorithm for real-time tasks with precedence constraints in heterogeneous systems. In Proceedings of the 30th. International Conference on Parallel Processing, pages 360-368, August 2002.
17. R. K. Sahoo, A. J. Oliner, I. Rish, M. Gupta, J. E. Moreira, S. Ma, R. Vilalta, and A. Sivasubramaniam. Critical event prediction for proactive management in large-scale computer clusters. In Proceedings of the ACM SIGKDD, Intl. Conf. on Knowledge Discovery and Data Mining, pages 426-435, August 2003.
18. R. K. Sahoo, A. Sivasubramanian, M. S. Squillante, and Y. Zhang. Failure data analysis of a large-scale heterogeneous server environment. In Proceedings of the Intl. Conf. on Dependable Systems and Networks (DSN), pages 772-781, June 2004.
19. S. Sankaran, J. M. Squyres, B. Barrett, A. Lumsdaine, J. Duell, P. Hargrove, and E. Roman. The LAM/MPI checkpoint/restart framework: System-initiated checkpointing. In Proceedings, LACSI Symposium, Sante Fe, New Mexico, USA, October 2003.
20. A. N. Tantawi and M. Ruschitzka. Performance analysis of checkpointing strategies. In ACM Transactions on Computer Systems, volume 110, pages 123-144, May 1984.
21. A. Uno, T. Aoyagi, and K. Tani. Job scheduling on the earth simulator. NEC Jl. of Research and Development, 44:47-52, January 2003.
22. R. Vilalta and S. Ma. Predicting rare events in temporal domains. In Proceedings IEEE Conf. on Data Mining (ICDM.02), pages 474-481, 2002.
23. Y. Zhang, M. S. Squillante, A. Sivasubramaniam, and R. K. Sahoo. Performance implications of failures in large-scale cluster scheduling. In 10th Workshop on JSSPP, SIGMETRICS, 2004.