Cooperative checkpointing: A robust approach to large-scale systems reliability

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2006, Pages 14-23

  Oliner, Adam J ^a   Rudolph, Larry ^b   Sahoo, Ramendra K ^c  

^a Stanford University   (United States)

^b MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^c IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Cooperative checkpointing; High performance computing; Parallel computing; RAS; Simulations; Supercomputing

Indexed keywords

COMPUTER SIMULATION; COMPUTER SYSTEM RECOVERY; LARGE SCALE SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); SCHEDULING;

COOPERATIVE CHECKPOINTING; HIGH-PERFORMANCE COMPUTING; SUPERCOMPUTING;

RELIABILITY;

EID: 34547424386     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1183401.1183406     Document Type: Conference Paper

References (24)

1. N. Adiga and T. B. Team. An overview of the bluegene/1 supercomputer. In Supercomputing, Technical Papers, Nov. 2002.
2. S. Agarwal, R. Garg, M. S. Gupta, and J. E. Moreira. Adaptive incremental checkpointing for massively parallel systems. In Proceedings of the Intl. Conf. on Supercomputing (ICS), pages 277-286, 2004.
3. S.-E. Choi and S. J. Deitz. Compiler support for automatic checkpointing. In 16th Annual International Symposium on High Performance Computing Systems and Applications, 2002.
4. T. Dietterich and R. Michalski. Discovering patterns in sequence of events. In Artificial Intelligence, volume 25, pages 187-232, 1985.
5. E. N. Elnozahy, D. B. Johnson, and W. Zwaenepoel. The performance of consistent checkpointing. In 11th Symposium on Reliable Distributed Systems, Houston, TX, Oct. 1992.
6. E. N. Elnozahy and J. S. Plank. Checkpointing for peta-scale systems: A look into the future of practical rollback-recovery. IEEE Trans. Dependable Secur. Comput., 1(2):97-108, 2004.
7. D. G. Feitelson. Parallel workloads archive. URL: http://cs.huji.ac.il/ labs/parallel/workload/, 2001.
8. R. K. Jain. The Art of Computer Systems Performance Analysis: Techniques for Experimental Design, Measurement, Simulation, and Modeling. Wiley-Interscience, New York, 1991.
9. I. Lee, R. K. Iyer, and D. Tang. Error/failure analysis using event logs from fault tolerant systems. In Proceedings of the 21st Intl. Symposium on Fault-Tolerant Computing, pages 10-17, June 1991.
10. Y. Liang, Y. Zhang, M. Jette, A. Sivasubramaniam, and R. K. Sahoo. Blue gene/l failure analysis and prediction models. In Proceedings of the Intl. Conf. on Dependable Systems and Networks (DSN), 2006.
11. Y. Liang, Y. Zhang, A. Sivasubramaniam, R. K. Sahoo, J. Moreira, and M. Gupta. Filtering failure logs for a bluegene/l prototype. In Proceedings of the Intl. Conf. on Dependable Systems and Networks (DSN), June 2005.
12. A. N. Norman, S.-E. Choi, and C. Lin. Compiler-generated staggered checkpointing. In Proceedings of the 7th workshop on Workshop on languages, compilers, and run-time support for scalable systems (LCR), pages 1-8, New York, NY, USA, 2004. ACM Press.
13. A. J. Oliner. Cooperative checkpointing for supercomputing systems. Master's thesis, Massachusetts Institute of Technology, 2005.
14. A. J. Oliner, L. Rudolph, and R. K. Sahoo. Cooperative checkpointing theory. In Proceedings of IPDPS, Intl. Parallel and Distributed Processing Symposium, 2006.
15. A. J. Oliner, L. Rudolph, R. K. Sahoo, J. Moreira, and M. Gupta. Probabilistic qos guarantees for supercomputing systems. In Proceedings of the Intl. Conf. on Dependable Systems and Networks (DSN), June 2005.
16. A. J. Oliner and R. K. Sahoo. Evaluating cooperative checkpointing for supercomputing systems. In IEEE IPDPS, Workshop on System Management Tools for Large-scale Parallel Systems, Apr. 2006.
17. A. J. Oliner, R. K. Sahoo, J. E. Moreira, and M. Gupta. Performance implications of periodic checkpointing on large-scale cluster systems. In IEEE IPDPS, Workshop on System Management Tools for Large-scale Parallel Systems, Apr. 2005.
18. J. S. Plank and W. R. Elwasif. Experimental
19. assessment of workstation failures and their impact on checkpointing systems. In Proceedings of the 28th Intl. Symposium on Fault-tolerant Computing, June 1998.
20. J. S. Plank and M. G. Thomason. Processor allocation and checkpoint interval selection in cluster computing systems. Journal of Parallel and Distributed Computing, 61(11):1570-1590, November 2001.
21. R. K. Sahoo, A. J. Oliner, I. Rish, M. Gupta, J. E. Moreira, S. Ma, R. Vilalta, and A. Sivasubramaniam. Critical event prediction for proactive management in large-scale computer clusters. In Proceedings of the ACM SIGKDD, Intl. Conf. on Knowledge Discovery and Data Mining, pages 426-435, August 2003.
22. M. Schultz, G. Bronevetsky, R. Fernandes, D. Marques, K. Pingali, and P. Stodghill. Implementation and evaluation of a scalable application-level checkpoint-recovery scheme for mpi programs. In Supercomputing, 2004.
23. A. N. Tantawi and M. Ruschitzka. Performance analysis of checkpointing strategies. In ACM Transactions on Computer Systems, volume 110, pages 123-144, May 1984.
24. J. W. Young. A first order approximation to the optimum checkpoint interval. Commun. ACM, 17(9):530-531, 1974.