Checkpointing strategies for parallel jobs

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Bougeret, Marin ^a   Casanova, Henri ^b   Rabie, Mikael ^a   Robert, Yves ^a   Vivien, Frédéric ^c  

^a UNIVERSITÉ DE LYON   (France)

^b UNIVERSITY OF HAWAII   (United States)

^c INRIA   (France)

Author keywords

Checkpointing; Fault tolerance; Parallel job; Sequential job

Indexed keywords

CHECK POINTING; DYNAMIC PROGRAMMING ALGORITHM; EXPECTED EXECUTION TIME; EXTENSIVE SIMULATIONS; INTER-ARRIVAL TIME; JOB EXECUTION; JOB PARALLELISM; OPTIMAL SOLUTIONS; PARALLEL JOB; PARALLEL JOBS; PERIODIC CHECKPOINTING; PROCESSOR FAILURES; REAL-WORLD SYSTEM; SEQUENTIAL JOB; SIMULATION EXPERIMENTS; WEIBULL;

CLUSTERING ALGORITHMS; COMPUTER SOFTWARE SELECTION AND EVALUATION; EXPERIMENTS; FAULT TOLERANCE; OPTIMIZATION; WEIBULL DISTRIBUTION;

DYNAMIC PROGRAMMING;

EID: 83155184556     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063428     Document Type: Conference Paper

References (31)

1. G. Amdahl. The validity of the single processor approach to achieving large scale computing capabilities. In AFIPS Conference Proceedings, volume 30, pages 483-485. AFIPS Press, 1967.
2. L. Bautista Gomez, A. Nukada, N. Maruyama, F. Cappello, and S. Matsuoka. Transparent low-overhead checkpoint for GPU-accelerated clusters. https://wiki.ncsa.illinois.edu/download/attachments/17630761/ INRIA-UIUC-WS4-lbautista.pdf?version=1&modificationDate=1290470402000.
3. L. S. Blackford, J. Choi, A. Cleary, E. D'Azevedo, J. Demmel, I. Dhillon, J. Dongarra, S. Hammarling, G. Henry, A. Petitet, K. Stanley, D. Walker, and R. C. Whaley. ScaLAPACK Users'Guide. SIAM, 1997.
4. A. Bland, R. Kendall, D. Kothe, J. Rogers, and G. Shipman. Jaguar: The World's Most Powerful Computer. In GUC'2009, 2009.
5. M. Bougeret, H. Casanova, M. Rabie, Y. Robert, and F. Vivien. Checkpointing strategies for parallel jobs. Research Report 7520, INRIA, France, Jan. 2011. Available at http://graal.ens-lyon.fr/~fvivien/.
6. M.-S. Bouguerra, T. Gautier, D. Trystram, and J.-M. Vincent. A exible checkpoint/restart model in distributed systems. In PPAM, volume 6067 of LNCS, pages 206-215, 2010.
7. M. S. Bouguerra, D. Trystram, and F. Wagner. An optimal algorithm for scheduling checkpoints with variable costs. Technical report, INRIA, Oct. 2010.
8. F. Cappello, H. Casanova, and Y. Robert. Checkpointing vs. migration for post-petascale supercomputers. In ICPP'2010. IEEE Computer Society Press, 2010.
9. V. Castelli, R. E. Harper, P. Heidelberger, S. W. Hunter, K. S. Trivedi, K. Vaidyanathan, and W. P. Zeggert. Proactive management of software aging. IBM J. Res. Dev., 45(2):311-332, 2001. (Pubitemid 32736915)
10. J. T. Daly. A higher order estimate of the optimum checkpoint interval for restart dumps. Future Generation Computer Systems, 22(3):303-312, 2004. (Pubitemid 41689812)
11. J. Dongarra, P. Beckman, P. Aerts, F. Cappello, T. Lippert, S. Matsuoka, P. Messina, T. Moore, R. Stevens, A. Trefethen, and M. Valero. The international exascale software project: a call to cooperative action by the global high-performance community. Int. J. High Perform. Comput. Appl., 23(4):309-322, 2009.
12. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Computing Survey, 34:375-408, 2002.
13. T. Heath, R. P. Martin, and T. D. Nguyen. Improving cluster availability using workstation validation. SIGMETRICS Perf. Eval. Rev., 30(1):217-227, 2002. (Pubitemid 35009524)
14. J. Ho, C. Wang, and F. Lau. Scalable group-based checkpoint/restart for large-scale message-passing systems. In Parallel and Distributed Processing, 2008. IPDPS 2008. IEEE International Symposium on, pages 1-12. IEEE, 2008.
15. W. Jones, J. Daly, and N. DeBardeleben. Impact of sub-optimal checkpoint intervals on application efficiency in computational clusters. In HPDC'10, pages 276-279. ACM, 2010.
16. N. Kolettis and N. D. Fulton. Software rejuvenation: Analysis, module and applications. In FTCS'95, page 381, Washington, DC, USA, 1995. IEEE CS.
17. D. Kondo, B. Javadi, A. Iosup, and D. Epema. The failure trace archive: Enabling comparative analysis of failures in diverse distributed systems. Cluster Computing and the Grid, IEEE International Symposium on, 0:398-407, 2010.
18. P. L'Ecuyer and J. Malenfant. Computing optimal checkpointing strategies for rollback and recovery systems. IEEE Transactions on computers, 37(4):491-496, 2002.
19. Y. Ling, J. Mi, and X. Lin. A variational calculus approach to optimal checkpoint placement. IEEE Transactions on computers, pages 699-708, 2001. (Pubitemid 32720123)
20. Y. Liu, R. Nassar, C. Leangsuksun, N. Naksinehaboon, M. Paun, and S. Scott. An optimal checkpoint/restart model for a large scale high performance computing system. In IPDPS 2008, pages 1-9. IEEE, 2008.
21. E. Meneses. Clustering Parallel Applications to Enhance Message Logging Protocols. https://wiki.ncsa.illinois.edu/download/attachments/17630761/INRIA- UIUC-WS4-emenese.pdf?version=1&modificationDate=1290466786000.
22. A. Moody, G. Bronevetsky, K. Mohror, and B. R. d. Supinski. Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System. In Proceedings of the ACM/IEEE SC Conference, pages 1-11, 2010.
23. T. Ozaki, T. Dohi, H. Okamura, and N. Kaio. Distribution-free checkpoint placement algorithms based on min-max principle. IEEE TDSC, pages 130-140, 2006.
24. M. L. Puterman. Markov Decision Processes: Discrete Stochastic Dynamic Programming. Wiley, 2005.
25. V. Sarkar and others. Exascale software study: Software challenges in extreme scale systems, 2009. White paper available at: http://users.ece.gatech. edu/mrichard/ExascaleComputingStudyReports/ECSS%20report%20101909.pdf.
26. B. Schroeder and G. A. Gibson. A large-scale study of failures in high-performance computing systems. In Proc. of DSN, pages 249-258, 2006. (Pubitemid 44930426)
27. A. Tantawi and M. Ruschitzka. Performance analysis of checkpointing strategies. ACM TOCS, 2(2):123-144, 1984.
28. S. Toueg and O. Babaoglu. On the optimum checkpoint selection problem. SIAM J. Computing, 13(3):630-649, 1984.
29. K. Venkatesh. Analysis of Dependencies of Checkpoint Cost and Checkpoint Interval of Fault Tolerant MPI Applications. Analysis, 2(08):2690-2697, 2010.
30. L. Wang, P. Karthik, Z. Kalbarczyk, R. Iyer, L. Votta, C. Vick, and A. Wood. Modeling Coordinated Checkpointing for Large-Scale Supercomputers. In Proc. of the International Conference on Dependable Systems and Networks, pages 812-821, June 2005. (Pubitemid 41538294)
31. J. W. Young. A first order approximation to the optimum checkpoint interval. Communications of the ACM, 17(9):530-531, 1974.