Adaptive incremental checkpointing for massively parallel systems

Proceedings of the International Conference on Supercomputing

Volumn , Issue , 2004, Pages 277-286

  Agarwal, Saurabh ^a   Garg, Rahul ^a   Gupta, Meeta S ^a   Moreira, Jose E ^a,b  

^a IBM RESEARCH INDIA   (India)

^b IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Fault Tolerance; Incremental Checkpoint; Large Scale Systems; Probabilistic Checkpoint

Indexed keywords

ADAPTIVE ALGORITHMS; BENCHMARKING; COMPUTER HARDWARE; COMPUTER OPERATING SYSTEMS; LARGE SCALE SYSTEMS; MATHEMATICAL MODELS; PROBABILISTIC LOGICS;

FAULT-TOLERANCE; INCREMENTAL CHECKPOINT; PROBABILISTIC CHECKPOINT;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 8344232253     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1006209.1006248     Document Type: Conference Paper

References (32)

1. N. H. Vaidya, "Impact of checkpoint latency on overhead ratio of a checkpointing scheme," IEEE Transactions on Computers, vol. 46, Aug. 1997.
2. J. S. Plank and W. R. Elwasif, "Experimental assesment of workstation failures and their impact on checkpointing systems," in 28th International Symposium on Fault-Tolerant Computing, June 1998.
3. J. S. Plank, J. Xu, and R. H. Netzer, "Compressed differences: An algorithm for fast incremental checkpointing," Tech. Rep. CS-95-302, University of Tennessee at Knoxville, Aug. 1995.
4. K. Li, J. F. Naughton, and J. S. Plank, "Low-latency, concurrent checkpointing for parallel programs," IEEE Transactions on Parallel and Distributed Systems, vol. 5, Aug. 1994.
5. M. Litzkow, T. Tannenbaum, J. Basney, and M. Livny, "Checkpoint and migration of UNIX processes in the Condor distributed processing system," Tech. Rep. UW-CS-TR-1346, University of Wisconsin - Madison Computer Sciences Department, April 1997.
6. Princeton University Scalable I/O Research, "A checkpointing library for Intel Paragon." http://www.cs.princeton.edu/sio/CLIP/.
7. J. S. Plank, M. Beck, G. Kingsley, and K. Li, "Libckpt: Transparent checkpointing under Unix," in Usenix Winter Technical Conference, pp. 213-223, Jan. 1995.
8. M. Elnozahy, L. Alvisi, Y. Wang, and D. Johnson, "A survey of rollback-recovery protocols in message passing systems," Tech. Rep. CMU-CS-96-181, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA, Oct. 1996.
9. Y. Chen, J. S. Plank, and K. Li, "CLIP: A checkpointing tool for message-passing parallel programs," in SC97: In Proceedings of the Supercomputing, Nov. 1997.
10. A. Beguelin, E. Seligman, and P. Stephan., "Application level fault tolerance in heterogeneus networks of workstations.," Journal of Parallel and Distributed Computing, vol. 43, pp. 147-155, May 1997.
11. D. Pei, D. Wang, and Y. Zhang, "Quasi-asynchronous migration: A novel migration protocol for PVM tasks," ACM Operating Systems Review, vol. 33, Apr. 1999.
12. G. Bronevetsky, D. Marques, K. Pingali, and P. Stodghill, "Automated application-level checkpointing of mpi programs.," in In Principles and Practice of Parallel Programming, June 2003.
13. C. J. Li and W. K. Fuch, "CATCH - Compiler assisted techniques for checkpointing.," in In Proceedings of the Internationnal Symposium on Fault Tolerant Computing, June 1990.
14. A. Agbaria and J. S. Plank, "Design, implementation, and performance of checkpointing in netsolve.," in In Proceedings of the International Conference on Dependable Systems and Networks., June 2000.
15. J. S. Plank, Y. Kim, and J. J. Dongarra, "Diskless checkpointing," IEEE Transactions on Parallel and Distributed Systems, vol. 9, pp. 972-986, Oct. 1998.
16. J. S. Plank and K. Li., "ickp: A consistent checkpointer for multicomputers.," IEEE Parallel and Distributed Technologies, vol, 2, pp. 62-67, June 1994.
17. J. Pruyne and M. Livny, "Managing checkpoints for parallel programs.," in In Proceedings of the IPPS Second Workshop on Job Scheduling Strategies for Parallel Processing, Apr. 1996.
18. E. Pinheiro, "Truly-transparent checkpointing of parallel applications." http://www.cs.rutgers.edu/edpin/epckpt/paper_html/.
19. S. Sankaran, J. Squyres, B. Barren, A. Lumsdaine, J. Duell, P. Hargrove, and E. Roman, "The design and implementation of Berkeley lab's Linux checkpoint/restart," in Los Alamos Computer Science Institute (LACSI) Symposium, Oct. 2003.
20. H. Zhong and J. Nieh, "CRAK: Linux checkpoint/restart as a kernel module," Tech. Rep. CUCS-014-01, Department of Computer Science, Columbia University, Nov. 2001.
21. M. Prvulovic, Z. Zhang, and J. Torrellas, "Revive: Cost-effective architectural support for rollback recovery in shared-memory multiprocessors.," in In Proceedings of the International Symposium on Computer Architecture, May 2002.
22. D. J. Sorin, M. K. Martin, M. D. Hill, and D. A.Wood, "Safetynet: Improving the availability of shared memory multiprocessors with global checkpoint/recovery," in In Proceedings of the International Symposium on Computer Architecture, May 2002.
23. J. C. Sancho, F. Petrini, G. Johnson, J. Fernandez, and E. Frachtenberg, "On the feasibility of incremental checkpointing for scientific computing," in International Parallel and Distributed Processing Symposium, (Santa Fe, NM, USA), April 2004.
24. H. Nam, J. Kim, S. J. Hong, and S. Lee, "Probabilistic checkpointing," IEICE Transactions, Information and Systems, vol. E85-D, July 2002.
25. E. Elnozahy, "How safe is probabilistic checkpointing," in Twenty Eight Annual International Symposium on Fault-Tolerant Computing, pp. 358-363, 1998.
26. H. Nam, J. Kim, S. J. Hong, and S. Lee, "A secure checkpointing system," Journal of Systems Architecture, vol. 48, pp. 237-254, 2003.
27. A. J. Menezes, P. C. Oorschot, and S. A. Vanstone, Handbook of Applied Cryptography. 1997.
28. SUN Microsystems Inc., "Soft memory errors and their effect on sun fire system." http://www.sun.com/products-n-solutions/hardware/docs/pdf/ 816-5053-10.pdf.
29. N. Adiga and et. al., "An overview of the BlueGene/L Supercomputer," in In Proceedings of the Supercomputing, Nov. 2002.
30. G. Almasi, R. Bellofatto, J. Brunheroto, C. Ca - scaval, J. G. Castaqos, L. Ceze, P. Crumley, C. C. Erway, J. Gagliano, D. Lieber, X. Martorell, J. E. Moreira, A. Sanomiya and K. Strauss, "An Overview of the BlueGene/L System Software Organization," in Euro-Par: 9th International European Conference on Parallel Processing, Aug. 2003.
31. D. Bailey, T. Harris, W. Saphir, R. vander Wijngaart, A. Woo, and M. Yarros, "The NAS parallel benchmarks 2.0," Tech. Rep. NAS-95-020, NAS Systems Division, Dec. 1995.
32. "ASCI blue benchmarks." http://www.llnl.gov/asci_benchmarks/ asci/asci_code.list.html.