Implementation and Evaluation of a Scalable Application-Level Checkpoint-Recovery Scheme for MPI Programs

Proceedings of the ACM/IEEE SC 2004 Conference: Bridging Communities

Volumn , Issue , 2004, Pages

  Schulz, Martin ^a   Bronevetsky, Greg ^b   Fernandes, Rohit ^b   Marques, Daniel ^b   Pingali, Keshav ^b   Stodghill, Paul ^b  

^a LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^b Department of Computer Science and School of Operations Research and Information Engineering   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

DISTRIBUTED COMPUTER SYSTEMS; FAULT TOLERANCE; HARDWARE;

APPLICATION LEVEL; CHECKPOINT-AND-RESTART; CHECKPOINTING SCHEMES; COMPUTATIONAL SCIENCE; HARDWARE FAILURES; HIGH PERFORMANCE COMPUTING; MEAN TIME TO FAILURE; NON-BLOCKING CHECKPOINTING;

APPLICATION PROGRAMS;

EID: 84934312471     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2004.29     Document Type: Conference Paper

References (25)

1. A. Agbaria and R. Friedman. Starfish: Fault-tolerant dynamic MPI programs on clusters of workstations. In 8th IEEE International Symposium on High Performance Distributed Computing, 1999.
2. M. Beck, J. S. Plank, and G. Kingsley. Compiler-assisted checkpointing. Technical Report UT-CS-94-269, Dept. of Computer Science, University of Tennessee, 1994.
3. A. Beguelin, E. Seligman, and P. Stephan. Application level fault tolerance in heterogeneous networks of workstations. Journal of Parallel and Distributed Computing, 43(2):147-155, 1997.
4. A. Bouteiller, F. Cappello, T. Herault, G. Krawezik, P. Lemarnier, and F. Magniette. MPICH-V2: a fault tolerant MPI for volatile nodes based on pessimistic sender based message logging. In Supercomputing Conference SC'03, Phoenix, AZ, Nov. 2003.
5. G. Bronevetsky, D. Marques, K. Pingali, and P. Stodghill. Automated application-level checkpointing of mpi programs. In Principles and Practices of Parallel Programming, San Diego, CA, June 2003.
6. G. Bronevetsky, D. Marques, K. Pingali, and P. Stodghill. Collective operations in an application-level fault tolerant MPI system. In International Conference on Supercomputing (ICS) 2003, San Francisco, CA, June 23-26 2003.
7. B. Carnes. The smg2000 benchmark code. Available at http://www.llnl.gov/asci/purple/benchmarks/limited/smg/, September 19 2001.
8. M. Chandy and L. Lamport. Distributed snapshots: Determining global states of distributed systems. ACM Transactions on Computing Systems, 3(1):63-75, 1985.
9. Condor. http://www.cs.wisc.edu/condor/manual.
10. E. N. Elnozahy and W. Zwaenepoel. Manetho: Transparent rollback-recovery with low overhead, limited rollback and fast output. IEEE Transactions on Computers, 41(5), May 1992.
11. M. Elnozahy, L. Alvisi, Y. M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message passing systems. Technical Report CMU-CS-96-181, School of Computer Science, Carnegie Mellon University, Pittsburgh, PA, USA, Oct. 1996.
12. G. Fagg and J. J. Dongarra. FT-MPI: Fault tolerant MPI, supporting dynamic applications in a dynamic world. In EuroPVM/MPI User's Group Meeting, pages 346-353. Springer-Verilag, 2000.
13. A. J. Ferrari, S. J. Chapin, and A. S. Grimshaw. Process introspection: A heterogeneous checkpoint/restart mechanism based on automatic code modification. Technical Report CS-97-05, Department of Computer Science, University of Virginia, 25, 1997.
14. A. V. Gerbessiotis and L. G. Valiant. Direct bulk-synchronous parallel algorithms. Journal of Parallel and Distributed Computing, 22(2):251-267, 1994.
15. C.-C. J. Li and W. K. Fuchs. Catch - compiler-assisted techniques for checkpointing. In 20th International Symposium on Fault Tolerant Computing, pages 74-81, 1990.
16. N. Lynch. Distributed Algorithms. Morgan Kaufmann, San Francisco, California, first edition, 1996.
17. J. P. M. Beck and G. Kingsley. Compiler-Assisted Checkpointing. Technical Report Technical Report CS-94-269, University of Tennessee, Dec. 1994.
18. J. B. M. Litzkow, T. Tannenbaum and M. Livny. Checkpoint and migration of UNIX processes in the condor distributed processing system. Technical Report 1346, University of Wisconsin-Madison, 1997.
19. K. Perumalla and R. Fujimoto. Source-code transformations for efficient reversibility. Technical Report GIT-CC-99-21, College of Computing, Georgia Tech, September 1999.
20. A. Petitet, R. C. Whaley, J. Dongarra, and A. Cleary. Hpl - a portable implementation of the high-performance linpack benchmark for distributed-memory computers. Available at http://www.netlib.org/benchmark/hpl/.
21. B. Ramkumar and V. Strumpen. Portable checkpointing for heterogenous architectures. In Symposium on Fault-Tolerant Computing, pages 58-67, 1997.
22. S. Rao, L. Alvisi, and H. M. Vin. Egida: An extensible toolkit for low-overhead fault-tolerance. In Symposium on Fault-Tolerant Computing, pages 48-55, 1999.
23. G. Stellner. CoCheck: Checkpointing and Process Migration for MPI. In Proceedings of the 10th International Parallel Processing Symposium (IPPS'96), Honolulu, Hawaii, 1996.
24. N. Stone, J. Kochmar, R. Reddy, J. R. Scott, J. Sommerfield, and C. Vizino. A checkpoint and recovery system for the Pittsburgh Supercomputing Center Terascale Computing System. In Supercomputing, 2001. Available at http://www.psc.edu/publications/tech\-reports/chkpt\-rcvry/checkpoint-recovery-1.0.html.
25. S. Vadhiyar and J. Dongarra. Srs - a framework for developing malleable and migratable parallel software. Parallel Processing Letters, 13(2):291-312, June 2003.