Transparent, incremental checkpointing at kernel level: A foundation for fault tolerance for parallel computers

Proceedings of the ACM/IEEE 2005 Supercomputing Conference, SC'05

Volumn 2005, Issue , 2005, Pages

  Gioiosa, Roberto ^a,b   Sancho, José Carlos ^a   Song, Jiang ^a   Petrini, Fabrizio ^c   Davis, Kei ^a  

^a LOS ALAMOS NATIONAL LABORATORY   (United States)

^b UNIVERSITY OF ROME TOR VERGATA   (Italy)

^c PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER OPERATING SYSTEMS; COMPUTER SOFTWARE; DIGITAL LIBRARIES; FAULT TOLERANT COMPUTER SYSTEMS; USER INTERFACES;

CHECKPOINTERS; INCREMENTAL CHECKPOINTING; SYSTEM LIBRARIES;

PARALLEL PROCESSING SYSTEMS;

EID: 33845434226     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2005.76     Document Type: Conference Paper

References (35)

1. D. Addison, J. Beecroft, D. Hewson, M. McLaren, and F. Petrini. Quadrics QsNet II: A Network for Supercomputing Applications. In Hot Chips 14, Stanford University, California, August 18-20, 2003.
2. N. R. Adiga and et al. An Overview of the BlueGene/L Supercomputer. In Proceedings of the Supercomputing 2002, also IBM research report RC22570 (W0209-033), Baltimore, Maryland, November 16-22, 2002.
3. D. Bailey, T. Harris, W. Saphir, R. van der Wijngaart, A. Woo, and M. Yarrow. The NAS Parallel Benchmarks 2.0. NAS 95-020, NASA Ames Research Center, Moffett Field, California, December 1995.
4. A. Barak and O. La'adan. The MOSIX Multicomputer Operating System for High Performance Cluster Computing. Journal of Future Generation Computer Systems, 13(4-5):361-372, March 1998.
5. Greg Bronevetsky, Martin Schulz, Peter Szwed, Daniel Marques, and Keshav Pingali. Application-level Checkpointing for Shared Memory Programs. In Eleventh International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS XI), Boston, MA, October 2004.
6. C. Carothers and B. Szymanski. Checkpointing of Multithreaded Programs. Dr. Dobbs Journal, 15(8), August 2002.
7. F. Chabaud, N. Cunningham, and B. Blackham. Software Suspend for Linux.
8. High Productivity Computing Systems (HPCS) initiative in DARPA. Available from http://http://www.darpa.mil/ipto/programs/hpcs/index.html.
9. J. Duell, P. Hargrove, and E. Roman. The Design and Implementation of Berkeley Lab's Linux Checkpoint/Restart.
10. E. N. Elnozahy, D. B. Johnson, and W. Zwaenepoel. The Performance of Consistent Checkpointing. In Proceedings of the 11th Symposium on Reliable Distributed Systems, Houston, TX, October 5-7, 1992.
11. Yoav Etsion and Dror G. Feitelson. User-Level Communication in a System with Gang Scheduling. In Proceedings of the International Parallel and Distributed Processing Symposium 2001, IPDPS2001, San Francisco, CA, April 2001.
12. Fabrizio Petrini and Kei Davis and José Carlos Sancho. System-Level Fault-Tolerance in Large-Scale Parallel Machines with Buffered Coscheduling. In In 9th IEEE Workshop on Fault-Tolerant Parallel, Distributed and Network-Centric Systems (FTPDS04), Santa Fe, NM, April 2004.
13. Juan Fernández, Eitan Frachtenberg, and Fabrizio Petrini. BCS MPI: A New Approach in the System Software Design for Large-Scale Parallel Computers. In Proceedings of SC2003, Phoenix, Arizona, November 10-16, 2003.
14. Juan Fernández, Eitan Frachtenberg, Fabrizio Petrini, Kei Davis, and José Carlos Sancho. Architectural Support for System Software on Large-Scale Clusters. In The 2004 International Conference on Parallel Processing, (ICPP-04), Montreal, Quebec, Canada, August 2004.
15. M. Foster. Pursuing the AP's to Checkpointing with UCLiK. In Proceedings of the 10th International Linux System Technology Conference, Saarbrucken, Germany, October 14-16, 2003.
16. Eitan Frachtenberg, Kei Davis, Fabrizio Petrini, Juan Fernández, and José Carlos Sancho. Designing Parallel Operating Systems via Parallel Programming. In Euro-Par 2004, Pisa, Italy, August 2004.
17. Eitan Frachtenberg, Fabrizio Petrini, Juan Fernández, Scott Pakin, and Salvador Coll. STORM: Lightning-Fast Resource Management. In ACM/IEEE SC2002, Baltimore, MD, November 2002.
18. Eitan Frachtenberg, Fabrizio Petrini, Juan Fernández, Scott Pakin, and Salvador Coll. STORM: Lightning-Fast Resource Management. In Proceedings of SC2002, Baltimore, Maryland, November 16-22 2002.
19. E. Hendriks. VMADump. Available from http://cvs.sourceforge.net/viewcvs. py/bproc/vmadump.
20. E. Hendriks. BProc: The Beowulf Distributed Process Space. In Proceedings of the 16th Annual ACM International Conference on Supercomputing, New York City, June 22-26, 2002.
21. D. J. Kerbyson, H. J. Alme, A. Hoisie, F.Petrini, H. J. Wasserman, and M. Gittings. Predictive Performance and Scalability Modeling of a Large-Scale Application. In Proceedings of the Supercomputing, November 10-16, 2001.
22. Lightning Linux Cluster. Available from http://www.lanl.gov/worldview/ news/releases/archive/03-107.shtml.
23. N. Meyer. User and Kernel Level Checkpointing. In Proceedings of the Sun Microsystems HPC Consortium Meeting, Phoenix, Arizona, November 15-17, 2003. Available from http://checkpointing.psnc.pl/Progress/sat_nmeyer.pdf.
24. S. Osman, D. Subhraveti, G. Su, and J. Nieh. The Design and Implementation of Zap: A System for Migrating Computing Environments. In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation, Boston, MA, December 9-11, 2002.
25. Fabrizio Petrini and Wu-chun Feng. Improved Resource Utilization with Buffered Coscheduling. Journal of Parallel Algorithms and Applications, 16:123-144, 2001.
26. E. Pinheiro. EPCKPT. Available from http://www.research.rutgers.edu/ ~edpin/epckpt.
27. J. S. Plank, M. Beck, G. Kingsley, and K. Li. Libckpt: Transparent Checkpointing under Unix. In Proceedings of the Usenix Winter 1995 Technical Conference, New Orleans, Louisiana, January 16-20, 1995.
28. Michael L. Powell and Barton P. Miller. Process migration in DEMOS/MP. In ACM symposium on Operating systems principles, Bretton Woods, New Hampshire, 1983.
29. J. Rough and A. Goscinski. Exploiting Operating System Services to Efficiently Checkpoint Parallel Applications in GENESIS. In Proceedings of the International Conference on Algorithms and Architectures for Parallel Processing, Beijing, China, October 23-25, 2002.
30. J. C. Sancho, F. Petrini, G. Johnson, J. Fernández, and E. Frachtenberg. On the Feasibility of Incremental Checkpointing for Scientific Computing. In Proceedings of the 18th International Parallel & Distributed Processing Symposium, Santa Fe, New Mexico, April 26-30, 2004.
31. S. Sankaran, J. M. Squyres, B. Barrett, A. Lumsdaine, J. Duell, P. Hargrove, and E. Roman. The LAM/MPI Checkpoint/Restart Framework: System-Initiated Checkpointing. In Proceedings of the LACSI Symposium, Santa Fe, New Mexico, October 12-14, 2003.
32. Martin Schulz, Greg Bronevetsky, Rohit Fernandes, Daniel Marques, Keshav Pingali, , and Paul Stodghill. Implementation and Evaluation of a Scalable Application-level Checkpoint-Recovery Scheme for MPI Programs. In ACM/IEEE SC2004, Pittsburgh, PA, November 10-16, 2004.
33. O. O. Sudakov and E. S. Meshcheryakov. Process Checkpointing and Restart System for Linux. Available from http://www.cluster.kiev.ua/eng/tasks/chpx.html.
34. The ASCI Sweep3D Benchmark. Available from http://www.llnl.gov/ asci_benchmarks/asci/limited/sweep3d/.
35. H. Zhong and J. Nieh. CRAK: Linux Checkpoint/Restart as a Kernel Module. Technical Report CUCS-014-01, Department of Computer Science, Columbia University, New York, November 2001.