Accelerating checkpoint operation by node-levelwrite aggregation on multicore systems

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2009, Pages 34-41

  Ouyang, Xiangyong ^a   Gopalakrishnan, Karthik ^a   Panda, Dhabaleswar K ^a  

^a Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CHECK POINTING; CHECKPOINT/RESTART; FILE SYSTEMS; JOB SIZE; MEAN TIME BETWEEN FAILURES; MPI APPLICATIONS; MULTI-CORE SYSTEMS; MULTICORE ARCHITECTURES; NAS PARALLEL BENCHMARKS; PARALLEL APPLICATION; PARALLEL JOBS; PERFORMANCE DEGRADATION; SMALL FILES; TIME COST;

SECURITY OF DATA;

EID: 77951447133     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2009.73     Document Type: Conference Paper

References (19)

1. MPI over InfiniBand and iWarp. In http://mvapich.cse.ohiostate. edu
2. Milo Polte and Jiri Simsa etc. . Fast log-based concurrent writing of checkpoints . In PDSI 2008 workshop in conjunction with SC08, Nov. 2008.
3. Micah Beck, Jack J. Dongarra, and Graham E. Fagg. Harness: A next generation distributed virtual machine. Future Generation Computer Systems, 15(5-6):571-582, 1999.
4. George Bosilca, Aurelien Bouteiller, Samir Djilali, Gilles Fedak, Cecile Germain, Thomas Herault, Vincent Neri, and Anton Selikhov. MPICH-V: Toward a scalable fault tolerant MPI for volatile nodes. In Supercomputing, pages 1-18, 2002.
5. Cluster File System, Inc. Lustre: A Scalable, High Performance File System. http://www.lustre.org/docs.html.
6. Duell, J., Hargrove, P., and Roman, E. The Design and Implementation of Berkeley Lab's Linux Checkpoint/Restart. Technical Report LBNL-54941, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, 2002.
7. J. Hursey, J.M. Squyres, T.I. Mattox, and A. Lumsdaine. The Design and Implementation of Checkpoint/Restart Process Fault Tolerance for Open MPI. In 12th IEEE Workshop on Dependable Parallel, Distributed and Network-Centric Systems, March 2007.
8. I.R. Philp. Software failures and the road to a petaflop machine. In First Workshop on High Performance Computing Reliability Issues (HPCRI), February 2005.
9. Michael Litzkow, Todd Tannenbaum, Jim Basney, and Miron Livny. Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing System. In Technical Report UW-CS-TR-1346, University of Wisconsin-Madison, Computer Sciences Department, April 1997.
10. Paul H. Hargrove and Jason C. Duell. Berkeley Lab Checkpoint/Restart (BLCR) for Linux Clusters. In SciDAC, 6 2006.
11. James S. Plank, Micah Beck, Gerry Kingsley, and Kai Li.Libckpt: Transparent checkpointing under unix. Technical report, Knoxville, TN, USA, 1994.
12. Q. Gao, W. Huang, M. Koop, and D. K. Panda. Groupbased Coordinated Checkpointing for MPI: A Case Study on InfiniBand. In Int'l Conference on Parallel Processing (ICPP), XiAn, China, 9 2007.
13. Q. Gao, W. Yu, W. Huang and D. K. Panda. Application- Transparent Checkpoint/Restart for MPI Programs over InfiniBand. In International Conference on Parallel Processing (ICPP), August 2006.
14. S. Sankaran and J. M. Squyres and B. Barrett etc. The LAM/MPI Checkpoint/Restart Framework: System-Initiated Checkpointing. LACSI, October 2003.
15. V. Strumpen. Compiler Technology for Portable Checkpoints. submitted for publication (http://theory.lcs. mit.edu/strumpen/porch.ps.gz). citeseer.ist.psu.edu/strumpen98compiler.html, 1998
16. Chao Wang, Frank Mueller, Christian Engelmann, and Stephen L. Scott. A Job Pause Service under LAM/MPI+BLCR for Transparent Fault Tolerance. In IPDPS, pages 1-10, 2007.
17. Chao Wang, Frank Mueller, Christian Engelmann, and Stephen L. Scott. Proactive process-level live migration in HPC environments. In SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, 2008.
18. Frederick C. Wong and Richard P. Martin etc. Architectural requirements and scalability of the NAS parallel benchmarks. In Supercomputing, page 41, 1999
19. Hua Zhong and Jason Nieh. CRAK: Linux Checkpoint/Restart As a Kernel Module. Technical report, Department of Computer Science, Columbia University, November 2001.