Fast checkpointing by write aggregation with dynamic buffer and interleaving on multicore architecture

16th International Conference on High Performance Computing, HiPC 2009 - Proceedings

Volumn , Issue , 2009, Pages 99-108

  Ouyang, Xiangyong ^a   Gopalakrishnan, Karthik ^a   Gangadharappa, Tejus ^a   Panda, Dhabaleswar K ^a  

^a Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION EXECUTION; CHECK POINTING; CHECKPOINT/RESTART; DE FACTO STANDARD; DYNAMIC BUFFER POOL; JOB SIZE; LARGE CLUSTERS; MEAN TIME BETWEEN FAILURES; MULTICORE ARCHITECTURES; PARALLEL APPLICATION; PROCESSOR CORES;

DYNAMICS; FAULT TOLERANCE; PARALLEL PROGRAMMING; QUALITY ASSURANCE; SOFTWARE ARCHITECTURE;

SECURITY OF DATA;

EID: 77952145003     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HIPC.2009.5433218     Document Type: Conference Paper

References (25)

1. MPI over InfiniBand Project. In http://nowlab.cse.ohiostate.edu/projects/ mpi-iba/.
2. Application Requirements and Objectives for Petascale Systems . HPCwire, February 2008.
3. Milo Polte and Jiri Simsa etc. . Fast log-based concurrent writing of checkpoints . In PDSI 2008 workshop in conjunction with SC08 , Nov. 2008.
4. S. Al-Kiswany, M. Ripeanu, S.S. Vazhkudai, and A. Gharaibeh. stdchk: A checkpoint storage system for desktop grid computing. June 2008.
5. Micah Beck, Jack J. Dongarra, and etc. Graham E. Fagg. Harness: a next generation distributed virtual machine. Future Gener. Comput. Syst., 15(5-6):571-582, 1999.
6. George Bosilca, Aurelien Bouteiller, Samir Djilali, Gilles Fedak, Cecile Germain, Thomas Herault, Vincent Neri, and Anton Selikhov. Mpich-v: Toward a scalable fault tolerant mpi for volatile nodes. In In Supercomputing, pages 1-18, 2002.
7. Cluster File System, Inc. Lustre: A Scalable, High Performance File System. http://www.lustre.org/docs.html.
8. J. Duell. The design and implementation of berkeley lab's linux checkpoint/restart. Lawrence Berkeley National Laboratory, Paper LBNL-54941, April 2005.
9. Duell, J., Hargrove, P., and Roman, E. Requirements for Linux Checkpoint/Restart. Technical Report LBNL-49659, Lawrence Berkeley National Laboratory, Berkeley, CA 94720, 2002.
10. Chung hsing Hsu and Wu chun Feng. A power-aware run-time system for high-performance computing. Supercomputing, 2005. Proceedings of the ACM/IEEE SC 2005 Conference, Nov. 2005.
11. J. Hursey, J.M. Squyres, T.I. Mattox, and A. Lumsdaine. The design and implementation of checkpoint/restart process fault tolerance for open mpi. In 12th IEEE Workshop on Dependable Parallel, Distributed and Network-Centric Systems, March 2007.
12. I.R. Philp. Software failures and the road to a petaflop machine. In First Workshop on High Performance Computing Reliability Issues (HPCRI), February 2005.
13. K. Li, J. F. Naughton, and J. S. Plank. Low-latency, concurrent checkpointing for parallel programs. IEEE Trans. Parallel Distrib. Syst., 1994.
14. Michael Litzkow, Todd Tannenbaum, Jim Basney, and Miron Livny. Checkpoint and Migration of UNIX Processes in the Condor Distributed Processing System. In Technical Report UW-CSTR-1346, University of Wisconsin-Madison, Computer Sciences Department, April 1997.
15. Paul H. Hargrove and Jason C. Duell. Berkeley Lab Checkpoint/Restart (BLCR) for Linux Clusters. In SciDAC, 6 2006.
16. James S. Plank, Micah Beck, Gerry Kingsley, and Kai Li. Libckpt: Transparent checkpointing under unix. Technical report, Knoxville, TN, USA, 1994.
17. Q. Gao, W. Huang, M. Koop, and D. K. Panda. Group-based Coordinated Checkpointing for MPI: A Case Study on InfiniBand. In Int'l Conference on Parallel Processing (ICPP), XiAn, China, 9 2007.
18. Q. Gao, W. Yu, W. Huang and D. K. Panda. Application-Transparent Checkpoint/Restart for MPI Programs over InfiniBand. In International Conference on Parallel Processing (ICPP), August 2006.
19. S. Sankaran and J. M. Squyres and B. Barrett etc. The lam/mpi checkpoint/restart framework: System-initiated checkpointing. LACSI, Oct. 2003.
20. Rajeev Thakur and Ewing Lusk. Data sieving and collective i/o in romio. In Proceedings of the 7th Symposium on the Frontiers of Massively Parallel Computation, pages 182-189. IEEE Computer Society Press, 1999.
21. Chao Wang, Frank Mueller, Christian Engelmann, and Stephen L. Scott. A job pause service under lam/mpi+blcr for transparent fault tolerance. In IPDPS, pages 1-10, 2007.
22. Chao Wang, Frank Mueller, Christian Engelmann, and Stephen L. Scott. Proactive process-level live migration in hpc environments. In SC '08: Proceedings of the 2008 ACM/IEEE conference on Supercomputing, 2008.
23. Frederick C. Wong and Richard P. Martin etc. Architectural requirements and scalability of the nas parallel benchmarks. In Supercomputing '99, page 41, 1999.
24. Xiangyong Ouyang, Karthik Gopalakrishnan and Dhabaleswar K. Panda. Accelerating checkpoint operation by node-level write aggregation on multicore systems. To appear in ICPP 2009, September 2009.
25. Hua Zhong and Jason Nieh. Crak: Linux checkpoint/restart as a kernel module. Technical report, Department of Computer Science, Columbia University, November 2001.