Group-based coordinated checkpointing for MPI: A case study on infiniband

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2007, Pages 47-54

  Gao, Qi ^a   Huang, Wei ^a   Koop, Matthew J ^a   Panda, Dhabaleswar K ^a  

^a Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CLUSTER COMPUTING; DIGITAL STORAGE; FAULT TOLERANCE; SCALABILITY;

CLUSTER ENVIRONMENTS; COORDINATED CHECKPOINTING; HIGH PERFORMANCE COMPUTING (HPC); MICRO-BENCHMARK; PARALLEL APPLICATION; PARALLEL VERSION; ROLL-BACK RECOVERIES; STORAGE SYSTEMS;

DATA MINING;

EID: 47249116207     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2007.44     Document Type: Conference Paper

References (24)

1. MPICH-V Project. http://mpich-v.lri.fr.
2. MPICH2. http://www-unix.mcs.anl.gov/mpi/mpich2/.
3. MVAPICH: MPI for InfiniBand and iWARP. http://nowlab.cse.ohio-state.edu/ projects/mpi-iba/.
4. Parallel Virtual File System, Version 2. http://www.pvfs.org.
5. G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G. Magniette, V. Néri, and A. Selikhov. MPICH-V: Toward a Scalable Fault Tolerant MPI for Volatile Nodes. In IEEE/ACM Super-Computing 2002, Baltimore, MD, November 2002.
6. A. Bouteiller, F. Cappello, T. Hérault, G. Krawezik, P. Lemarinier, and F. Magniette. MPICH-V2: a fault tolerant MPI for volatile nodes based on pessimistic sender based message logging. In IEEE/ACM SuperComputing 2003, Phoenix, AZ, November 2003.
7. A. Bouteiller, B. Collin, T. Hérault, P. Lemarinier, and F. Cappello. Impact of event logger on causal message logging protocols for fault tolerant MPI. In Proceedings of Int'l Parallel and Distributed Processing Symposium (IPDPS), Denver, CO, April 2005.
8. A. Bouteiller, P. Lemarinier, T. Hérault, G. Krawezik, and F. Cappello. Improved message logging versus improved coordinated checkpointing for fault tolerant MPI. In Proceedings of Cluster 2004, San Diego, CA, September 2004.
9. M. Chandy and L. Lamport. Distributed Snapshots: Determining Global States of Distributed Systems. In ACM Trans. Comput. Syst. 31, 1985.
10. C. Coti, T. Herault, P. Lemarinier, L. Pilard, A. Rezmerita, E. Rodriguez, and F. Cappello. Blocking vs. non-blocking coordinated checkpointing for large-scale fault tolerant MPI. In ACM/IEEE SuperComputing (SC), 2006.
11. J. Duell, P. Hargrove, and E. Roman. The Design and Implementation of Berkeley Lab's Linux Checkpoint/Restart. Technical Report LBNL-54941, Berkeley Lab, 2002.
12. E. N. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson. A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv., 34(3), 2002.
13. G. E. Fagg, E. Gabriel, G. Bosilca, T. Angskun, Z. Chen, J. Pjesivac-Grbovic, K. London, and J. J. Dongarra. Extending the MPI Specification for Process Fault Tolerance on High Performance Computing Systems. In International Supercomputer Conference (ICS), 2003.
14. Q. Gao, W. Yu, W. Huang, and D. K. Panda. Application-Transparent Checkpoint/Restart for MPI Programs over InfiniBand. In Int'l Conference on Parallel Processing (ICPP'06), Columbus, OH, August 2006.
15. R. Gioiosa, J. C. Sancho, S. Jiang, and F. Petrini. Transparent incremental checkpointing at kernel level: A foundation for fault tolerance for parallel computers. In ACM/IEEE SuperComputing 2005, Seattle, WA, November 2005.
16. J. Hursey, T. Mattox, A. Lumsdaine, and J. M. Squyres. The design and implementation of checkpoint/restart process fault tolerance for Open MPI. In Workshop on Dependable Parallel, Distributed and Network-Centric Systems(DPDNS), in conjunction with IPDPS, 2007.
17. InfiniBand Trade Association. http://www.infinibandta.org.
18. M. Leininger. InfiniBand and OpenFabrics Successes and Future Requirements. http://www.infinibandta.org/events/DevCon2006_presentations/ 0930_Past_successes.pdf, 2006.
19. J. Liu, W. Jiang, P. Wyckoff, D. K. Panda, D. Ashton, D. Buntinas, W. Gropp, and B. Toonen. Design and Implementation of MPICH2 over InfiniBand with RDMA Support. In Int'l Parallel and Distributed Processing Symposium (IPDPS '04), April 2004.
20. A. Petitet, R. C. Whaley, J. Dongarra, and A. Cleary. High performance linpack. http://www.netlib.org/benchmark/hpl/.
21. S. Sankaran, J.M. Squyres, B. Barrett, A. Lumsdaine, J. Duell, P. Hargrove, and E. Roman. The LAM/MPI Checkpoint/Restart Framework: System-Initiated Checkpointing. International Journal of High Performance Computing Applications, pages 479-493, 2005.
22. J. S. Vetter and F. Mueller. Communication Characteristics of Large-Scale Scientific Applications for Contemporary Cluster Architectures. In Proceedings of International Parallel and Distributed Processing Symposium (IPDPS) 2002, Fort Lauderdale, FL, April 2002.
23. C. Wang, F. Mueller, C. Engelmann, and S. Scott. A Job Pause Service under LAM/MPI+BLCR for Transparent Fault Tolerance. In Int'l Parallel and Distributed Processing Symposium (IPDPS '07), 2007.
24. C. Wang and S. Parthasarathy. Parallel Algorithms for Mining Frequent Structural Motifs in Scientific Data. In ACM International Conference on Supercomputing (ICS) 2004, Malo, France, June 2004.