MPICH-GF: Transparent checkpointing and rollback-recovery for grid-enabled MPI processes

IEICE Transactions on Information and Systems

Volumn E87-D, Issue 7, 2004, Pages 1820-1828

  Woo, Namyoon ^a   Jung, Hyungsoo ^a   Yeom, Heon Young ^a   Park, Taesoon ^b   Park, Hyungwoo ^c  

^a Seoul National University   (South Korea)

^b Sejong University   (South Korea)

^c Korea Institute of Science and Technology Information (KISTI)   (South Korea)

Author keywords

Checkpoint; Consistent recovery; Fault tolerance; Grid computing; MPI

Indexed keywords

ABSTRACTING; ALGORITHMS; COMMUNICATION SYSTEMS; COMPUTATIONAL METHODS; MIDDLEWARE; PROCESS CONTROL;

CHECKPOINT; CONSISTENT RECOVERY; FAULT-TOLERANCE; GRID COMPUTING; MPI;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 3142722523     PISSN: 09168532     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Conference Paper

References (37)

1. A. Agbaria and R. Friedman, "Starfish: Fault-tolerant dynamic MPI programs on clusters of workstations," Proc. IEEE Symp. on High Performance Distributed Computing, pp.167-176, Aug. 1999.
2. L. Alvisi, E.N. Elnozahy, S. Rao, S.A. Husain, and A.D. Mel, "An analysis of communication induced checkpointing," Symp. on Fault-Tolerant Computing, pp.242-249, 1999.
3. R. Batchu, A. Skjellum, Z. Cui, M. Beddhu, J.P. Neelamegam, Y. Dandass, and M. Apte, "MPI/FT: Architecture and taxonomies for fault-tolerant, message-passing middleware for performance-portable parallel computing," Proc. 1st Int. Symp. on Cluster Computing and the Grid, May 2001.
4. A. Beguelin, E. Seligman, and P. Stephan, "Application level fault tolerance in heterogeneous networks of workstations," J. Parallel Distrib. Comput., vol.43, no.2, pp.147-155, 1997.
5. G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G.F. Magniette, V. Néri, and A. Selikhov, "MPICH-V: Toward a scalable fault tolerant MPI for volatile nodes," SuperComputing 2002, pp. 1-18, 2002.
6. G. Burns, R. Daoud, and J. Vaigl, "LAM: An open cluster environment for MPI," Proc. Supercomputing Symp., pp.379-386, Toronto, Canada, 1994.
7. R. Butler and E.L. Lusk, "Monitors, messages, and clusters: The p4 parallel programming system," Parallel Comput., vol.20, no.4, pp.547-564, 1994.
8. K.M. Chandy and L. Lamport, "Distributed snapshots: Determining global states of distributed systems," ACM Trans. Comput. Syst., vol.3, no.1, pp.63-75, Aug. 1985.
9. Y. Chen, K. Li, and J.S. Plank, "CLIP: A checkpointing tool for message-passing parallel programs," Proc. SC97: High Performance Networking and Computing, Nov. 1997.
10. I.B.M. Corporation, IBM Loadleveler: Users Guide, Sept. 1993.
11. E.N. Elnozahy, L. Alvisi, Y.-M.Wang, and D.B. Johnson, "A survey of rollback-recovery protocols in message-passing systems," ACM Comput. Surv., vol.34, no.3, pp.375-408, 2002.
12. G.E. Fagg and J. Dongarra, "FT-MPI: Fault tolerant MPI, supporting dynamic applications in a dynamic world," PVM/MPI 2000, pp.346-353, 2000.
13. M.P.I. Forum, MPI: A Message Passing Interface Standard, May 1994.
14. I. Foster and C. Kesselman, "The globus project: A status report," Proc. Heterogeneous Computing Workshop, pp.4-18, 1998.
15. I. Foster and C. Kesselman, The Grid: Blueprint for a Future Computing Infrastructure, Morgan Kaufmann, 1999.
16. I. Foster, C. Kesselman, and S. Tuecke, "The anatomy of the grid: Enabling scalable virtual organizations," J. Supercomput. Appl., vol.15, no.3, 2001.
17. J. Frey, T. Tannenbaum, I. Foster, M. Livny, and S. Tuecke, "Condor-G: A computation management agent for multi-institutional grids," Proc. 10th IEEE Symp. on High Performance Distributed Computing (HPDC10), pp.55-63, Aug. 2001.
18. W. Gropp, E. Lusk, N. Doss, and A. Skjellum, "A high-performance, portable implementation of the MPI message passing interface standard" Parallel Comput., vol.22, no.6, pp.789-828, 1996.
19. N.T. Karnois, B.Toonen, and I. Foster, "MPICH-G2: A grid-enabled implementation of the message passing interface," J. Parallel Distrib. Comput., vol.63, no.5, pp.551-563, May 2003.
20. R. Koo and S. Toueg, "Checkpointing and rollback recovery for distributed systems," IEEE Trans. Softw. Eng., vol.SE-13, no.1, pp.23-31, 1987.
21. W.-J. Li and J.-J. Tsay, "Checkpointing message-passing interface (MPI) parallel programs," Pacific Rim Int. Symp. on Fault-Tolerant Systems (PRFTS), 1997.
22. M.J. Litzkow and M. Solomon, "Supporting checkpointing and process migration outside the unix kernel," USENIX Conference Proc., pp.283-290, San Francisco, CA, Jan. 1992.
23. S. Louca, N. Neophytou, A. Lachanas, and P. Evripidou, "Portable fault tolerance scheme for MPI," Parallel Process. Lett., vol.10, no.4, pp.371-382, 2000.
24. K.Z. Meth and W.G. Tuel, "Parallel checkpoint/restart without message logging," Proc. 2000 Int. Workshops on Parallel Processing, pp.253-258, 2000.
25. NASA Ames Research Center, "Nas parallel benchmarks," Technical Report, http://science.nas.nasa.gov/Software/NPB/, 1997.
26. R. Netzer and J. Xu, "Necessary and sufficient conditions for consistent global snapshots," IEEE Trans. Parallel Distrib. Syst., vol.6, no.2, pp.165-169, 1995.
27. N. Neves and W.K. Fuchs, "RENEW: A tool for fast and efficient implementation of checkpoint protocols," Symp. on Fault-Tolerant Computing, pp.58-67, 1998.
28. G.T. Nguyen, V.D. Tran, and M. Kotocová, "Application recovery in parallel programming environment," European PVM/MPI, pp.234-242, 2002.
29. A. Nguyen-Tuong, Integrating Fault-Tolerance Techniques in Grid Applications, PhD Thesis, University of Virginia, USA, 2000.
30. J.S. Plank, M. Beck, G. Kingsley, and K. Li, "Libckpt: Transparent checkpointing under unix," USENIX Winter 1995 Technical Conference, pp.213-224, Jan. 1995.
31. J.S. Plank, K. Li, and M.A. Puening, "Diskless checkpointing," IEEE Trans. Parallel Distrib. Syst., vol.9, no.10, pp.972-986, 1998.
32. S. Rao, L. Alvisi, and H.M. Vin, "Egida: An extensible toolkit for low-overhead fault-tolerance," Symp. on Fault-Tolerant Computing, pp.48-55, 1999.
33. S.H. Russ, J. Robinson, B.K. Flachs, and B. Heckel, "The hector distributed run-time environment," IEEE Trans. Parallel Distrib. Syst., vol.9, no.11, pp.1102-1114, Nov. 1998.
34. L.M. Silva and J.G. Silva, "System-level versus user-defined checkpointing," Symp. on Reliable Distributed Systems, pp.68-74, 1998.
35. G. Stellner, "CoCheck: Checkpointing and process migration for MPI," Proc. Int. Parallel Processing Symp., pp.526-531, April 1996.
36. J. Tsai, S.-Y. Kuo, and Y.-M. Wang, "Theoretical analysis for communication-induced checkpointing protocols with rollback dependency trackability," IEEE Trans. Parallel Distrib. Syst., vol.9, no.10, pp.963-971, 1998.
37. V. Zandy, B. Miller, and M. Livny, "Process hijacking," Eighth Int. Symp. on High Performance Distributed Computing, pp.177-184, Aug. 1999.