Reasons for a pessimistic or optimistic message logging protocol in MPI uncoordinated failure recovery

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2009, Pages

  Bouteiller, Aurelien ^a   Ropars, Thomas ^b   Bosilca, George ^a   Morin, Christine ^c   Dongarra, Jack ^a  

^a UNIVERSITY OF TENNESSEE   (United States)

^b UNIVERSITÉ DE RENNES 1   (France)

^c INRIA   (France)

Author keywords

[No Author keywords available]

Indexed keywords

EVENT LOGGING; FAILURE RATE; FAILURE RECOVERY; HIGH PERFORMANCE COMPUTING; HIGH PERFORMANCE NETWORKS; MESSAGE LOGGING; MESSAGE LOGGING PROTOCOLS; MESSAGE RECEPTION; MPI APPLICATIONS; NEW MODEL; SEVERAL PROTOCOLS; STABLE STORAGE;

CLUSTER COMPUTING; COMPUTER SCIENCE; FAULT TOLERANCE; PROGRAM PROCESSORS; TECHNICAL PRESENTATIONS;

QUALITY ASSURANCE;

EID: 72149132074     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2009.5289157     Document Type: Conference Paper

References (29)

1. The MPI Forum, "MPI: a message passing interface," in Supercomputing '93: Proceedings of the 1993 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM Press, 1993, pp. 878-883.
2. P. Lemarinier, A. Bouteiller, T. Herault, G. Krawezik, and F. Cappello, "Improved message logging versus improved coordinated checkpointing for fault tolerant MPI," in IEEE International Conference on Cluster Computing (Cluster 2004). IEEE CS Press, 2004.
3. S. Sankaran, J. M. Squyres, B. Barrett, A. Lumsdaine, J. Duell, P. Hargrove, and E. Roman, "The LAM/MPI checkpoint/restart framework: System-initiated checkpointing," in Proceedings, LACSI Symposium, Sante Fe, New Mexico, USA, October 2003.
4. E. N. M. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson, "A survey of rollback-recovery protocols in message-passing systems," ACM Comput. Surv., vol.34, no.3, pp. 375-408, 2002.
5. A. Bouteiller, G. Bosilca, and J. Dongarra, "Redesigning the message logging model for high performance," in International Supercomputer Conference (ISC 2008), Dresden, Germany, June 2008.
6. E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra, J. M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R. H. Castain, D. J. Daniel, R. L. Graham, and T. S. Woodall, "Open MPI: Goals, concept, and design of a next generation MPI implementation," in Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 2004, pp. 97-104.
7. L. Lamport, "Time, clocks, and the ordering of events in a distributed system," Communications of the ACM, vol.21, no.7, pp. 558-565, 1978.
8. T. Ropars and C. Morin, "O2P: An Extremely Optimistic Message Logging Protocol," INRIA Research Report 6357, November 2007.
9. M. Schulz, G. Bronevetsky, and B. R. Supinski, "On the Performance of Transparent MPI Piggyback Messages," in Proceedings of the 15th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. Berlin, Heidelberg: Springer-Verlag, 2008, pp. 194-201.
10. O. P. Damani, Y.-M. Wang, and V. K. Garg, "Distributed Recovery with K-optimistic Logging," Journal of Parallel and Distributed Computing, vol.63, pp. 1193-1218, 2003.
11. M. Singhal and A. Kshemkalyani, "An Efficient Implementation of Vector Clocks," Information Processing Letters, vol.43, no.1, pp. 47-52, 1992.
12. Q. O. Snell, A. R. Mikler, and J. L. Gustafson, "NetPIPE: A Network Protocol Independent Performance Evaluator," in IASTED International Conference on Intelligent Information Management and Systems, June 1996.
13. D. Bailey, T. Harris, W. Saphir, R. van der Wilngaart, A. Woo, and M. Yarrow, "The NAS Parallel Benchmarks 2.0," NASA Ames Research Center, Tech. Rep. Report NAS-95-1020, 1995.
14. R. Bolze, F. Cappello, E. Caron, M. Daydé, F. Desprez, E. Jeannot, Y. Jégou, S. Lanteri, J. Leduc, N. Melab, G. Mornet, R. Namyst, P. Primet, B. Quetier, O. Richard, E.-G. Talbi, and I. Touche, "Grid'5000: A large scale and highly reconfigurable experimental grid testbed," International Journal of High Performance Computing Applications, vol.20, no.4, pp. 481-494, 2006.
15. A. Roy-Chowdhury and P. Banerjee, "Algorithm-based fault location and recovery for matrix computations on multiprocessor systems," IEEE Trans. Comput., vol.45, no.11, pp. 1239-1247, 1996.
16. Z. Chen, G. E. Fagg, E. Gabriel, J. Langou, T. Angskun, G. Bosilca, and J. Dongarra, "Fault tolerant high performance computing by a coding approach," in PPoPP '05: Proceedings of the tenth ACM SIGPLAN symposium on Principles and practice of parallel programming. New York, NY, USA: ACM Press, 2005, pp. 213-223.
17. G. Fagg and J. Dongarra, "FT-MPI : Fault tolerant MPI, supporting dynamic applications in a dynamic world," in 7th Euro PVM/MPI User's Group Meeting2000, vol.1908 / 2000. Balatonfred, Hungary: Springer-Verlag Heidelberg, september 2000.
18. G. E. Fagg, A. Bukovsky, and J. J. Dongarra, "HARNESS and fault tolerant MPI," Parallel Computing, vol.27, no.11, pp. 1479-1495, October 2001.
19. K. M. Chandy and L. Lamport, "Distributed snapshots : Determining global states of distributed systems," in Transactions on Computer Systems, vol.3(1). ACM, February 1985, pp. 63-75.
20. G. Stellner, "CoCheck: Checkpointing and process migration for MPI," in Proceedings of the 10th International Parallel Processing Symposium (IPPS '96). Honolulu, Hawaii: IEEE CS Press, April 1996.
21. J.-M. Hlary, A. Mostefaoui, and M. Raynal, "Communication-induced determination of consistent snapshots," IEEE Transactions on Parallel and Distributed Systems, vol.10, no.9, pp. 865-877, 1999.
22. J. F. Ruscio, M. A. Heffner, and S. Varadarajan, "Dejavu: transparent user-level checkpointing, migration and recovery for distributed systems," in SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing. New York, NY, USA: ACM Press, 2006, p. 158.
23. Elnozahy, Elmootazbellah, and Zwaenepoel, "Manetho: Transparent rollback-recovery with low overhead, limited rollback and fast output," IEEE Transactions on Computing, vol.41, no.5, May 1992.
24. S. Rao, L. Alvisi, and H. M. Vin, "Egida: An extensible toolkit for low-overhead fault-tolerance," in 29th Symposium on Fault-Tolerant Computing (FTCS'99). IEEE CS Press, 1999, pp. 48-55.
25. A. Bouteiler, T. Herault, G. Krawezik, P. Lemarinier, and F. Cappello, "MPICH-V project: a multiprotocol automatic fault tolerant MPI," vol.20. SAGE Publications, Summer 2006, pp. 319-333.
26. R. Strom and S. Yemini, "Optimistic Recovery in Distributed Systems," ACM Transactions on Computing Systems, vol.3, no.3, pp. 204-226, 1985.
27. A. P. Sistla and J. L. Welch, "Efficient Distributed Recovery Using Message Logging," in PODC '89: Proceedings of the eighth annual ACM Symposium on Principles of distributed computing. New York, NY, USA: ACM Press, 1989, pp. 223-238.
28. S. W. Smith, D. B. Johnson, and J. D. Tygar, "Completely Asynchronous Optimistic Recovery with Minimal Rollbacks," in FTCS-25: 25th International Symposium on Fault Tolerant Computing Digest of Papers, Pasadena, California, 1995, pp. 361-371.
29. M. Elnozahy, L. Alvisi, Y. M. Wang, and D. B. Johnson, "A survey of rollback-recovery protocols in message-passing systems," ACM Computing Surveys (CSUR), vol.34, no.3, pp. 375-408, september 2002.