Correlated set coordination in fault tolerant message logging protocols for many-core clusters

Concurrency and Computation: Practice and Experience

Volumn 25, Issue 4, 2013, Pages 572-585

  Bouteiller, Aurelien ^a   Herault, Thomas ^a   Bosilca, George ^a   Dongarra, Jack J ^a  

^a UNIVERSITY OF TENNESSEE   (United States)

Author keywords

checkpoint restart; fault tolerance; multicore clusters

Indexed keywords

COMPUTER APPLICATIONS; COMPUTER NETWORKS; CONCURRENCY CONTROL;

CHECKPOINT/RESTART; EVENT LOGGING; FAILURE PROBABILITY; FAULT-TOLERANT; MEAN TIME BETWEEN FAILURES; MESSAGE LOGGING; MESSAGE LOGGING PROTOCOLS; MULTI-CORE CLUSTER;

FAULT TOLERANCE;

EID: 84874118584     PISSN: 15320626     EISSN: 15320634     Source Type: Journal    
DOI: 10.1002/cpe.2859     Document Type: Conference Paper

References (22)

1. Dongarra J, Beckman P,. et al. The. Intl. Journal of High Performance Computer Applications 2011; 25 (11). to appear.
2. Bouteiller A, Hérault T, Bosilca G, Dongarra JJ,. Correlated set coordination in fault tolerant message logging protocols. In Euro-par 2011 Parallel Processing-17th International Conference, Proceedings, Part II, Lecture Notes in Computer Science, Vol. 6853. Springer, September 2011; 51-64, DOI: http://dx.doi.org/10.1007/978-3-642-23397-56.
3. Lamport L,. Time, clocks, and the ordering of events in a distributed system. Communications of the ACM 1978; 21 (7): 558-565. DOI: http://doi.acm.org/10.1145/359545.359563. (Pubitemid 8615486)
4. Bouteiller A, Bosilca G, Dongarra J,. Redesigning the message logging model for high performance. Concurrency and Computation: Practice and Experience 2010; 22 (16): 2196-2211. DOI: http://dx.doi.org/10.1002/cpe.1589.
5. Bronevetsky G,. Portable checkpointing for parallel applications. Ph.D. Thesis, Cornell University, Department of Computer Science, 2007.
6. Chandy KM, Lamport L,. Distributed snapshots: determining global states of distributed systems. Transactions on computer systems February 1985; 3 (1): 63-75. ACM. (Pubitemid 15597765)
7. Buntinas D, Coti C, Herault T, Lemarinier P, Pilard L, Rezmerita A, Rodriguez E, Cappello F,. Blocking vs. non-blocking coordinated checkpointing for large-scale fault tolerant MPI protocols. Future Generation Computer Systems 2008; 24 (1): 73-84. http://www.sciencedirect.com/science/article/B6V06- 4N2KT6H-1/2/00e790651475028977cc3031d9ea3980. (Pubitemid 47337128)
8. Plank JS,. Efficient checkpointing on MIMD architectures. Ph.D. Thesis, Thesis, Princeton University, June 1993. http://www.cs.utk.edu/~plank/plank/ papers/thesis.html.
9. Lemarinier P, Bouteiller A, Herault T, Krawezik G, Cappello F,. Improved message logging versus improved coordinated checkpointing for fault tolerant MPI. In IEEE International Conference on Cluster Computing. IEEE CS Press, 2004.
10. Rao S, Alvisi L, Vin HM,. The cost of recovery in message logging protocols. In 17th Symposium on Reliable Distributed Systems (SRDS). IEEE CS Press, October 1998; 10-18.
11. Bosilca G, Bouteiller A, Herault T, Lemarinier P, Dongarra JJ,. Dodging the cost of unavoidable memory copies in message logging protocols. In EuroMPI, Lecture Notes in Computer Science, Vol. 6305, Keller R, Gabriel E, Resch MM, Dongarra J, (eds). Springer, 2010; 189-197.
12. Gabriel E, Fagg GE, Bosilca G, Angskun T, Dongarra JJ, Squyres JM, Sahay V, Kambadur P, Barrett B, Lumsdaine A, Castain RH, Daniel DJ, Graham RL, Woodall TS,. Open MPI: Goals, concept, and design of a next generation MPI implementation. Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 2004; 97-104.
13. The MPI F. MPI: a message passing interface. In Supercomputing '93: Proceedings of the 1993 ACM/IEEE Conference on Supercomputing. ACM Press: New York, NY, USA, 1993; 878-883, DOI: http://doi.acm.org/10.1145/169627.169855.
14. Elnozahy EN, Alvisi L, Wang YM, Johnson DB,. A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv. 2002; 34 (3): 375-408.
15. Bouteiller A, Ropars T, Bosilca G, Morin C, Dongarra J,. Reasons to be pessimist or optimist for failure recovery in high performance clusters. In Proceedings of the 2009 IEEE Cluster Conference, IEEE (ed.), September 2009.
16. Hlary JM, Mostefaoui A, Raynal M,. Communication-induced determination of consistent snapshots. IEEE Transactions on Parallel and Distributed Systems 1999; 10 (9): 865-877. DOI: http://dx.doi.org/10.1109/71.798312. (Pubitemid 32081631)
17. Alvisi L, Elnozahy E, Rao S, Husain SA, Mel AD,. An analysis of communication induced checkpointing. In 29th Symposium on Fault-Tolerant Computing (FTCS'99). IEEE CS Press, June 1999.
18. Gao Q, Huang W, Koop MJ, Panda DK,. Group-based coordinated checkpointing for mpi: a case study on infiniband. Parallel Processing, 2007. ICPP 2007. International Conference on, 2007.
19. Ho JCY, Wang CL, Lau FCM,. Scalable group-based checkpoint/restart for large-scale message-passing systems. In Proceedings of the 22nd IEEE International Symposium on Parallel and Distributed Processing (IPDPS). IEEE; 2008; 1-12.
20. Kale L,Charm++. Encyclopedia of Parallel Computing (To Appear) (, Padua D, ed.), Springer Verlag, 2011.
21. Negara S, Pan KC, Zheng G, Negara N, Johnson RE, Kale LV, Ricker PM,. Automatic MPI to AMPI program transformation. Technical Report 10-09, Parallel Programming Laboratory, March 2010.
22. Meneses E, Mendes CL, Kalé LV,. Team-based message logging: preliminary results. 3rd Workshop on Resiliency in High Performance Computing (Resilience) in Clusters, Clouds, and Grids (CCGRID 2010), 2010.