FMI: Fault tolerant messaging interface for fast and transparent recovery

Proceedings of the International Parallel and Distributed Processing Symposium, IPDPS

Volumn , Issue , 2014, Pages 1225-1234

  Sato, Kento ^a   Moody, Adam ^a   Mohror, Kathryn ^b   Gamblin, Todd ^b   Supinski, Bronis R De ^b   Maruyama, Naoya ^c   Matsuoka, Satoshi ^a  

^a TOKYO INSTITUTE OF TECHNOLOGY   (Japan)

^b LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^c Advanced Institute for Computational Science RIKEN ^*  (Japan)

Author keywords

Checkpoint Restart; Fault tolerance; MPI

Indexed keywords

DISTRIBUTED PARAMETER NETWORKS; FAULT TOLERANCE; FILE ORGANIZATION; MESSAGE PASSING; RECOVERY; SEMANTICS; SUPERCOMPUTERS;

CHECK POINTING; CHECKPOINT/RESTART; FAULT-TOLERANT; MEAN TIME BETWEEN FAILURES; MPI; PARALLEL FILE SYSTEM; RUN-TIME SOFTWARE; TRADITIONAL APPROACHES;

APPLICATION PROGRAMS;

EID: 84906689065     PISSN: 15302075     EISSN: 23321237     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2014.126     Document Type: Conference Paper

References (27)

1. B. Schroeder and G. A. Gibson, "Understanding Failures in Petascale Computers," Journal of Physics: Conference Series, vol. 78, no. 1, pp. 012 022+, Jul. 2007. [Online]. Available: http://dx.doi.org/10.1088/ 1742-6596/78/1/012022
2. A. Geist and C. Engelmann, "Development of Naturally Fault Tolerant Algorithms for Computing on 100,000 Processors," 2002.
3. J. Daly et al., "Inter-Agency Workshop on HPC Resilience at Extreme Scale," February 2012. [Online]. Available: http://institutes.lanl.gov/ resilience/docs/Inter-AgencyResilienceReport.pdf
4. A. Moody, G. Bronevetsky, K. Mohror, and B. R. de Supinski, "Design, Modeling, and Evaluation of a Scalable Multi-level Checkpointing System," in Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, ser. SC '10. Washington, DC, USA: IEEE Computer Society, Nov. 2010, pp. 1-11. [Online]. Available: http://dx.doi.org/10.1109/sc.2010.18
5. "MPI Forum." [Online]. Available: http://www.mpi-forum.org/
6. K. Iskra, J. W. Romein, K. Yoshii, and P. Beckman, "ZOID: I/OForwarding Infrastructure for Petascale Architectures," in PPoPP '08: Proceedings of the 13th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, 2008, pp. 153-162.
7. R. Ross, J. Moreira, K. Cupps, and W. Pfeiffer, "Parallel I/O on the IBM Blue Gene/L System," Blue Gene/L Consortium Quarterly Newsletter, Tech. Rep., First Quarter, 2006.
8. B. Schroeder and G. A. Gibson, "Disk failures in the real world: what does an mttf of 1,000,000 hours mean to you?" in Proceedings of the 5th USENIX conference on File and Storage Technologies, ser. FAST '07. Berkeley, CA, USA: USENIX Association, 2007. [Online]. Available: http://dl.acm.org/ citation.cfm?id=1267903.1267904
9. C. L. Chen and M. Y. Hsiao, "Error-correcting codes for semiconductor memory applications: a state-of-the-art review," IBM J. Res. Dev., vol. 28, no. 2, pp. 124-134, Mar. 1984. [Online]. Available: http://dx.doi.org/10.1147/rd.282.0124
10. D. A. Patterson, G. Gibson, and R. H. Katz, "A Case for Redundant Arrays of Inexpensive Disks (RAID)," in Proceedings of the 1988 ACM SIGMOD international conference on Management of data, ser. SIGMOD '88. New York, NY, USA: ACM, 1988, pp. 109-116. [Online]. Available: http://dx.doi.org/10.1145/ 50202.50214
11. K. Sato, N. Maruyama, K. Mohror, A. Moody, T. Gamblin, B. R. de Supinski, and S. Matsuoka, "Design and Modeling of a Non-Blocking Checkpointing System," in Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, ser. SC '12. Salt Lake City, Utah: IEEE Computer Society Press, 2012. [Online]. Available: http://portal.acm.org/ citation.cfm?id=2389022
12. L. Bautista-Gomez, D. Komatitsch, N. Maruyama, S. Tsuboi, F. Cappello, and S. Matsuoka, "FTI: high performance Fault Tolerance Interface for hybrid systems," in Proceedings of the 2011 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis, Seattle, WS, USA, 2011.
13. N. H. Vaidya, "On Checkpoint Latency," College Station, TX, USA, Tech. Rep., 1995. [Online]. Available: http://portal.acm.org/citation. cfm?id=892900
14. R. L. Graham, R. Brightwell, B. Barrett, G. Bosilca, and Pjesivac-Grbović, "An Evaluation of Open MPI's Matching Transport Layer on the Cray XT," Oct 2007.
15. "PMGR COLLECTIVE." [Online]. Available: http://sourceforge.net/ projects/pmgrcollective/
16. K. Sato, A. Moody, K. Mohror, T. Gamblin, B. R. de Supinski, N. Maruyama, and S. Matsuoka, "Design and Modeling of a Non- Blocking Checkpoint System," in ATIP - A*CRC Workshop on Accelerator Technologies in High Performance Computing, May 2012.
17. A. Yoo, M. Jette, and M. Grondona, "Slurm: Simple linux utility for resource management," in Job Scheduling Strategies for Parallel Processing, ser. Lecture Notes in Computer Science, D. Feitelson, L. Rudolph, and U. Schwiegelshohn, Eds. Springer Berlin Heidelberg, 2003, vol. 2862, pp. 44-60. [Online]. Available: http://dx.doi.org/10. 1007/10968987 3
18. R. Himeno, "Himeno Benchmark," http://accc.riken. jp/HPC e/himenobmt e.html.
19. G. E. Fagg and J. Dongarra, "FT-MPI: Fault Tolerant MPI, Supporting Dynamic Applications in a Dynamic World," in Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. London, UK, UK: Springer-Verlag, 2000, pp. 346-353. [Online]. Available: http://portal.acm.org/citation.cfm?id=746632
20. W. Bland, A. Bouteiller, T. Herault, J. Hursey, G. Bosilca, and J. J. Dongarra, "An evaluation of user-level failure mitigation support in mpi," in Proceedings of the 19th European conference on Recent Advances in the Message Passing Interface, ser. EuroMPI'12. Berlin, Heidelberg: Springer-Verlag, 2012, pp. 193-203. [Online]. Available: http://dx.doi.org/10. 1007/978-3-642-33518-1 24
21. Q. Gao, W. Yu, W. Huang, and D. K. Panda, "Application-transparent checkpoint/restart for mpi programs over infiniband," in In ICPP'06: Proceedings of the 35th International Conference on Parallel Processing. IEEE Computer Society, 2006, pp. 471-478.
22. S. Sankaran, J. M. Squyres, B. Barrett, and A. Lumsdaine, "The lam/mpi checkpoint/restart framework: System-initiated checkpointing," in in Proceedings, LACSI Symposium, Sante Fe, 2003, pp. 479-493.
23. C. Huang, O. Lawlor, and L. V. Kal, "Adaptive mpi," in In Proceedings of the 16th International Workshop on Languages and Compilers for Parallel Computing (LCPC 03, 2003, pp. 306-322.
24. G. Zheng, L. Shi, and L. V. Kale, "FTC-Charm++: An In- Memory Checkpoint-Based Fault Tolerant Runtime for Charm++ and MPI," in Proceedings of the 2004 IEEE International Conference on Cluster Computing, ser. CLUSTER '04. Washington, DC, USA: IEEE Computer Society, 2004, pp. 93-103. [Online]. Available: http://portal.acm.org/citation.cfm?id=1111712
25. L. A. Gomez, N. Maruyama, F. Cappello, and S. Matsuoka, "Distributed Diskless Checkpoint for Large Scale Systems," in Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on. IEEE, May 2010, pp. 63-72. [Online]. Available: http://dx.doi.org/10.1109/ccgrid.2010.40
26. J. S. Plank, K. Li, and M. A. Puening, "Diskless Checkpointing," IEEE Trans. Parallel Distrib. Syst., vol. 9, no. 10, pp. 972-986, Oct. 1998. [Online]. Available: http://dx.doi.org/10.1109/71.730527
27. I. Stoica, R. Morris, D. Karger, M. F. Kaashoek, and H. Balakrishnan, "Chord: A scalable peer-to-peer lookup service for internet applications," in Proceedings of the 2001 conference on Applications, technologies, architectures, and protocols for computer communications, ser. SIGCOMM '01. New York, NY, USA: ACM, 2001, pp. 149-160. [Online]. Available: http://doi.acm.org/10.1145/383059.383071