Toward exascale resilience

International Journal of High Performance Computing Applications

Volumn 23, Issue 4, 2009, Pages 374-388

  Cappello, Franck ^a   Geist, Al ^b   Gropp, Bill ^c   Kale, Laxmikant ^c   Kramer, Bill ^d   Snir, Marc ^c  

^a INRIA   (France)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

^c University of Illinois at Urbana Champaign   (United States)

^d LAWRENCE BERKELEY NATIONAL LABORATORY   (United States)

Author keywords

Challenge; Exascale; Fault tolerance; High performance computing; Resilience

Indexed keywords

APPLICATION LEVEL; CENTRAL PROCESSING UNITS; CHECK POINTING; CHECKPOINT/RESTART; DISTRIBUTED SYSTEMS; EXASCALE; HIGH PERFORMANCE COMPUTING SYSTEMS; HIGH-PERFORMANCE COMPUTING; LARGE SYSTEM; MEAN TIME TO FAILURE; NEW APPROACHES; PETASCALE; PROGRAMMING MODELS; RESEARCH ISSUES; SYSTEM MANAGEMENT; WHITE PAPERS;

COMPUTER SCIENCE; FAULT TOLERANCE; PROGRAM PROCESSORS; QUALITY ASSURANCE;

FAULT TOLERANT COMPUTER SYSTEMS;

EID: 70450206305     PISSN: 10943420     EISSN: 17412846     Source Type: Journal    
DOI: 10.1177/1094342009347767     Document Type: Article

References (44)

1. Avizienis, A., Laprie, J.-C., Randell, B. and Landwehr, C. (2004). Basic concepts and taxonomy of dependable and secure computing. IEEE Trans. Dependable Secure Comput. 1: 11-33.
2. Bouteiller, A., Bosilca, G. and Dongarra, J. (2008). Redesigning the message logging model for high performance. In Proceedings of the International Supercomputing Conference (ISC 2008), Dresden, Germany, June.
3. Blum, M. and Kannan, S. (1995). Designing programs that check their work. J. ACM 42(1): 269-291.
4. BLCR. http://ftg.lbl.gov/CheckpointRestart/CheckpointRestart.shtml2009 (Accessed: September 2 2009)
5. Bronevetsky, G., Marques, D., Pingali, K. and Stodghill, P. (2003). C3: A system for automating application-level checkpointing of MPI programs. In Proceedings of the 16th International Workshop on Languages and Compilers for Parallel Computing (LCPC 2003), October.
6. Chen, Z. (2008). Extending algorithm-based fault tolerance to tolerate fail-stop failures in high performance distributed environments. In proceedings of the IEEE Parallel and Distributed Processing Symposium, April, pp. 1-8.
7. Wang, C., Mueller, F., Engelmann, C. and Scott, S.L. (2008). Proactive process-level live migration in HPC environments. In Proceedings of Supercomputing 2008, Tampa.
8. CIFT. http://www.mcs.anl.gov/research/cifts/index.php2009 (Accessed: September 2 2009)
9. Chandy, K.M. and Lamport, L. (1985). Distributed snapshots: Determining global states of distributed systems. ACM Trans. Comput. Syst. 3(1): 63-75.
10. Chakravorty, S., Mendes, C. and Kale, L.V. (2005). Proactive fault tolerance in large systems. HPCRI Workshop in conjunction with HPCA 2005.
11. Lu, C. and Reed, D.A. (2004). Assessing fault sensitivity in MPI applications. In Proceedings of the 2004 ACM/IEEE conference on Supercomputing.
12. CSCL. http://www.cs.wisc.edu/condor/manual/v6.8/ 4_2Condor_s_Checkpoint.html2009 (Accessed: September 2 2009)
13. Dijkstra, E.W. (1974). Self-stabilizing systems in spite of distributed control. Commun. ACM 17(11), 643-644.
14. Elnozahy, E.N., Alvisi, L., Wang, Y.-M. and Johnson, D.B. (2002). A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv. 34(3): 375-408.
15. Endsley, M.R. (1995). Toward a theory of situation awareness in dynamic systems. Human Factors 37(1), 32-64.
16. Engelman, C. and Geist, A. (2005). Super-scalable algorithms for computing on 100,000 processors. In Proceedings of the International Conference on Computational Science, May.
17. FT-MPI. http://icl.cs.utk.edu/ftmpi/2009
18. Glosli, J.N., Richards, D.F., Caspersen, K.J., Rudd, R.E., Gunnels, J.A. and Streitz, F.H. (2007). Extending stability beyond CPU millennium: A micron-scale atomistic simulation of Kelvin-Helmholtz instability, a micronscale atomistic simulation of Kelvin-Helmholtz instability. In Proceedings of the 2007 ACM/IEEE conference on Supercomputing, Reno.
19. Geist, A. and Engelmann, C. (2002). Development of naturally fault tolerant algorithms for computing on 100,000 processors. http:// www.csm.ornl.gov/~geist/Lyon2002-geist.pdf.
20. Huang, K. and Abraham, J. (1984). Algorithm-based fault tolerance for matrix operations. IEEE Trans. Comput. C-33(6): 518-528.
21. Kramer, W. et al. (2007). Report of the workshop on petascale systems integration for large scale facilities. LBNL Technical Report Number 63538. Lawrence Berkeley National Laboratory, http:// repositories.cdlib.org/lbnl/LBNL-63538.
22. Kramer, W. (2008). PERCU: A holistic method for evaluating high performance computing systems. Dissertation, University of California Berkeley.
23. LAM/MPI. http://www.lam-mpi.org/2009 (Accessed: September 2 2009)
24. Liu, G.-R. (2002). Mesh Free Methods: Moving Beyond the Finite Element Method. Boca Raton: CRC Press, ISBN 0849312388.
25. Libckpt. http://www.cs.utk.edu/~plank/plank/www./libckpt.html2009 (Accessed: September 2 2009)
26. Lu, C.D. (2005). Scalable diskless checkpointing for large parallel systems. Ph.D. dissertation, University of Illinois at Urbana-Champaign.
27. Bosilca, G., Bouteiller, A., Cappello, F., Djilali, S., Fédak, G., Germain, C., Hérault, T. and Lemarinier, P. (2002). MPICH-V: toward a scalable fault tolerant MPI for volatile nodes. In Proceedings of SuperComputing 2002. IEEE, November, http://mpich-v.lri.fr/.
28. MVAPICH. http://mvapich.cse.ohio-state.edu/overview/mvapich/2009 (Accessed: September 2 2009)
29. Nagaraja, K., Li, X., Bianchini, R., Martin, R. and Nguyen, T.D. (2003). Using fault Injection and modeling to evaluate the performability of cluster based services. In Proceedings of the 4th USENIX Symposium on Internet Technologies and Systems, Seattle, WA, March.
30. OpenMPI. http://www.open-mpi.org/.2009 (Accessed: September 2 2009)
31. Oliner, A. and Stearley, J. (2007). What supercomputers say: A study of five system logs. In Proceedings of the International Conference on Dependable Systems and Networks (DSN).
32. PDSI. http://pdsi.nersc.gov2009 (Accessed: September 2 2009)
33. Plank, J., Li, K. and Puening, M. (1998). Diskless checkpointing. IEEE Trans. Parallel Distr. Syst. 9(10): 972-986.
34. Plank, J.S., Chen, Y., Li, K., Beck, M. and Kingsley, G. (1999). Memory exclusion: Optimizing the performance of checkpointing systems. Software Pract. Ex. 29(2): 125-142.
35. Qin, F., Tucek, J., Sundaresan, J. and Zhou, Y. (2005). Rx: Treating bugs as allergies-a safe method to survive software failure. In Proceedings of the 20th ACM Symposium on Operating Systems Principles (SOSP'05), October.
36. Sahoo, R.K., Bae, M., Vilalta, R., Moreira, J., Ma, S. and Gupta, M. (2002). Providing persistent and consistent resources through event log analysis and predictions for large-scale computing systems. In Proceedings of IEEE/ACM Supercomputing 2002.
37. Liang, Y., Zhang Morris Jette, Y. and Sivasubramaniam Ramendra Sahoo, A. (2006). BlueGene/L failure analysis and prediction models. In Proceedings of IEEE DSN.
38. Chakravorty, S., Mendes, C.L. and Kale, L.V. (2006). Proactive fault tolerance in MPI Applications via task migration. In Proceedings of HIPC 2006, LNCS, volume 4297, p. 485.
39. Scott, S., Engelmann, C., Vallee, G., Naughton, T., Tikotekar, A., Ostrouchov, G., Leangsuksun, C., Naksinehaboon, N., Nassar, R., Paun, M., Mueller, F., Wang, C., Nagarajan, A. and Varma, J. (2009). A tunable holistic resiliency approach for high-performance computing systems. Poster in Proceedings of the 14th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP), Raleigh, NC, USA.
40. SCR. http://scalablecr.sourceforge.net/2009 (Accessed: September 2 2009)
41. Schroeder, B. and Gibson, G. (2007). Understanding failures in petascale computers. J Phys. Conf. 78: 012022. Teodorescu, R., Nakano, J. and Torrellas, J. (2006). SWICH: A prototype for efficient cache-level checkpointing and rollback. IEEE Micro. 26(5): 28-40.
42. Von Neuman, J. (1956). Probabilistic logics and the synthesis of reliable organisms from unreliable components. In Automata studies, edited by C. E. Shannon and J. McCarthy. New Jersey: Princeton University Press, pp. 43-98.
43. Yawei Li, Prashasta Gujrati, Zhiling Lan, Xian-he Sun, "Fault-Driven Re-Scheduling For Improving System-level Fault Resilience", in Proceedings of ICPP 2007.
44. Zheng, G., Shi, L. and Kale, L.V. (2004). FTC-Charm++: An in-memory checkpoint-based fault tolerant runtime for Charm++ and MPI. In Proceedings of the 2004 IEEE International Conference on Cluster Computing, San Diego, CA, September, pp. 93-103.