Evaluating the viability of process replication reliability for exascale systems

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Ferreira, Kurt ^a   Stearley, Jon ^a   Laros, James H ^a   Oldfield, Ron ^a   Pedretti, Kevin ^a   Brightwell, Ron ^a   Riesen, Rolf ^b   Bridges, Patrick G ^c   Arnold, Dorian ^c  

^a SANDIA NATIONAL LABORATORIES   (United States)

^b IBM RESEARCH   (United States)

^c University of New Mexico   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION SCALABILITY; CHECK POINTS; COMPUTING TECHNIQUES; COSTS AND BENEFITS; EMPIRICAL ANALYSIS; FAILURE DISTRIBUTIONS; FAULT TOLERANCE MECHANISMS; HIGH-END COMPUTING; I/O BANDWIDTH; MEAN TIME TO FAILURE; MISSION CRITICAL SYSTEMS; STATE MACHINE; STATE MACHINE REPLICATION; TIME-TO-SOLUTION;

COMPUTER SOFTWARE SELECTION AND EVALUATION; DISTRIBUTED COMPUTER SYSTEMS;

FAULT TOLERANCE;

EID: 83155188951     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063443     Document Type: Conference Paper

References (41)

1. AHN, J. 2-step algorithm for enhancing effectiveness of sender-based message logging. In SpringSim'07: Proceedings of the 2007 spring simulation multiconference (2007), pp. 429-434.
2. AMARASINGHE, S., AND ET AL. Exascale software study: Software challenges in extreme scale systems. http://users.ece.gatech.edu/mrichard/ ExascaleComputingStudyReports/ECSS%20report%20101909.pdfSept. 2009.
3. BARTLETT, J. F. A nonstop kernel. In SOSP'81: Proceedings of the eighth ACM symposium on Operating systems principles (1981), pp. 22-29.
4. BERGMAN, K., BORKAR, S., CAMPBELL, D., CARLSON, W., DALLY, W., DENNEAU, M., FRANZON, P., HARROD, W., HILL, K., HILLER, J., KARP, S., KECKLER, S., KLEIN, D., KOGGE, P., LUCAS, R., RICHARDS, M., SCARPELLI, A., SCOTT, S., SNAVELY, A., STERLING, T., WILLIAMS, R. S., AND YELICK, K. Exascale computing study: Technology challenges in achieving exascale systems. http://www.science.energy. gov/ascr/Research/CS/DARPAexascale-hardware(2008).pdf, Sept. 2008.
5. BRIGHTWELL, R., FERREIRA, K. B., AND RIESEN, R. Transparent redundant computing with mpi. In EuroMPI (2010), R. Keller, E. Gabriel, M. M. Resch, and J. Dongarra, Eds., vol. 6305 of Lecture Notes in Computer Science, Springer, pp. 208-218.
6. CAPPELLO, F. Fault tolerance in petascale/exascale systems: Current knowledge, challenges and research opportunities. IJHPCA 23, 3 (2009), 212-226.
7. CASTRO, M., AND LISKOV, B. Practical byzantine fault tolerance and proactive recovery. ACM Transactions on Computer Systems (TOCS) 20, 4 (Nov. 2002), 398-461. (Pubitemid 135702591)
8. CHAKRAVORTY, S., AND KALÉ, L. V. A fault tolerant protocol for massively parallel systems. In Proceedings of the International Parallel and Distributed Processing Symposium (Santa Fe, NM USA, April 2004), IEEE Computer Society Press.
9. CHAPIN, J., ROSENBLUM, M., DEVINE, S., LAHIRI, T., TEODOSIU, D., AND GUPTA, A. Hive: fault containment for shared-memory multiprocessors. In SOSP'95: Proceedings of the fifteenth ACM symposium on Operating systems principles (New York, NY, USA, 1995), ACM, pp. 12-25.
10. DALY, J. T. A higher order estimate of the optimum checkpoint interval for restart dumps. Future Gener. Comput. Syst. 22, 3 (2006), 303-312. (Pubitemid 41689812)
11. E. S. HERTEL, J., BELL, R. L., ELRICK, M. G., FARNSWORTH, A. V., KERLEY, G. I., MCGLAUN, J. M., PETNEY, S. V., SILLING, S. A., TAYLOR, P. A., AND YARRINGTON, L. CTH: A software family for multi-dimensional shock physics analysis. In Proceedings of the 19th International Symposium on Shock Waves (July 1993), pp. 377-382.
12. ELNOZAHY, E., AND PLANK, J. Checkpointing for peta-scale systems: a look into the future of practical rollback-recovery. Dependable and Secure Computing, IEEE Transactions on 1, 2 (Apr. 2004), 97-108.
13. ELNOZAHY, E. N. M., ALVISI, L., WANG, Y.-M., AND JOHNSON, D. B. A survey of rollback-recovery protocols in message-passing systems. ACM Comput. Surv. 34, 3 (2002), 375-408.
14. th IASTED International Conference on Parallel and Distributed Computing and Networks (PDCN) 2009 (Innsbruck, Austria, Feb. 16-18, 2009), ACTA Press, Calgary, AB, Canada, pp. 189-194.
15. FERREIRA, K., RIESEN, R., OLDFIELD, R., STEARLEY, J., III, J. H. L., Pedretti, K., and Brightwell, R. rMPI: Increasing fault resiliency in a message-passing environment. Technical Report SAND2011-2488, Sandia National Laboratories, 2011.
16. GÄRTNER, F. C. Fundamentals of fault-tolerant distributed computing in asynchronous environments. ACM Computing Surveys 31, 1 (March 1999), 1-26.
17. GUERMOUCHE, A., ROPARS, T., BRUNET, E., SNIR, M., AND CAPPELLO, F. Uncoordinated checkpointing without domino effect for send-deterministic message passing applications. In Proceedings of the 2011 IEEE International Parallel and Distributed Processing Symposium (May 2011).
18. HACKER, T. J., ROMERO, F., AND CAROTHERS, C. D. An analysis of clustered failures on large supercomputing systems. J. Parallel Distrib. Comput. 69 (July 2009), 652-665.
19. HOLST, L. The general birthday problem. In Random Graphs 93: Proceedings of the sixth international seminar on Random graphs and probabilistic methods in combinatorics and computer science (New York, NY, USA, 1995), John Wiley & Sons, Inc., pp. 201-208.
20. JIANG, Q., AND MANIVANNAN, D. An optimistic checkpointing and selective approach for consistent global checkpoint collection in distributed systems. In Proceedings of the 2007 IEEE International Parallel and Distributed Processing Symposium (Mar. 2007).
21. JOHNSON, D. B., AND ZWAENEPOEL, W. Recovery in distributed systems using asynchronous and checkpointing. In Proceedings of the seventh annual ACM Symposium on Principles of distributed computing (1988), pp. 171-181.
22. KERBYSON, D. J., ALME, H. J., HOISIE, A., PETRINI, F., WASSERMAN, H. J., AND GITTINGS, M. Predictive performance and scalability modeling of a large-scale application. In Proceedings of the ACM/IEEE conference on Supercomputing (2001), pp. 37-48.
23. LAMPORT, L. Time, clocks, and the ordering of events in a distributed system. Commun. ACM 21, 7 (1978), 558-565. (Pubitemid 8615486)
24. MATHIS, F. H. A generalized birthday problem. SIAM Review 33, 2 (1991), 265-270.
25. MATTSON, T. G., AND HENRY, G. An overview of the Intel TFLOPS supercomputer. Intel Technology Journal, Q1 (1998), 12.
26. MCEVOY, D. The architecture of tandem's nonstop system. In ACM'81: Proceedings of the ACM'81 conference (New York, NY, USA, 1981), ACM, p. 245.
27. MOODY, A., BRONEVETSKY, G., MOHROR, K., AND SUPINSKI, B. R. D. Design, modeling, and evaluation of a scalable multi-level checkpointing system. In Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis (Washington, DC, USA, 2010), SC'10, IEEE Computer Society, pp. 1-11.
28. OLDFIELD, R. A., ARUNAGIRI, S., TELLER, P. J., SEELAM, S., VARELA, M. R., RIESEN, R., AND ROTH, P. C. Modeling the impact of checkpoints on next-generation systems. In 24th IEEE Conference on Mass Storage Systems and Technologies (Sept. 2007), pp. 30-46.
29. OLINER, A. J., SAHOO, R. K., MOREIRA, J. E., AND GUPTA, M. Performance implications of periodic checkpointing on large-scale cluster systems. In Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 18 (2005), p. 299-2.
30. PACKARD, H. HP NonStop computing. http://h20338.www2.hp.com/ NonStopComputing/cache/76385-0-0-0-121.html.
31. PEDRETTI, K. T., VAUGHAN, C., HEMMERT, K. S., AND BARRETT, B. Application sensitivity to link and injection bandwidth on a Cray XT4 system. In Proceedings of the 2005 Cray User Group Annual Technical Conference (Helsinki, Finland, May 2008).
32. PLANK, J. S., KIM, Y. B., AND DONGARRA, J. J. Algorithm-based diskless checkpointing for fault tolerant matrix operations. In Twenty-Fifth International Symposium on Fault-Tolerant Computing. Digest of Papers (Pasadena, CA, USA, June 1995), Los Alamitos, CA, USA : IEEE Comput. Soc. Press, 1995, pp. 351-360.
33. PLIMPTON, S. J. Fast parallel algorithms for short-range molecular dynamics. J Comp Phys 117, 1 (1995), 1-19.
34. Sandia National Laboratory. LAMMPS molecular dynamics simulator. http://lammps.sandia.gov, Apr. 10 2010.
35. Sandia National Laboratory. Mantevo project home page. https://software.sandia.gov/mantevo, Apr. 10 2010.
36. SCHNEIDER, F. Implementing fault-tolerant services using the state machine approach: A tutorial. ACM Computing Surveys 22, 4 (1990), 299-319.
37. SCHROEDER, B., AND GIBSON, G. A. A large-scale study of failures in high-performance computing systems. In Proceedings of the International Conference on Dependable Systems and Networks (DSN2006) (June 2006).
38. SCHROEDER, B., AND GIBSON, G. A. Understanding failures in petascale computers. Journal of Physics: Conference Series 78, 1 (2007), 012022.
39. SILVA, L. M., AND SILVA, J. G. An experimental study about diskless checkpointing. In 24th EUROMICRO Conference (Vasteras, Sweden, August 1998), IEEE Computer Society Press, pp. 395 - 402.
40. UHLEMANN, K., ENGELMANN, C., AND SCOTT, S. Joshua: Symmetric active/active replication for highly available hpc job and resource management. In Proceedings of the 2006 IEEE International Conference on Cluster Computing (Los Alamitos, CA, USA, 2006), IEEE Computer Society.
41. ZHENG, Z., AND LAN, Z. Reliability-aware scalability models for high performance computing, . In Cluster'09: Proceedings of the IEEE conference on Cluster Computing (2009).