Addressing failures in exascale computing

International Journal of High Performance Computing Applications

Volumn 28, Issue 2, 2014, Pages 129-173

  Snir, Marc ^a   Wisniewski, Robert W ^b   Abraham, Jacob A ^c   Adve, Sarita V ^d   Bagchi, Saurabh ^e   Balaji, Pavan ^a   Belak, Jim ^f   Bose, Pradip ^g   Cappello, Franck ^a   Carlson, Bill ^h   Chien, Andrew A ⁱ   Coteus, Paul ^g   Debardeleben, Nathan A ^j   Diniz, Pedro C ^k   Engelmann, Christian ^l   Erez, Mattan ^c   Fazzari, Saverio ^m   Geist, Al ^l   Gupta, Rinku ^a   Johnson, Fred ⁿ   Krishnamoorthy, Sriram ^o   Leyffer, Sven ^a   Liberty, Dean ^p   Mitra, Subhasish ^q   Munson, Todd ^a   Schreiber, Rob ^r   Stearley, Jon ^s   Hensbergen, Eric Van ^t   more..

^a ARGONNE NATIONAL LABORATORY   (United States)

^b INTEL CORPORATION   (United States)

^c UNIVERSITY OF TEXAS AT AUSTIN   (United States)

^d UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^e PURDUE UNIVERSITY   (United States)

^f LAWRENCE LIVERMORE NATIONAL LABORATORY   (United States)

^g IBM T J WATSON RESEARCH CENTER   (United States)

^h IDA Center for Computing Sciences   (United States)

ⁱ UNIVERSITY OF CHICAGO   (United States)

^j LOS ALAMOS NATIONAL LABORATORY   (United States)

^k UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

^l OAK RIDGE NATIONAL LABORATORY   (United States)

^m BOOZ ALLEN HAMILTON   (United States)

ⁿ SCIENCE APPLICATIONS INTERNATIONAL CORPORATION   (United States)

^o PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

^p ADVANCED MICRO DEVICES   (United States)

^q STANFORD UNIVERSITY   (United States)

^r HEWLETT PACKARD COMPANY   (United States)

^s SANDIA NATIONAL LABORATORIES   (United States)

^t ARM Inc   (United States)

more..

Author keywords

exascale; extreme scale computing; fault tolerance; high performance computing; Resilience

Indexed keywords

APPLICATION PROGRAMS; FAULT TOLERANCE;

COMPUTING SYSTEM; EXASCALE; EXASCALE COMPUTING; EXTREME-SCALE COMPUTING; HARDWARE AND SOFTWARE; HIGH-PERFORMANCE COMPUTING; RESILIENCE; SYSTEM SOFTWARES;

HARDWARE;

EID: 84900560822     PISSN: 10943420     EISSN: 17412846     Source Type: Journal    
DOI: 10.1177/1094342014522573     Document Type: Article

References (168)

1. Agostinelli M, Pae S, Yang W, et al. Random charge effects for PMOS NBTI in ultra-small gate area devices. Proceedings of the 2005 IEEE international reliability physics symposium (IRPS). 2005 ;: 529-532
2. Ahn DH, Supinski BRD, Laguna I, et al. Scalable temporal order analysis for large scale debugging. ; 2009 ; 2009..
3. Austin TM. DIVA: A reliable substrate for deep submicron microarchitecture design. Proceedings of the annual international symposium on microarchitecture (MICRO). 1999 ;: 196-207
4. Avizienis A. Arithmetic algorithms for error-coded operands. IEEE Transactions on Computers. 1973 ; C-22 (6). 567-572
5. Aviienis A, Laprie J, Randell B, et al. Basic concepts and taxonomy of dependable and secure computing. IEEE Transactions on Dependable and Secure Computing. 2004 ; 1 (1). 11-33
6. Avritzer A, Bondi A, Grottke M, et al. Performance assurance via software rejuvenation: Monitoring, statistics and algorithms. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2006 ;: 435-444
7. BaileyFRBellGBlondinJ. (2007) Petascale metrics panel report. Available at: http://research.microsoft.com/en-us/um/people/gbell/supers/ascac-petascale- metrics-panel-report-and-executive-summary-2007-02-12.pdf (accessed 25 February 2014)
8. Ballesteros FJ, Evans N, Forsyth C, et al. Nix: A case for a manycore system for cloud computing. Bell Labs Technical Journal. 2012 ; 17 (2). 41-54
9. Banerjee P, Abraham J. Bounds on algorithm-based fault tolerance in multiple processor systems. IEEE Transactions on Computers. 1986 ; C-35: 4 296-306
10. Banerjee P, Rahmeh J, Stunkel C, et al. Algorithm-based fault tolerance on a hypercube multiprocessor. IEEE Transactions on Computers. 1990 ; 39 (9). 1132-1145
11. Bautista-Gomez LA, Tsuboi S, Komatitsch D, et al. FTI: High performance fault tolerance interface for hybrid systems. International conference for high-performance computing, networking, storage and analysis (SC). 2011a ;:
12. Bautista-Gomez L, Komatitsch D, Maruyama N, et al. FTI: High performance fault tolerance interface for hybrid systems. International conference for high-performance computing, networking, storage and analysis (SC). 2011b ;:
13. Birge J, Louveaux F Introduction to Stochastic Programming. Berlin: Springer Verlag ; 1997 :
14. Bland W, Bouteiller A, Herault T, et al Recent Advances in the Message Passing Interface. Träff J Benkner S Dongarra J, ed. New York, NY: Springer ; 2012: 193-203.
15. Borkar S. Designing reliable systems from unreliable components: The challenges of transistor variability and degradation. IEEE Micro. 2005 ; 25 (6). 10-16
16. Bosilca G, Delmas R, Dongarra J, et al. Algorithm-based fault tolerance applied to high performance computing. Journal of Parallel and Distributed Computing. 2009 ; 69 (4). 410-416
17. Bouteiller A, Herault T, Bosilca G, et al Euro-Par 2011: Parallel Processing Workshops. Jeannot E Namyst R Jean R, ed. New York, NY: Springer ; 2011: 51-64.
18. Bouteiller A, Herault T, Krawezik G, et al. MPICH-V project: A multiprotocol automatic fault-tolerant MPI. International Journal of High Performance Computing Applications. 2006 ; 20 (3). 319-333
19. Bower F, Sorin D, Ozev S. Online diagnosis of hard faults in microprocessors. ACM Transactions on Architecture and Code Optimization. 2007 ; 4 ( 2 ):
20. Bronevetsky G, Laguna I, Bagchi S, et al. AutomaDeD: Automata-based debugging for dissimilar parallel tasks. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2010 ;: 231-240
21. Cai K, Qin Z. Memory Device with Soft-Decision Decoding.. :
22. Cappello F, Geist A, Gropp B, et al. Toward exascale resilience. International Journal of High Performance Computing Applications. 2009 ; 23 (4). 374-388
23. Cappello F, Guermouche A, Snir M. On communication determinism in parallel HPC applications. Proceedings of the 19th international conference on computer communications and networks (ICCCN). 2010 ;: 1-8
24. Carulli J, Anderson T IEEE Workshop on Silicon Errors in Logic-System Effects. Stanford University, CA ; 2005 :
25. Castelli V, Harper RE, Heidelberger P, et al. Proactive management of software aging. IBM Journal of Research and Development. 2001 ; 45 (2). 311-332
26. Chan JTY, Tseng CW, Chu YC, et al. Experimental results for IDDQ and VLV testing. Proceedings of the IEEE VLSI test symposium. 1998 ;: 118-125
27. Chen D, Eisley NA, Heidelberger P, et al. The IBM Blue Gene/Q interconnection network and message unit. International conference for high-performance computing, networking, storage and analysis (SC). 2011 ;:
28. Chen Z, Dongarra J. Algorithm-based checkpoint-free fault tolerance for parallel matrix computations on volatile resources. Proceedings of the 20th international parallel and distributed processing symposium (IPDPS). 2006 ;:
29. Chow P Stochastic Partial Differential Equations. Boca Raton/ London/ New York: Chapman & Hall/CRC ; 2007 :
30. Chung J, Lee I, Sullivan M, et al. Containment domains: A scalable, efficient, and flexible resilience scheme for exascale systems. International conference for high-performance computing, networking, storage and analysis (SC). 2012 ;:
31. Conn AR, Gould NI, Toint PL Trust-Region Methods. Philadelphia, PA: Society for Industrial and Applied Mathematics ; 1987 :
32. DalyJAdolfBBorkarS. (2012) Inter agency workshop on HPC resilience at extreme scale. Available at: http://institutes.lanl.gov/resilience/docs/Inter- AgencyResilienceReport.pdf (accessed 25 February 2014).
33. Daly JT. A higher order estimate of the optimum checkpoint interval for restart dumps. Future Generation Computer Systems. 2006 ; 22 (3). 303-312
34. Dean J, Ghemawat S. MapReduce: Simplified data processing on large clusters. Communications of the ACM. 2008 ; 51 (1). 107-113
35. DeBardelebenNLarosJDalyJ. (2010b) High-end computing resilience: Analysis of issues facing the HEC community and path-forward for research and development. Technical Report LA-UR-10-00030, DARPA, VA. available at http://www.csm.ornl.gov/∼engelman/publications/debardeleben09high-end 2/25/14
36. DeHonACarterNQuinnH (eds) (2011) Final report for CCC cross-layer reliability visioning study. 3 March Available at: http://xlayer.org/FinalReport (accessed 25 February 2014).
37. Dimitrov M, Zhou H. Unified architectural support for soft-error protection or software bug detection. Proceedings of the conference on parallel architecture and compilation techniques. 2007 ;: 73-82
38. DixitAHealdRWoodA (2009) Trends from ten years of soft error experimentation. In: The workshop on silicon Available at: http://softerrors. info/selse/images/selse-2009/Papers/selse5-submission-29.pdf (acessed 25 February 2014).
39. Dongarra J, Beckman P, Moore T, et al. The international exascale software project roadmap International Journal of High Performance Computing Applications.. 2011 ; 25 (1). 3-60
40. Downing R, Nowak J, Tuomenoksa L. No. 1 ESS maintenance plan. Bell System Technical Journal. 1964 ; 43 (5). 1961-2019
41. Du P, Bouteiller A, Bosilca G, et al. Algorithm-based fault tolerance for dense matrix factorizations. Proceedings of the 17th ACM SIGPLAN symposium on principles and practice of parallel programming. 2012 ;: 225-234
42. Elnozahy ENM, Alvisi L, Wang YM, et al. A survey of rollback-recovery protocols in message-passing systems. ACM Computing Surveys. 2002 ; 34 (3). 375-408
43. Elnozahy (editor) System Resilience at Extreme Scale White Paper available at http://citeseerx.ist.psu.edu/viewdoc/download?rep=rep1&type= pdf&doi=10.1.1.205.4240accessed 2/25/14
44. EMC (2014) Smarts: Automated IT management enabling service assurance. Available at: http://www.emc.com/it-management/smarts/index.htm (accessed 25 February 2014).
45. Ernst MD, Perkins JH, Guo PJ, et al. The Daikon system for dynamic detection of likely invariants. Science of Computer Programming. 2007 ; 69 (1). 35-45
46. FaddenS (2012) An introduction to GPFS version 3.5. Available at: www-03.ibm.com/systems/jo/resources/introduction-to-gpfs-3-5.pdf (accessed 25 February 2014).
47. Fagg G, Dongarra J Recent Advances in Parallel Virtual Machine and Message Passing Interface. Dongarra J, ed. Berlin/Heidelberg: Lecture Notes in Computer Science Springer ; 2000: 346-353.
48. Feng S, Gupta S, Ansari A, et al. Shoestring: Probabilistic soft error reliability on the cheap. Proceedings of the international conference on architectural support for programming languages and operating systems (ASPLOS). 2010 ;: 385-396
49. Ferreira KB, Stearley J, Laros JH, et al. Evaluating the viability of process replication reliability for exascale systems. International conference for high-performance computing, networking, storage and analysis (SC). 2011 ;:
50. Fletcher R Constrained Optimization New York, NY John Wiley & Sons ; 1981 :
51. Fujita H, Schreiber R, Chien AA. It's time for new programming models for unreliable hardware. Proceedings of the international conference on architectural support for programming languages and operating systems (ASPLOS). 2013 ;:
52. Gainaru A, Cappello F, Kramer W. Taming of the shrew: Modeling the normal and faulty behavior of large-scale HPC systems. Proceedings of the IEEE international parallel & distributed processing symposium (IPDPS). 2012a ;:
53. Gainaru A, Cappello F, Fullop J, et al. Adaptive event prediction strategy with dynamic time window for large-scale HPC systems. Proceedings of managing large-scale systems via the analysis of system logs and the application of machine learning techniques (SLAM'11). 2011a ; 4: 1-4
54. Gainaru A, Cappello F, Snir M, et al. Fault prediction under the microscope: A closer look into HPC systems. International conference for high-performance computing, networking, storage and analysis (SC). 2012b ;:
55. Gainaru A, Cappello F, Trausan-Matu S, et al Euro-Par 2011: Parallel Processing Workshops. Alexander M D'Ambra P Belloum A, ed. NY: Springer ; 2011b :
56. Gao B, Zhang H, Chen B, et al. Modeling of retention failure behavior in bipolar oxide-based resistive switching memory. IEEE Electron Device Letters. 2011 ; 32 (3). 276-278
57. Gao Q, Qin F, Panda DK. DMTracker: Finding bugs in large-scale parallel programs by detecting anomaly in data movements. International conference for high-performance computing, networking, storage and analysis (SC). 2007 ;:
58. Gao Q, Zhang W, Qin F. FlowChecker: Detecting bugs in MPI libraries via message flow checking. International conference for high-performance computing, networking, storage and analysis (SC). 2010 ;:
59. Gattiker A, Nigh P, Grosch D, et al. Current signatures for production testing [CMOS ICs]. IEEE international workshop on IDDQ testing. 1996 ;: 25-28
60. Geist A, Lucas B, Snir M, et al Technical report, U.S. Department of Energy, DC ; 2012 :
61. Gill B, Seifert N, Zia V. Comparison of alpha-particle and neutron-induced combinational and sequential logic error rates at the 32nm technology node. IEEE international reliability physics symposium. 2009 ;: 199-205
62. Goloubeva O, Rebaudengo M, Reorda MS, et al. Soft-error detection using control flow assertions. Proceedings of the international symposium on defect and fault tolerance in VLSI systems. 2003 ;: 581-588
63. Griewank A, Corliss G Automatic Differentiation of Algorithms: Theory, Implementation, and Application. Philadelphia, PA: Society for Industrial and Applied Mathematics ; 1991 :
64. Grottke M, Trivedi KS. Fighting bugs: Remove, retry, replicate, and rejuvenate. IEEE Computer. 2007 ; 40 (2). 107-109
65. Guermouche A, Ropars T, Brunet E, et al. Uncoordinated checkpointing without domino effect for send-deterministic MPI applications. IEEE international parallel & distributed processing symposium (IPDPS). 2011 ;: 989-1000
66. Guermouche A, Ropars T, Snir M, et al. HydEE: Failure containment without event logging for large scale send-deterministic MPI applications. IEEE international parallel & distributed processing symposium (IPDPS). 2012 ;: 1216-1227
67. Gunnels J, Katz D, Quintana-Orti E, et al. Fault-tolerant high-performance matrix multiplication: Theory and practice. Proceedings of the international conference on dependable systems and networks (DSN). 2001 ;: 47-56
68. Hackbusch W Multi-Grid Methods and Applications. Berlin: Springer-Verlag ; 1985 :
69. Hafner JL, Deenadhayalan V, Belluomini W, et al. Undetected disk errors in RAID arrays. IBM Journal of Research and Development. 2008 ; 52 (4.5). 413-425
70. Hamming R Numerical Methods for Scientists and Engineers. New York: Dover Publications ; 1987 :
71. Hangal S, Lam MS. Tracking down software bugs using automatic anomaly detection. Proceedings of the 2002 international conference on software engineering. 2002 ;:
72. Hao H, McCluskey E. Very-low-voltage testing for weak CMOS logic ICs. Proceedings of the IEEE international test conference (ITC). 1993 ;: 275-284
73. Hari SKS, Adve SV, Naeimi H. Low-cost program-level detectors for reducing silent data corruptions. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2012a ;:
74. Hari SKS, Adve SV, Naeimi H, et al. Relyzer: Exploiting application-level fault equivalence to analyze application resiliency to transient faults. Proceedings of the international conference on architectural support for programming languages and operating systems (ASPLOS). 2012b ;:
75. Hari SKS, Li ML, Ramachandran P, et al. mSWAT: Low-cost hardware fault detection and diagnosis for multicore systems. Proceedings of the annual international symposium on microarchitecture (MICRO). 2009 ;: 122-132
76. Hazucha P, Karnik T, Bloechel SWB, et al. Measurements and analysis of SER tolerant latch in a 90 nm dual-Vt CMOS process. IEEE custom integrated circuits conference. 2003 ;: 617-620
77. Hedges R, Loewe B, McLarty T, et al. Parallel file system testing for the lunatic fringe: The care and feeding of restless I/O power users. Proceedings of the 22nd IEEE/13th NASA Goddard conference on mass storage systems and technologies. 2005 ;: 3-17
78. Heien E, Kondo D, Gainaru A, et al. Modeling and tolerating heterogeneous failures in large parallel systems. International conference for high-performance computing, networking, storage and analysis (SC). 2011 ;:
79. Heiser G, Ryzhyk L, Von Tessin M, et al. What if you could actually trust your kernel. 13th workshop on hot topics in operating systems (HotOS). 2011 ;:
80. Hess WN, Patterson HW, Wallace R, et al. Cosmic-ray neutron energy spectrum. Physical Review. 1959 ; 116 (2). 445
81. Hogan S, Hammond J, Chien AA. An evaluation of difference and threshold techniques for efficient checkpointing. 2nd workshop on fault-tolerance for HPC at extreme scale (FTXS 2012). 2012 ;:
82. Huang KH, Abraham J. Algorithm-based fault tolerance for matrix operations. IEEE Transactions on Computers. 1984 ; C-33 (6). 518-528
83. Hunter R. Engine failure prediction techniques. Aircraft Engineering and Aerospace Technology. 1975 ; 47 (3). 4-14
84. Hwang AA, Stefanovici IA, Schroeder B. Cosmic rays don't strike twice: Understanding the nature of DRAM errors and the implications for system design. Proceedings of the international conference on architectural support for programming languages and operating systems (ASPLOS). 2012 ;: 111-122
85. Ibe E, Taniguchi H, Yahagi Y, et al. Impact of scaling on neutron-induced soft error in SRAMs from a 250 nm to a 22 nm design rule. IEEE Transactions on Electron Devices. 2010 ; 57 (7). 1527-1538
86. Katz D, Some R. NASA advances robotic space exploration. Computer. 2003 ; 36 (1). 52-61
87. Katz DS, Daly J, DeBardeleben N, et al IL: Argonne National Laboratory ; 2009 :
88. Kerbyson D, Rajamony R, Van Hensbergen E. Performance health monitoring for large-scale systems. Second international workshop on high-performance infrastructure for scalable tools. 2012 ;:
89. Kubota K, Iri M. Estimates of rounding errors with fast automatic differentiation and interval analysis. Journal of Information Processing. 1992 ; 14 (3). 508-515
90. Kundu S, Mak T, Galivanche R. Trends in manufacturing test methods and their implications. Proceedings of the international test conference (ITC). 2004 ;: 679-687
91. Laguna I, Ahn DH, de Supinski BR, et al. Probabilistic diagnosis of performance faults in large-scale parallel applications. Proceedings of the 21st international conference on parallel architectures and compilation techniques. 2012 ;: 213-222
92. Laguna I, Gamblin T, de Supinski BR, et al. Large scale debugging of parallel tasks with AutomaDeD. International conference for high-performance computing, networking, storage and analysis (SC). 2011 ;:
93. Lange J, Pedretti K, Hudson T, et al. Palacios and kitten: New high performance operating systems for scalable virtualized and native supercomputing. IEEE international symposium on parallel & distributed processing (IPDPS). 2010 ;: 1-12
94. Lee GL, Ahn DH, Arnold DC, et al. Benchmarking the stack trace analysis tool for Blue Gene/L. International conference on parallel computing: Architectures, algorithms and applications (ParCo). 2007 ;:
95. Lee GL, Ahn DH, Arnold DC, et al. Lessons learned at 208K: Towards debugging millions of cores. International conference for high-performance computing, networking, storage and analysis (SC). 2008 ;:
96. Li ML, Ramachandran P, Sahoo S, et al. Trace-based microarchitecture- level diagnosis of permanent hardware faults. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2008a ;:
97. Li ML, Ramachandran P, Sahoo S, et al. Understanding the propagation of hard errors to software and implications for resilient systems design. Proceedings of the international conference on architectural support for programming languages and operating systems (ASPLOS). 2008b ;: 265-276
98. Lindekugel K, DiGirolamo A, Stanzione D. Architecture for an offline parallel debugger. International symposium on parallel and distributed processing with applications (ISPA'08). 2008 ;: 227-235
99. Linderoth J, Wright S. Decomposition algorithms for stochastic programming on a computational grid. Computational Optimization and Applications. 2003 ; 24 (2). 207-250
100. Lo JC. Reliable floating-point arithmetic algorithms for error-coded operands. IEEE Transactions on Computers. 1994 ; 43 (4). 400-412
101. Lo J, Thanawastien S, Rao T. Concurrent error detection in arithmetic and logical operations using Berger codes. Proceedings of 9th symposium on computer arithmetic. 1989 ;: 233-240
102. Los Alamos National Lab (2006) Operational data to support and enable computer science research. Available at: http://institutes.lanl.gov/data/fdata/ (accessed 25 February 2014).
103. Lourenço J, Cunha J. Fiddle: A flexible distributed debugger architecture. International conference on computational science (ICCS). 2001 ;: 821-830
104. Lu G, Zheng Z, Chien AA. When are multiple checkpoints needed?. 3rd workshop on fault-tolerance for HPC at extreme scale (FTXS 2013). 2013 ;:
105. Lunardini D, Narasimham B, Ramachandran V, et al. A performance comparison between hardened-by-design and conventional-design standard cells. 2004 workshop on radiation effects on components and systems, radiation hardening techniques and new developments. 2004 ;:
106. Lyle G, Cheny S, Pattabiraman K, et al. An end-to-end approach for the automatic derivation of application-aware error detectors. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2009 ;: 584-589
107. Maxwell P, O'Neill P, Aitken R, et al. Current ratios: A self-scaling technique for production IDDQ testing. Proceedings of the international test conference (ITC). 2000 ;: 1148-1156
108. Meixner A, Bauer ME, Sorin DJ. Argus: Low-cost, comprehensive error detection in simple cores. Proceedings of the annual international symposium on microarchitecture (MICRO). 2007 ;: 210-222
109. Mirgorodskiy AV, Maruyama N, Miller BP. Problem diagnosis in large-scale computing environments. International conference for high-performance computing, networking, storage and analysis (SC). 2006 ;:
110. MitchellR (1977) The Underground Grammarian, Vol., No. 1, January. Available at http://www.sourcetext.com/grammarian/ (accessed 25 February 2014).
111. Mitra S, Zhang M, Seifert N, et al. Built-in soft error resilience for robust system design. IEEE international conference on integrated circuit design and technology. 2007 ;:
112. MokhtaraniAKramerWHickJ (2008) Reliability results of NERSC systems. https://publications.lbl.gov/islandora/object/ir%3A150330 (accessed 25 February 2014).
113. Moody A, Bronevetsky G, Mohror K, et al. Design, modeling, and evaluation of a scalable multi-level checkpointing system. International conference for high-performance computing, networking, storage and analysis (SC). 2010 ;:
114. Moré JJ, Wild SM. Estimating derivatives of noisy simulations. ACM Transactions of Mathematical Software. 2012 ; 38 (3). 1-19
115. MPIPlugIn (2013) MPI plugin for KDevelop. Available at: http://sourceforge.net/projects/mpiplugin/ (accessed 25 February 2014).
116. Nakano J, Montesinos P, Gharachorloo K, et al. ReVive I/O: Efficient handling of I/O in highly-available rollback-recovery servers. Proceedings of the international symposium on high performance computer architecture (HPCA). 2006 ;:
117. Naksinehaboon N, Taerat N, Leangsuksun C, et al. Benefits of software rejuvenation on HPC systems. International symposium on parallel and distributed processing with applications (ISPA). 2010 ;: 499-506
118. Nassif S, Kleeberger V, Schlichtmann U. Goldilocks failures: Not too soft, not too hard. 2012 IEEE international reliability physics symposium (IRPS). 2012 ;: 2F - 1
119. NCAR (2014) Community earth system model. Available at: http://www2.cesm.ucar.edu/ (accessed 25 February 2014).
120. Network Working Group (2009) The syslog protocol. Available at: http://tools.ietf.org/html/rfc5424 (accessed 25 February 2014).
121. Nigh P, Gattiker A. Test method evaluation experiments and data. Proceedings of the international test conference (ITC). 2000 ;: 454-463
122. Oh J, Washington SP, Nam D. Accident prediction model for railway-highway interfaces. Accident Analysis and Prevention. 2006 ; 38 (2). 346-356
123. Oliner A, Stearley J. What supercomputers say: A study of five system logs. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2007 ;: 575-584
124. Park Y, Van Hensbergen E, Hillenbrand M, et al. FusedOS: Fusing LWK performance with FWK functionality in a heterogeneous environment. 24th international symposium on computer architecture and high performance computing (SBAC-PAD). 2012 ;: 211-218
125. Pattabiraman K, Nakka N, Kalbarczyk Z, et al. SymPLFIED: Symbolic program-level fault injection and error detection framework. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2008 ;:
126. Pattabiraman K, Saggese GP, Chen D, et al. Dynamic derivation of application-specific error detectors and their implementation in hardware. European dependable computing conference. 2006 ;: 97-108
127. Prvulovic M, Zhang Z, Torrellas J. ReVive: Cost-effective architectural support for rollback recovery in shared-memo multiprocessors. Proceedings of the annual international symposium on computer architecture (ISCA). 2002 ;:
128. Racunas P, Constantinides K, Manne S, et al. Perturbation-based fault screening. Proceedings of the international symposium on high performance computer architecture (HPCA). 2007 ;: 169-180
129. RamachandranP (2011) Detecting and recovering from in-core hardware faults through software anomaly treatment. PhD Thesis, University of Illinois at Urbana Champaign, IL.
130. Randall A V. The Eckert tapes: Computer pioneer says ENIAC team couldn't afford to fail - and didn't. Computerworld. 2006 ; 40 (8). 18
131. Rao TRN Error Coding for Arithmetic Processors. Orlando, FL: Academic Press, Inc ; 1974 :
132. Reddy V, Krishnan A, Marshall A, et al. Impact of negative bias temperature instability on digital circuit reliability. Microelectronics Reliability. 2005 ; 45 (1). 31-38
133. Reis G, Chang J, Vachharajani N, et al. Software-controlled fault tolerance. ACM Transactions on Architecture and Code Optimization. 2005a ; 2 (4). 366-396
134. Reis GA, Chang J, Vachharajani N, et al. SWIFT: Software implemented fault tolerance. Proceedings of the international symposium on code generation and optimization. 2005b ;: 243-254
135. Rogue Wave Software (2013) TotalView Debugger. Available at: http://www.roguewave.com/products/totalview.aspx (accessed 25 February 2014).
136. Ropars T, Guermouche A, Uçar B, et al Euro-Par 2011: Parallel Processing Workshops 17th International Euro-ParConference. Emmanuel J Raymond N Jean R, ed. New York, NY: Springer ; 2011: 567-578.
137. Roth PC, Arnold DC, Miller BP. MRNet: A software-based multicast/reduction network for scalable tools. International conference for high-performance computing, networking, storage and analysis (SC). 2003 ;:
138. Roy-Chowdhury A, Bellas N, Banerjee P. Algorithm-based error-detection schemes for iterative solution of partial differential equations. IEEE Transactions on Computers. 1996 ; 45 (4). 394-407
139. Sahoo S, Li ML, Ramchandran P, et al. Using likely program invariants to detect hardware errors. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2008 ;: 70-79
140. Salfner F, Lenk M, Malek M. A survey of online failure prediction methods. ACM Computing Surveys. 2010 ; 42: 1-42
141. Saxena N, McCluskey E. Dependable adaptive computing systems - the ROAR project. IEEE international conference on systems, man, and cybernetics. 2002 ;: 2172-2177
142. Schroeder B, Gibson GA. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you. Proceedings of the 5th USENIX conference on file and storage technologies (FAST). 2007 ;: 1-16
143. Schroeder B, Gibson GA. A large-scale study of failures in high-performance computing systems. IEEE Transactions on Dependable and Secure Computing. 2010 ; 7 (4). 337-350
144. Schroeder B, Pinheiro E, Weber WD. DRAM errors in the wild: A large-scale field study. Proceedings of the eleventh international joint conference on measurement and modeling of computer systems. 2009 ;: 193-204
145. Seltborg P, Polanski A, Petrochenkov S, et al. Radiation shielding of high-energy neutrons in SAD. Nuclear Instruments and Methods in Physics Research Section A: Accelerators, Spectrometers, Detectors and Associated Equipment.. 2005 ; 550 (1). 313-328
146. Shipman G, Dillow D, Oral S, et al. Lessons learned in deploying the world's largest scale Lustre file system. The 52nd Cray user group conference. 2010 ;:
147. Slayman C. Soft error trends and mitigation techniques in memory devices. Proceedings of the annual reliability and maintainability symposium (RAMS). 2011 ;: 1-5
148. Slegel TJ, Averill RM, Check MA, et al. IBM's S/390 G5 microprocessor design. IEEE Micro. 1999 ; 19 (2). 12-23
149. Snir M, Bader DA. A framework for measuring supercomputer productivity. International Journal for High Performance Computing Applications. 2004 ; 18 (4). 417-432
150. Sorin D, Martin MMK, Hill MD, et al. SafetyNet: Improving the availability of shared memory multiprocessors with global checkpoint/recovery. Proceedings of the annual international symposium on computer architecture (ISCA). 2002 ;:
151. Spainhower L, Gregg T. IBM S/390 parallel enterprise server G5 fault tolerance: A historical perspective. IBM Journal of Research and Development. 1999 ; 43 (5.6). 863-873
152. Sridharan V, Liberty D. A study of DRAM failures in the field. International conference for high-performance computing, networking, storage and analysis (SC). 2012 ;:
153. Stearley J. Defining and measuring supercomputer reliability, availability, and serviceability (RAS). Proceedings of the Linux clusters institute conference. 2005 ;:
154. Taleb N The Black Swan: The Impact of the Highly Improbable. New York: Random House Trade Paperbacks ; 2010 :
155. Trottenberg U, Oosterlee C, Schüller A Multigrid. New York, NY: Academic Press ; 2001 :
156. Turmon M, Granat R, Katz D. Software-implemented fault detection for high-performance space applications. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2000 ;: 107-116
157. Turmon M, Granat R, Katz D, et al. Tests and tolerances for high-performance software-implemented fault detection. IEEE Transactions on Computers. 2003 ; 52 (5). 579-591
158. Van Horn J. Towards achieving relentless reliability gains in a server marketplace of teraflops, laptops, kilowatts, and ''cost, cost, cost''... : Making peace between a black art and the bottom line. Proceedings of the IEEE international test conference (ITC). 2005 ;: 8
159. Wang N, Patel S. ReStore: Symptom-based soft error detection in microprocessors. IEEE Transactions on Dependable and Secure Computing. 2006 ; 3 (3). 188-201
160. Wittgenstein L New York: The Macmillan Company ; 1953 :
161. Yang J, Zhang M, Strachan J, et al. High switching endurance in TaOx memristive devices. Applied Physics Letters. 2010 ; 97 (23). 232102
162. Young JW. A first order approximation to the optimum checkpoint interval. Communications of the ACM. 1974 ; 17 (9). 530-531
163. Yu J, Garzaran MJ, Snir M. Esoftcheck: Removal of non-vital checks for fault tolerance. Proceedings of the 7th annual IEEE/ACM international symposium on code generation and optimization. 2009 ;: 35-46
164. Yu S, Yin Chen Y, Guan X, et al. A Monte Carlo study of the low resistance state retention of HfOx based resistive switching memory. Applied Physics Letters. 2012 ; 100 (4). 043507
165. Zhang M, Mitra S, Mak TM, et al. Sequential element design with built-in soft error resilience. IEEE Transactions on Very Large Scale Integration (VLSI) Systems. 2006 ; 14 (13). 1368-1378
166. Zheng G, Ni X, Kalé L. A scalable double in-memory checkpoint and restart scheme towards exascale. Proceedings of the IEEE/IFIP international conference on dependable systems and networks (DSN). 2012 ;: 1-6
167. Zhou J, Wang M, Wong M. Instability of p-channel poly-Si thin-film transistors under dynamic negative bias temperature stress. 17th IEEE international symposium on the physical and failure analysis of integrated circuits (IPFA). 2010 ;: 1-4
168. Zio E, Maio FD, Stasi M. A data-driven approach for predicting failure scenarios in nuclear systems. Annals of Nuclear Energy. 2010 ; 37: 482-491