Detection and correction of silent data corruption for large-scale high-performance computing

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn , Issue , 2012, Pages

  Fiala, David ^a   Mueller, Frank ^a   Engelmann, Christian ^b   Riesen, Rolf ^c   Ferreira, Kurt ^d   Brightwell, Ron ^d  

^a NORTH CAROLINA STATE UNIVERSITY   (United States)

^b OAK RIDGE NATIONAL LABORATORY   (United States)

^c Smarter Cities Technology Centre   (Ireland)

^d SANDIA NATIONAL LABORATORIES   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION DATA; CONSISTENCY PROTOCOL; FAULT INJECTOR; HIGH-END COMPUTING; HIGH-PERFORMANCE COMPUTING; MPI APPLICATIONS; SILENT DATA CORRUPTIONS; SOFT ERROR;

CRIME; MESSAGE PASSING; REDUNDANCY;

DIGITAL STORAGE;

EID: 84877705582     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2012.49     Document Type: Conference Paper

References (37)

1. B. Schroeder, E. Pinheiro, and W.-D. Weber, "Dram errors in the wild: a large-scale field study," in SIGMETRICS Conference on Measurement and Modeling of Computer Systems, 2009, pp. 193-204.
2. E. Pinheiro, W.-D. Weber, and L. A. Barroso, "Failure trends in a large disk drive population," in USENIX Conference on File and Storage Technologies, 2007.
3. A. A. Hwang, I. A. Stefanovici, and B. Schroeder, "Cosmic rays don't strike twice: understanding the nature of dram errors and the implications for system design," in Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating Systems, ser. ASPLOS '12, 2012, pp. 111-122.
4. J. T. Daly, "ADTSC nuclear weapons highlights: Facilitating high-throughput ASC calculations," Los Alamos National Laboratory, Los Alamos, NM, USA, Tech. Rep. LALP-07-041, Jun. 2007.
5. J. T. Daly, L. A. Pritchett-Sheats, and S. E. Michalak, "Application MTTFE vs. platform MTTF: A fresh perspective on system reliability and application throughput for computations at scale," in Proceedings of the Workshop on Resiliency in High Performance Computing (Resilience) 2008, May 2008, pp. 19-22.
6. I. Philp, "Software failures and the road to a petaflop machine," in HPCRI: 1st Workshop on High Performance Computing Reliability Issues, in Proceedings of the 11th International Symposium on High Performance Computer Architecture (HPCA-11). IEEE Computer Society, 2005.
7. K. Ferreira, J. Stearley, J. H. L. III, R. Oldfield, K. Pedretti, R. Brightwell, R. Riesen, P. Bridges, and D. Arnold, "Evaluating the viability of process replication reliability for exascale systems," in Supercomputing, nov 2011.
8. A. Geist, "What is the monster in the closet?" Aug. 2011, invited Talk at Workshop on Architectures I: Exascale and Beyond: Gaps in Research, Gaps in our Thinking.
9. G. Bronevetsky and A. Moody, "Scalable i/o systems via node-local storage: Approaching 1 tb/sec file i/o," Lawrence Berkeley National Laboratory, TR 415791, 2009.
10. J. R. Sklaroff, "Redundancy management technique for space shuttle computers," IBM Journal of Research and Development, vol. 20, no. 1, pp. 20-28, 1976.
11. S. Mitra, N. Seifert, M. Zhang, Q. Shi, and K. S. Kim, "Robust system design with built-in soft-error resilience," Computer, vol. 38, no. 2, pp. 43-52, 2005. (Pubitemid 40377402)
12. M. Gomaa, C. Scarbrough, T. N. Vijayjumar, and I. Pomeranz, "Transient-fault recovery for chip multiprocessors," in International Symposium on Computer Architecture, May 2003, pp. 98-109.
13. S. K. Reinhardt and S. S. Mukherjee, "Transient fault detection via simultaneous multithreading," in International Symposium on Computer Architecture, 2000, pp. 25-36.
14. H. Quinn and P. Graham, "Terrestrial-based radiation upsets: A cautionary tale," in Symposium on Field-Programmable Custom Computing Machines (FCCM) 2005, Apr. 18-20, 2005, pp. 193-202.
15. J. Elliot, K. Kharbas, D. Fiala, F. Mueller, C. Engelmann, and K. Ferreirar, "Combining partial redundancy and checkpointing for HPC," in International Conference on Distributed Computing Systems, 2012, p. (accepted).
16. J. Vetter, "Hpc landscape - application accelerators: Deus ex machina?" Sep. 2009, invited Talk at High Performance Embedded Computing Workshop.
17. J. Shalf, "Simulation challenge: Exascale planning overview," Aug. 2010, invited Talk at HEC FSIO R&D Workshop.
18. J. Dongarra, P. Beckman, T. Moore, P. Aerts, G. Aloisio, J. C. Andre, D. Barkai, J. Y. Berthou, T. Boku, B. Braunschweig, and et al., "The international exascale software project roadmap," International Journal of High Performance Computing Applications, vol. 25, no. 1, pp. 3-60, 2011.
19. D. Fiala, F. Mueller, C. Engelmann, K. Ferreira, R. Brightwell, and R. Riesen, "Detection and correction of silent data corruption for large-scale high-performance computing," Dept. of Computer Science, North Carolina State University, Tech. Rep. TR 2012-5, May 2012.
20. S. Böhm and C. Engelmann, "File i/o for mpi applications in redundant execution scenarios," in Euromicro International Conference on Parallel, Distributed, and network-based Processing, Feb. 2012.
21. N. DeBardeleben, J. Laros, J. T. Daly, S. L. Scott, C. Engelmann, and B. Harrod, "High-end computing resilience: Analysis of issues facing the HEC community and path-forward for research and development," Whitepaper, Dec. 2009. [Online]. Available: http://www.csm.ornl.gov/̃engelman/publications/ debardeleben09high-end.pdf
22. P. H. Hargrove and J. C. Duell, "Berkeley Lab Checkpoint/Restart (BLCR) for Linux clusters," in Journal of Physics: Proceedings of the Scientific Discovery through Advanced Computing Program (SciDAC) Conference 2006, vol. 46. Denver, CO, USA: Institute of Physics Publishing, Bristol, UK, Jun. 25-29, 2006, pp. 494-499. [Online]. Available: http://www.iop.org/EJ/ article/1742-6596/46/1/067/jpconf6-46-067.pdf
23. G. Bronevetsky and A. Moody, "Scalable I/O systems via node-local storage: Approaching 1 TB/sec file I/O," Lawrence Livermore National Laboratory, Livermore, CA, USA, Tech. Rep. TR-JLPC-09-01, Aug. 2009. [Online]. Available: http://dx.doi.org/10.2172/964079
24. S. Li, K. Chen, M.-Y. Hsieh, N. Muralimanohar, C. D. Kersey, J. B. Brockman, A. F. Rodrigues, and N. P. Jouppi, "System implications of memory reliability in exascale computing," in Supercomputing, 2011, pp. 46:1-46:12.
25. D. Fiala, K. Ferreira, F. Mueller, and C. Engelmann, "A tunable, software-based dram error detection and correction library for hpc," in Workshop on Resiliency in High Performance Computing (Resilience) in Clusters, Clouds, and Grids, Sep. 2011, pp. 110-121.
26. S. E. Michalak, K. W. Harris, N. W. Hengartner, B. E. Takala, and S. A. Wender, "Predicting the number of fatal soft errors in Los Alamos National Laboratory's ASC Q supercomputer," IEEE Transactions on Device and Materials Reliability (TDMR), vol. 5, no. 3, pp. 329-335, 2005. [Online]. Available: http://ieeexplore.ieee.org/xpls/abs-all.jsp?arnumber=1545893
27. st ACM International Conference on Supercomputing (ICS) 2008. Island of Kos, Greece: ACM Press, New York, NY, USA, Jun. 7-12, 2007. [Online]. Available: http://greg.bronevetsky.com/papers/2008ICS.pdf
28. D. P. Siemwiorek, "Architecture of fault-tolerant computers: An historical perspective," Proceedings of the IEEE, vol. 79, no. 12, pp. 1710-1734, 1991. [Online]. Available: http://dx.doi.org/10.1109/5.119549
29. A. Golander, S. Weiss, and R. Ronen, "DDMR: Dynamic and scalable dual modular redundancy with short validation intervals," IEEE Computer Architecture Letters, vol. 7, no. 2, pp. 65-68, 2008. [Online]. Available: http://doi.ieeecomputersociety.org/10.1109/L-CA.2008.12
30. A. Shye, J. Blomstedt, T. Moseley, V. J. Reddi, and D. A. Connors, "PLR: A software approach to transient fault tolerance for multicore architectures," IEEE Transactions on Dependable and Secure Computing (TDSC), vol. 6, no. 2, pp. 135-148, 2009. [Online]. Available: http://doi.ieeecomputersociety.org/10.1109/TDSC.2008.62
31. th Annual International Symposium on Computer Architecture (ISCA) 2002. Anchorage, AK, USA: IEEE Computer Society, May 25-29, 2002, pp. 99-110. [Online]. Available: http://doi.ieeecomputersociety.org/10.1109/ISCA. 2002.1003566
32. th IASTED International Conference on Parallel and Distributed Computing and Networks (PDCN) 2009. Innsbruck, Austria: ACTA Press, Calgary, AB, Canada, Feb. 16-18, 2009, pp. 189-194. [Online]. Available: http://www.csm.ornl.gov/̃engelman/publications/engelmann09case.pdf
33. R. Brightwell, K. B. Ferreira, and R. Riesen, "Transparent redundant computing with MPI," in EuroMPI, ser. Lecture Notes in Computer Science, R. Keller, E. Gabriel, M. M. Resch, and J. Dongarra, Eds., vol. 6305. Springer, 2010, pp. 208-218.
34. th IASTED International Conference on Parallel and Distributed Computing and Networks (PDCN) 2011. Innsbruck, Austria: ACTA Press, Calgary, AB, Canada, Feb. 15-17, 2011.
35. th European PVM/MPI Users' Group Meeting (EuroPVM/MPI) 2009, vol. 5759. Espoo, Finland: Springer Verlag, Berlin, Germany, Sep. 7-10, 2009, pp. 124-133. [Online]. Available: http://dx.doi.org/10.1007/978-3-642-03770-2-19
36. B. Roundtree, G. Cobb, T. Gamblin, M. Schulz, B. Supinski, and H. Tufo, "Parallelizing heavyweight debugging tools with mpiecho," in High-performance Infrastructure for Scalable Toolsi, WHIST 2011, Held as part of ICS '11, Tucson, Arizona, 2011, pp. 803-808.
37. G. Cobb, B. Roundtree, H. Tufo, M. Schulz, T. Gamblin, and B. de Supinski, "Mpiecho: A framework for transparent mpi task replication," Dept. of Computer Science, University of Colorado at Boulder, Tech. Rep. CU-CS-1082-11, Jun. 2011.