File I/O for MPI applications in redundant execution scenarios

Proceedings - 20th Euromicro International Conference on Parallel, Distributed and Network-Based Processing, PDP 2012

Volumn , Issue , 2012, Pages 112-119

  Böhm, Swen ^a   Engelmann, Christian ^a  

^a OAK RIDGE NATIONAL LABORATORY   (United States)

Author keywords

Fault tolerance; High performance computing; Message Passing Interface; Redundancy; Resilience

Indexed keywords

ASSOCIATED COSTS; CHECKPOINT/RESTART; CIRCUIT SIZE; CIRCUIT VOLTAGES; COMPONENT COUNT; CONCEPT PROTOTYPE; COORDINATION PROTOCOLS; COST CALCULATION; EXECUTION SCENARIO; FAULT TOLERANCE TECHNIQUES; FILE SYSTEMS; HIGH PERFORMANCE COMPUTING SYSTEMS; HIGH-PERFORMANCE COMPUTING; I/O OPERATIONS; MESSAGE PASSING INTERFACE; MPI APPLICATIONS; NETWORKED FILE SYSTEMS; PARALLEL APPLICATION; PERFORMANCE IMPACT; REPLICATION ALGORITHM; RESEARCH AND DEVELOPMENT; RESEARCH PROBLEMS; RESILIENCE;

COMMUNICATION; COMPUTER SOFTWARE SELECTION AND EVALUATION; FAULT TOLERANCE;

REDUNDANCY;

EID: 84862123385     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PDP.2012.22     Document Type: Conference Paper

References (17)

1. D. P. Siemwiorek, "Architecture of fault-tolerant computers: An historical perspective," Proceedings of the IEEE, vol. 79, no. 12, pp. 1710-1734, 1991.
2. N. DeBardeleben, J. Laros, J. T. Daly, S. L. Scott, C. Engelmann, and B. Harrod, "High-end computing resilience: Analysis of issues facing the HEC community and pathforward for research and development," Whitepaper, 2009.
3. E. N. Elnozahy, R. Bianchini, T. El-Ghazawi, A. Fox, F. Godfrey, A. Hoisie, K. McKinley, R. Melhem, J. S. Plank, P. Ranganathan, and J. Simons, "System resilience at extreme scale," Defense Advanced Research Project Agency (DARPA), Tech. Rep., 2008.
4. P. Kogge, K. Bergman, S. Borkar, D. Campbell, W. Carlson, W. Dally, M. Denneau, P. Franzon, W. Harrod, K. Hill, J. Hiller, S. Karp, S. Keckler, D. Klein, R. Lucas, M. Richards, A. Scarpelli, S. Scott, A. Snavely, T. Sterling, R. S. Williams, and K. Yelick, "ExaScale computing study: Technology challenges in achieving exascale systems," Defense Advanced Research Project Agency (DARPA) Information Processing Techniques Office (IPTO), Tech. Rep., 2008.
5. F. Cappello, A. Geist, W. D. B. Gropp, L. V. S. Kale, W. T. C. B. Kramer, and M. Snir, "Toward exascale resilience," University of Illinois at Urbana-Champaign (UIUC) - Institut National de Recherche en Informatique et en Automatique (INRIA) Joint Laboratory on PetaScale Computing, Tech. Rep. TR-JLPC-09-01, 2009.
6. A. Geist and R. F. Lucas, "Major computer science challenges at exascale," International Exascale Software Project, Tech. Rep., 2009, whitepaper.
7. J. Dongarra, P. Beckman, T. Moore, J.-C. Andre, J.-Y. Berthou, T. Boku, F. Cappello, B. Chapman, X. Chi, A. Choudhary, S. Dosanjh, A. Geist, B. Gropp, R. Harrison, M. Hereld, M. Heroux, A. Hoisie, K. Hotta, Y. Ishikawa, F. Johnson, S. Kale, R. Kenway, B. Kramer, J. Labarta, B. Lucas, B. Maccabe, S. Matsuoka, P. Messina, B. Mohr, M. Mueller, W. Nagel, H. Nakashima, M. E. Papka, D. Reed, M. Sato, E. Seidel, J. Shalf, D. Skinner, T. Sterling, R. Stevens, W. Tang, J. Taylor, R. Thakur, A. Trefethen, M. Snir, A. van der Steen, F. Streitz, B. Sugar, S. Sumimoto, J. Vetter, R. Wisniewski, and K. Yelick, "International exascale software project roadmap (draft 0.93)," 2009.
8. B. Schroeder and G. A. Gibson, "Understanding failures in petascale computers," in Journal of Physics: Scientific Discovery through Advanced Computing Program (SciDAC) Conference, vol. 78, 2007, pp. 2022-2032.
9. J. T. Daly, L. A. Pritchett-Sheats, and S. E. Michalak, "Application MTTFE vs. platform MTTF: A fresh perspective on system reliability and application throughput for computations at scale," in IEEE International Symposium on Cluster Computing and the Grid (CCGrid): Workshop on Resiliency in High Performance Computing (Resilience), 2008.
10. F. B. Schneider, "Implementing fault-tolerant services using the state machine approach: A tutorial," ACM Computing Surveys (CSUR), vol. 22, no. 4, pp. 299-319, 1990.
11. K. Ferreira, R. Riesen, R. Oldfield, J. Stearley, J. Laros, K. Pedretti, R. Brightwell, and T. Kordenbrock, "Increasing fault resiliency in a message-passing environment," Sandia National Laboratories, Technical report SAND2009-6753, 2009.
12. C. Engelmann and S. Böhm, "Redundant execution of HPC applications with MR-MPI," in IASTED International Conference on Parallel and Distributed Computing and Networks (PDCN), 2011, pp. 31-38.
13. th IEEE International Parallel and Distributed Processing Symposium (IPDPS) 2011, Anchorage, AK, USA, 2011.
14. T. LeBlanc, R. Anand, E. Gabriel, and J. Subhlok, "Volpexmpi: An MPI library for execution of parallel applications on volatile nodes," in Lecture Notes in Computer Science: European PVM/MPI Users' Group Meeting (EuroPVM/ MPI), vol. 5759, 2009, pp. 124-133.
15. D. H. Bailey, E. Barszcz, J. T. Barton, D. S. Browning, R. L. Carter, D. Dagum, R. A. Fatoohi, P. O. Frederickson, T. A. Lasinski, R. S. Schreiber, H. D. Simon, V. Venkatakrishnan, and S. K. Weeratunga, "The NAS Parallel Benchmarks," The International Journal of Supercomputer Applications, vol. 5, no. 3, pp. 63-73, 1991.
16. Sun Microsystems, Inc., Santa Clara, CA, USA, "Lustre file system - High-performance storage architecture and scalable cluster file system," 2007, white paper.
17. P. H. Carns, W. B. L. III, R. B. Ross, and R. Thakur, "PVFS: A parallel file system for linux clusters," in Annual Linux Showcase and Conference, 2000, pp. 317-327.