Modeling and tolerating heterogeneous failures in large parallel systems

Proceedings of 2011 SC - International Conference for High Performance Computing, Networking, Storage and Analysis

Volumn , Issue , 2011, Pages

  Heien, Eric ^a   Kondo, Derrick ^a   Gainaru, Ana ^b,c   Lapine, Dan ^b   Kramer, Bill ^b   Cappello, Franck ^a  

^a INRIA   (France)

^b UNIVERSITY OF ILLINOIS AT URBANA CHAMPAIGN   (United States)

^c UNIVERSITY POLITEHNICA OF BUCHAREST   (Romania)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION-CENTRIC; CHECK POINTING; COMPONENT FAILURES; FAILURE MODEL; FAILURE RATE; FAULT-TOLERANT ALGORITHMS; GENERAL MODEL; HARDWARE COMPONENTS; HARDWARE FAILURES; HIGH PERFORMANCE COMPUTING SYSTEMS; OR-NETWORKS; PARALLEL SYSTEM; SPACE AND TIME; SPECIFIC COMPONENT; SUPERCOMPUTING APPLICATIONS; SYSTEM FAILURES;

COMPUTER SOFTWARE SELECTION AND EVALUATION; FAULT TOLERANT COMPUTER SYSTEMS; SUPERCOMPUTERS; SYSTEMS ENGINEERING;

COMPUTATION THEORY;

EID: 83155160934     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/2063384.2063444     Document Type: Conference Paper

References (27)

1. William D. Gropp. Personal communication, May 2010.
2. Franck Cappello, Al Geist, Bill Gropp, Laxmikant Kale, Bill Kramer, and Marc Snir. Toward exascale resilience. Int. J. High Perform. Comput. Appl., 23:374-388, November 2009.
3. Ana Gainaru, Franck Cappello, Stefan Trausan-Matu, and Bill Kramer. Hierarchical event log organizer. Technical Report of the INRIA-Illinois Joint Laboratory on PetaScale Computing, pages 1-24, Sep 2010.
4. Daniel Ford, Francois Labelle, Florentina Popovici, Murray Stokely, Van-Anh Truong, Luiz Barroso, Carrie Grimes, and Sean Quinlan. Availability in globally distributed storage systems. In Proceedings of the 9th USENIX Symposium on Operating Systems Design and Implementation, 2010.
5. Bianca Schroeder and Garth Gibson. Understanding disk failure rates: What does an mttf of 1, 000, 000 hours mean to you? Transactions on Storage (TOS, 3(3), Oct 2007.
6. Bianca Schroeder and Garth A. Gibson. A large-scale study of failures in high-performance computing systems. In Proceedings of the International Conference on Dependable Systems and Networks, pages 249-258, Washington, DC, USA, 2006. IEEE Computer Society. (Pubitemid 44930426)
7. G. Casella and R. Berger. Statistical Inference. Duxbury, 2002.
8. A. Iosup, C. Dumitrescu, D. H. J. Epema, H. Li, and L. Wolters. How are real grids used? the analysis of four grid traces and its implications. In GRID, pages 262-269, 2006.
9. Catalog of boinc projects. http://www.boinc-wiki.info/Catalog-of-BOINC- Powered-Projects.
10. D. Baker. ROSETTA@home. http://boinc.bakerlab.org/rosetta/.
11. EINSTEN@home. http://einstein.phys.uwm.edu.
12. James C. Phillips, Rosemary Braun, Wei Wang, James Gumbart, Emad Tajkhorshid, Elizabeth Villa, Christophe Chipot, Robert D. Skeel, Laxmikant V. Kalé, and Klaus Schulten. Scalable molecular dynamics with namd. Journal of Computational Chemistry, 26(16):1781-1802, 2005. (Pubitemid 43078511)
13. John W. Young. A first order approximation to the optimum checkpoint interval. Commun. ACM, 17:530-531, September 1974.
14. M. S. Bouguerra, D. Kondo, and D. Trystram. On the scheduling of checkpoints in desktop grids. In Proceedings of the 11th IEEE International Symposium on Cluster Computing and Grid (CCGrid), 2011.
15. A Oliner, A Aiken, and J Stearley. Alert detection in system logs. Data Mining, 2008. ICDM'08. Eighth IEEE International Conference on, pages 959-964, 2008.
16. J. Stearley. Towards informatic analysis of syslogs. In Proceedings of the 2004 IEEE International Conference on Cluster Computing, pages 309-318, Washington, DC, USA, 2004. IEEE Computer Society. (Pubitemid 40822381)
17. Derrick Kondo, Bahman Javadi, Alexandru Iosup, and Dick Epema. The failure trace archive: Enabling comparative analysis of failures in diverse distributed systems. Cluster, Cloud and Grid Computing (CCGrid), 2010 10th IEEE/ACM International Conference on, pages 398 -407, 2010.
18. R. Bhagwan, S. Savage, and G. Voelker. Understanding Availability. In Proceedings of IPTPS'03, 2003.
19. B. Javadi, D. Kondo, JM. Vincent, and D.P. Anderson. Mining for statistical availability models in large-scale distributed systems: An empirical study of seti@home. In 17th IEEE/ACM International Symposium on Modelling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS), September 2009.
20. John R. Douceur. Is remote host availability governed by a universal law? SIGMETRICS Performance Evaluation Review, 31(3):25-29, 2003.
21. J. Brevik, D. Nurmi, and R. Wolski. Quantifying Machine Availability in Networked and Desktop Grid Systems. Technical Report CS2003-37, Dept. of Computer Science and Engineering, University of California at Santa Barbara, November 2003.
22. Mehmet Bakkaloglu, Jay J. Wylie, Chenxi Wang, and Gregory R. Ganger. On correlated failures in survivable storage systems. Technical Report CMU-CS-02-129, Carnegie Mellon University, 2002.
23. D Kondo, F Araujo, P Malecot, P Domingues, LM Silva, G Fedak, and F Cappello. Characterizing result errors in internet desktop grids. Lecture Notes in Computer Science, 4641:361, 2007.
24. Bianca Schroeder, Eduardo Pinheiro, and Wolf-Dietrich Weber. Dram errors in the wild: a large-scale field study. SIGMETRICS'09: Proceedings of the eleventh international joint conference on Measurement and modeling of computer systems, Jun 2009.
25. Xin Li, Michael Huang, Kai Shen, and Lingkun Chu. A realistic evaluation of memory hardware errors and software system susceptibility. USENIXATC'10: Proceedings of the 2010 USENIX conference on USENIX annual technical conference, Jun 2010.
26. Jason Ansel, Kapil Arya, and Gene Cooperman. Dmtcp: Transparent checkpointing for cluster computations and the desktop. Parallel and Distributed Processing Symposium, International, 0:1-12, 2009.
27. Camille Coti, Thomas Herault, Pierre Lemarinier, Laurence Pilard, Ala Rezmerita, Eric Rodriguez, and Franck Cappello. Blocking vs. non-blocking coordinated checkpointing for large-scale fault tolerant mpi. In SC 2006 Conference, Proceedings of the ACM/IEEE, page 18, 2006.