A redundant communication approach to scalable fault tolerance in PGAS programming models

Proceedings - 19th International Euromicro Conference on Parallel, Distributed, and Network-Based Processing, PDP 2011

Volumn , Issue , 2011, Pages 24-31

  Ali, Nawab ^a   Krishnamoorthy, Sriram ^a   Govind, Niranjan ^a   Palmer, Bruce ^a  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

Computational chemistry; Fault tolerance; Global Arrays; NWChem

Indexed keywords

CHECKPOINT/RESTART; COST OF FAILURE; FAULT TOLERANCE MECHANISMS; GLOBAL ARRAYS; HIGH-PERFORMANCE COMPUTING; LARGE MACHINES; LONG-RUNNING APPLICATIONS; MEAN TIME BETWEEN FAILURES; MEMORY BANDWIDTHS; NWCHEM; PERFORMANCE ISSUES; PROGRAMMING MODELS; RECENT TRENDS; REMOTE MEMORY ACCESS;

COMPUTATIONAL CHEMISTRY; COMPUTER SOFTWARE SELECTION AND EVALUATION; DATA STRUCTURES; FAULT TOLERANCE;

QUALITY ASSURANCE;

EID: 79955038373     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/PDP.2011.72     Document Type: Conference Paper

References (34)

1. H. Meuer, E. Strohmaier, J. Dongarra, and H. Simon, "Top500 supercomputing sites," http://www.top500.org.
2. R. Baumann, "Soft errors in advanced computer systems," IEEE Design & Test of Computers, vol. 22, no. 3, pp. 258-266, 2005. (Pubitemid 40889826)
3. "Roadrunner," http://www.lanl.gov/roadrunner.
4. "Jaguar," http://www.nccs.gov/jaguar.
5. B. Schroeder and G. A. Gibson, "Understanding failures in petascale computers," Journal of Physics: Conference Series, vol. 78, no. 1, 2007.
6. E. N. Elnozahy and J. S. Plank, "Checkpointing for peta-scale systems: A look into the future of practical rollback-recovery," IEEE Transactions on Dependable and Secure Computing, vol. 1, no. 2, pp. 97-108, 2004.
7. E. N. Elnozahy, L. Alvisi, Y.-M. Wang, and D. B. Johnson, "A survey of rollback-recovery protocols in message-passing systems," ACM Computing Surveys, vol. 34, no. 3, pp. 375-408, 2002.
8. A. Beguelin, E. Seligman, and P. Stephan, "Application level fault tolerance in heterogeneous networks of workstations," Journal of Parallel and Distributed Computing, vol. 43, no. 2, pp. 147-155, 1997. (Pubitemid 127171411)
9. J. S. Plank, M. Beck, G. Kingsley, and K. Li, "Libckpt: Transparent checkpointing under Unix," in Usenix Winter Technical Conference, Jan. 1995, pp. 213-223.
10. G. Bronevetsky and A. Moody, "Scalable I/O systems via node-local storage: Approaching 1 TB/sec file I/O," Lawrence Livermore National Laboratory, Tech. Rep. LLNL-TR-415791, Aug. 2009.
11. P. H. Hargrove and J. C. Duell, "Berkeley lab checkpoint/restart (BLCR) for Linux clusters," Journal of Physics: Conference Series, vol. 46, no. 1, pp. 494-499, 2006. (Pubitemid 44461038)
12. B. Bhargava and S.-R. Lian, "Independent checkpointing and concurrent rollback for recovery in distributed systems - An optimistic approach," in Proceedings of the IEEE International Symposium on Reliable Distributed Systems, Oct. 1988, pp. 3-12.
13. A. Bouteiller, T. Ropars, G. Bosilca, C. Morin, and J. Dongarra, "Reasons for a pessimistic or optimistic message logging protocol in MPI uncoordinated failure recovery," in IEEE International Conference on Cluster Computing, Aug. 2009, pp. 1-9.
14. K. M. Chandy and L. Lamport, "Distributed snapshots: Determining global states of distributed systems," ACM Transactions on Computer Systems, vol. 3, no. 1, pp. 63-75, 1985. (Pubitemid 15597765)
15. J. Plank and K. Li, "Faster checkpointing with N+1 parity," in International Symposium on Fault-Tolerant Computing, Jun. 1994, pp. 288-297.
16. J. S. Plank, K. Li, and M. A. Puening, "Diskless checkpointing," IEEE Transactions on Parallel and Distributed Systems, vol. 9, no. 10, pp. 972-986, Oct. 1998. (Pubitemid 128747893)
17. K.-H. Huang and J. A. Abraham, "Algorithm-based fault tolerance for matrix operations," IEEE Transactions on Computers, vol. 33, no. 6, pp. 518-528, 1984.
18. G. Bosilca, R. Delmas, J. Dongarra, and J. Langou, "Algorithm-based fault tolerance applied to high performance computing," Journal of Parallel and Distributed Computing, vol. 69, no. 4, pp. 410-416, 2009.
19. Z. Chen and J. Dongarra, "Algorithm-based checkpoint-free fault tolerance for parallel matrix computations on volatile resources," in IEEE International Parallel & Distributed Processing Symposium, Apr. 2006.
20. th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, 2000, pp. 346-353.
21. G. Zheng, L. Shi, and L. V. Kale, "FTC-Charm++: An in-memory checkpoint-based fault tolerant runtime for Charm++ and MPI," in IEEE International Conference on Cluster Computing, Sep. 2004, pp. 93-103. (Pubitemid 40822360)
22. V. Tipparaju, M. Krishnan, B. Palmer, F. Petrini, and J. Nieplocha, "Towards fault resilient global arrays." in International Conference on Parallel Computing, vol. 15, 2007, pp. 339-345.
23. R. Gupta et al., "CIFTS: A coordinated infrastructure for fault-tolerant systems," in International Conference on Parallel Processing, 2009, pp. 237-245.
24. C. Engelmann, G. Vallée, T. Naughton, and S. L. Scott, "Proactive fault tolerance using preemptive migration," in Euromicro International Conference on Parallel, Distributed and Network-based Processing, Feb. 2009, pp. 252-257.
25. C. Wang, F. Mueller, C. Engelmann, and S. L. Scott, "Proactive process-level live migration in HPC environments," in Proceedings of the ACM/IEEE Conference on Supercomputing, Nov. 2008, pp. 1-12.
26. J. Nieplocha, B. Palmer, V. Tipparaju, M. Krishnan, H. Trease, and E. Aprà, "Advances, applications and performance of the global arrays shared memory programming toolkit," International Journal of High Performance Computing Applications, vol. 20, pp. 203-231, May 2006.
27. "Global Arrays," http://www.emsl.pnl.gov/docs/global.
28. M. Valiev et al., "NWChem: A comprehensive and scalable open-source solution for large scale molecular simulations," Computer Physics Communications, vol. 181, no. 9, pp. 1477-1489, 2010.
29. W. A. Jong et al., "Utilizing high performance computing for chemistry: parallel computational chemistry," Physical Chemistry Chemical Physics, vol. 12, no. 26, pp. 6896-6920, 2010.
30. D. Cociorva et al., "Space-time trade-off optimization for a class of electronic structure calculations," in Proceedings of the Programming Language Design and Implementation, 2002, pp. 177-186. (Pubitemid 34991517)
31. C. Oehmen and J. Nieplocha, "ScalaBLAST: A scalable implementation of BLAST for high-performance data-intensive bioinformatics analysis," IEEE Transactions on Parallel and Distributed Systems, vol. 17, no. 8, pp. 740-749, 2006. (Pubitemid 44070144)
32. "EMSL Basis Set Exchange," https://bse.pnl.gov/bse/portal.
33. W. Yu, Q. Gao, and D. Panda, "Adaptive connection management for scalable MPI over InfiniBand," in IEEE International Parallel and Distributed Processing Symposium, 2006.
34. rd Workshop on Resiliency in High Performance Computing, May 2010, pp. 709-714.