Fault-tolerant communication runtime support for data-centric programming models

17th International Conference on High Performance Computing, HiPC 2010

Volumn , Issue , 2010, Pages

  Vishnu, Abhinav ^a   Van Dam, Huub ^a   De Jong, Wibe ^a   Balajiz, Pavan ^b   Songy, Shuaiwen ^c  

^a PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

^c Virginia Polytechnic Institute and State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

FAULT DETECTION; FAULT TOLERANCE; SEMANTICS;

DATA CENTRIC; FAULT RESILIENCE; FAULT TOLERANT COMMUNICATIONS; ONE SIDED COMMUNICATION; PARTITIONED GLOBAL ADDRESS SPACE; PHYSICAL NODES; PROCESSING CORE; PROGRAMMING MODELS; RUNTIME SUPPORT; SPACE MODELS;

SUPERCOMPUTERS;

EID: 79952786876     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/HIPC.2010.5713195     Document Type: Conference Paper

References (39)

1. W. Gropp, E. Lusk, N. Doss, and A. Skjellum, "A High-Performance, Portable Implementation of the MPI Message Passing Interface Standard," Parallel Computing, vol. 22, no. 6, pp. 789-828, 1996.
2. A. Geist, W. Gropp, S. Huss-Lederman, A. Lumsdaine, E. L. Lusk, W. Saphir, T. Skjellum, and M. Snir, "MPI-2: Extending the message-passing interface," in Euro-Par, Vol. I, 1996, pp. 128-135.
3. J. Nieplocha, R. J. Harrison, and R. J. Littlefield, "Global Arrays: A Nonuniform Memory Access Programming Model for High-Performance Computers," Journal of Supercomputing, vol. 10, no. 2, pp. 169-189, 1996.
4. P. Husbands, C. Iancu, and K. A. Yelick, "A Performance Analysis of the Berkeley UPC Compiler," in International Conference on Supercomputing, 2003, pp. 63-73.
5. P. Charles, C. Grothoff, V. Saraswat, C. Donawa, A. Kielstra, K. Ebcioglu, C. von Praun, and V. Sarkar, "X10: An Object-Oriented Approach to Non-Uniform Cluster Computing," in OOPSLA '05: Proceedings of the 20th annual ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications. ACM, 2005, pp. 519-538.
6. B. Chamberlain, D. Callahan, and H. Zima, "Parallel Programmability and the Chapel Language," International Journal on High Performance Computing Applications, vol. 21, no. 3, pp. 291-312, 2007.
7. J. Nieplocha and B. Carpenter, "ARMCI: A Portable Remote Memory Copy Library for Distributed Array Libraries and Compiler Run-Time Systems," in Lecture Notes in Computer Science. Springer-Verlag, 1999, pp. 533-546.
8. D. Bonachea and J. Duell, "Problems with using MPI 1.1 and 2.0 as Compilation Targets for Parallel Language Implementations," International Journal on High Performance Computing Applications, vol. 1, no. 1-3, pp. 91-99, 2004.
9. W. Gropp and E. Lusk, "Fault Tolerance in Message Passing Interface Programs," International Journal on High Performance Computing Applications, vol. 18, no. 3, pp. 363-372, 2004.
10. Q. Gao, W. Yu, W. Huang, and D. K. Panda, "Application-Transparent Checkpoint/Restart for MPI Programs over InfiniBand," in International Conference on Parallel Processing, 2006, pp. 471-478.
11. G. E. Fagg and J. Dongarra, "Ft-mpi: Fault tolerant mpi, supporting dynamic applications in a dynamic world," in Proceedings of the 7th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface, London, UK, 2000, pp. 346-353.
12. J. Liu, W. Huang, B. Abali, and D. K. Panda, "High performance vmm-bypass i/o in virtual machines," in ATEC '06: Proceedings of the annual conference on USENIX '06 Annual Technical Conference. USENIX Association, 2006, pp. 3-3.
13. G. Bosilca, A. Bouteiller, F. Cappello, S. Djilali, G. Fedak, C. Germain, T. Herault, P. Lemarinier, O. Lodygensky, F. Magniette, V. Neri, and A. Selikhov, "Mpich-v: toward a scalable fault tolerant mpi for volatile nodes," in Supercomputing '02: Proceedings of the 2002 ACM/IEEE conference on Supercomputing, 2002, pp. 1-18.
14. A. Bouteiller, F. Cappello, T. Herault, G. Krawezik, P. Lemarinier, and F. Magniette, "Mpich-v2: a fault tolerant mpi for volatile nodes based on pessimistic sender based message logging," in SC '03: Proceedings of the 2003 ACM/IEEE conference on Supercomputing, 2003, p. 25.
15. R. A. F. Bhoedjang, T. Rühl, and H. E. Bal, "User-Level Network Interface Protocols," IEEE Transactions on Computers, vol. 31, no. 11, pp. 53-60, 1998.
16. J. Hursey, J. M. Squyres, and A. Lumsdaine, "A checkpoint and restart service specification for open mpi," Indiana University, Bloomington, Indiana, USA, Tech. Rep. TR635, July 2006.
17. O. Villa, S. Krishnamoorthy, J. Nieplocha, and D. M. Brown, Jr., "Scalable transparent checkpoint-restart of global address space applications on virtual machines over infiniband," in CF '09: Proceedings of the 6th ACM conference on Computing frontiers, 2009, pp. 197-206.
18. R. Brightwell, "A New MPI Implementation for Cray SHMEM," in EuroPVM/MPI, 2004, pp. 122-130.
19. InfiniBand Trade Association, "InfiniBand Architecture Specification, Release 1.2," October 2004.
20. N.J. Boden, D. Cohen, R.E. Felderman, A.E. Kulawik, C.L. Seitz, J.N. Seizovic, and W. Su, "Myrinet: A Gigabit-per-second Local Area Network," IEEE Micro, vol. 15, no. 1, pp. 29-36, February 1995.
21. F. Petrini, W. Feng, A. Hoisie, S. Coll, and E. Frachtenberg, "The Quadrics Network: High-Performance Clustering Technology," IEEE Micro, vol. 22, no. 1, pp. 46-57, 2002.
22. R. Brightwell, K. T. Pedretti, K. D. Underwood, and T. Hudson, "Seastar interconnect: Balanced bandwidth for scalable performance," IEEE Micro, vol. 26, no. 3, pp. 41-57, 2006.
23. G. Shah, J. Nieplocha, J. H. Mirza, C. Kim, R. J. Harrison, R. Govindaraju, K. J. Gildea, P. DiNicola, and C. A. Bender, "Performance and Experience with LAPI - a New High-Performance Communication Library for the IBM RS/6000 SP." in IPPS/SPDP, 1998, pp. 260-266.
24. R. K. Govindaraju, P. H. Hochschild, D. G. Grice, K. J. Gildea, R. Blackmore, C. A. Bender, C. Kim, P. Chaudhary, J. Goscinski, J. Herring, S. Martin, and J. Houston, "Architecture and Early Performance of the New IBM HPS Fabric and Adapter," in International Conference on High Performance Computing, 2004, pp. 156-165.
25. R. Sivaram, R. K. Govindaraju, P. H. Hochschild, R. Blackmore, and P. Chaudhary, "Breaking the Connection: RDMA Deconstructed," in Hot Interconnects, 2005, pp. 36-42.
26. S. Kumar, G. Dozsa, G. Almasi, P. Heidelberger, D. Chen, M. E. Giampapa, M. Blocksome, A. Faraj, J. Parker, J. Ratterman, B. Smith, and C. J. Archer, "The Deep Computing Messaging Framework: Generalized Scalable Message Passing on the Blue Gene/P Supercomputer," in ICS '08: Proceedings of the 22nd annual international conference on Supercomputing, 2008, pp. 94-103.
27. A. Vishnu and M. Krishnan, "Efficient On-demand Connection Management Protocols with PGAS Models over InfiniBand," in International Conference on Cluster, Cloud and Grid Computing, 2010.
28. A. Vishnu and D. K. P. M. K. Krishnan, "A Hardware-Software Approach to Network Fault Tolerance wwith InfiniBand Cluster," in International Conference on Cluster Computing, 2009, pp. 479-486.
29. R. Gupta, P. Beckman, B.-H. Park, E. Lusk, P. Hargrove, A. Geist, D. Panda, A. Lumsdaine, and J. Dongarra, "CIFTS: A Coordinated Infrastructure for Fault-Tolerant Systems," in ICPP '09: Proceedings of the 2009 International Conference on Parallel Processing, 2009, pp. 237-245.
30. J. Varma, C. Wang, F. Mueller, C. Engelmann, and S. L. Scott, "Scalable, Fault Tolerant Membership for MPI tasks on HPC Systems," in ICS '06: Proceedings of the 20th annual international conference on Supercomputing, 2006, pp. 219-228.
31. A. Vishnu, A. Mamidala, S. Narravula, and D. K. Panda, "Automatic Path Migration over InfiniBand: Early Experiences," in Proceedings of Third International Workshop on System Management Techniques, Processes, and Services, held in conjunction with IPDPS'07, March 2007.
32. M. J. Koop, S. Sur, Q. Gao, and D. K. Panda, "High performance mpi design using unreliable datagram for ultra-scale infiniband clusters," in ICS, 2007, pp. 180-189.
33. W. Yu, J. Wu, and D. K. Panda, "Fast and Scalable Startup of MPI Programs in InfiniBand Clusters," in International Conference on High Performance Computing, 2004, pp. 440-449.
34. Network-Based Computing Laboratory, "MVAPICH/MVAPICH2: MPI-1/MPI-2 for InfiniBand and iWARP with OpenFabrics," http://mvapich.cse.ohio-state. edu/.
35. R. A. Kendall, E. Aprà, D. E. Bernholdt, E. J. Bylaska, M. Dupuis, G. I. Fann, R. J. Harrison, J. Ju, J. A. Nichols, J. Nieplocha, T. P. Straatsma, T. L. Windus, and A. T. Wong, "High Performance Computational Chemistry: An Overview of NWChem, A Distributed Parallel Application," Computer Physics Communications, vol. 128, no. 1-2, pp. 260-283, June 2000.
36. "Chinook SuperComputer, Environmental Molecular Science Lab, PNNL," http://emsl.pnl.gov.
37. "Voltaire Technologies," http://www.voltaire.com/.
38. "Mellanox Technologies," http://www.mellanox.com/.
39. A. Vishnu, M. J. Koop, A. Moody, A. R. Mamidala, S. Narravula, and D. K. Panda, "Hot-Spot Avoidance With Multi-Pathing Over InfiniBand: An MPI Perspective," in Cluster Computing and Grid, 2007, pp. 479-486.