Enabling highly-scalable remote memory access programming with MPI-3 one sided

International Conference for High Performance Computing, Networking, Storage and Analysis, SC

Volumn , Issue , 2013, Pages

  Gerstenberger, Robert ^a   Besta, Maciej ^a   Hoefler, Torsten ^a  

^a ETH ZURICH   (Switzerland)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER PROGRAMMING; COMPUTER SCIENCE;

APPLICATION PERFORMANCE; APPLICATION STUDIES; CRITICAL FUNCTIONS; MEMORY CONSUMPTION; PERFORMANCE MODEL; PROGRAMMING COMPLEXITY; REMOTE DIRECT MEMORY ACCESS; REMOTE MEMORY ACCESS;

COMPLEX NETWORKS;

EID: 84899678292     PISSN: 21674329     EISSN: 21674337     Source Type: Conference Proceeding    
DOI: 10.1145/2503210.2503286     Document Type: Conference Paper

References (41)

1. R. Alverson, D. Roweth, and L. Kaplan. The Gemini system interconnect. In Proceedings of the IEEE Symposium on High Performance Interconnects (HOTI'10), pages 83-87. IEEE Computer Society, 2010.
2. B. Arimilli, R. Arimilli, V. Chung, S. Clark, W. Denzel, B. Drerup, T. Hoefler, J. Joyner, J. Lewis, J. Li, N. Ni, and R. Rajamony. The PERCS high-performance interconnect. In Proceedings of the IEEE Symposium on High Performance Interconnects (HOTI'10), pages 75-82. IEEE Computer Society, 2010.
3. R. Barriuso and A. Knies. SHMEM user's guide for C, 1994.
4. G. Bauer, S. Gottlieb, and T. Hoefler. Performance modeling and comparative analysis of the MILC lattice QCD application su3 rmd. In Proceedings of the IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGRID'12), pages 652-659. IEEE Computer Society, 2012.
5. M. Beck and M. Kagan. Performance evaluation of the RDMA over ethernet (RoCE) standard in enterprise data centers infrastructure. In Proceedings of the Workshop on Data Center-Converged and Virtual Ethernet Switching (DC-CaVES'11), pages 9-15. ITCP, 2011.
6. C. Bell, D. Bonachea, Y. Cote, J. Duell, P. Hargrove, P. Husbands, C. Iancu, M. Welcome, and K. Yelick. An evaluation of current high-performance networks. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS'03). IEEE Computer Society, 2003.
7. C. Bell, D. Bonachea, R. Nishtala, and K. Yelick. Optimizing bandwidth limited problems using one-sided communication and overlap. In Proceedings of the International Conference on Parallel and Distributed Processing (IPDPS'06), pages 1-10. IEEE Computer Society, 2006.
8. C. Bernard, M. C. Ogilvie, T. A. DeGrand, C. E. DeTar, S. A. Gottlieb, A. Krasnitz, R. Sugar, and D. Toussaint. Studying quarks and gluons on MIMD parallel computers. International Journal of High Performance Computing Applications, 5(4):61-70, 1991.
9. G. Faanes, A. Bataineh, D. Roweth, T. Court, E. Froese, B. Alverson, T. Johnson, J. Kopnick, M. Higgins, and J. Reinhard. Cray Cascade: A scalable HPC system based on a Dragonfly network. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'12), pages 103:1-103:9. IEEE Computer Society, 2012.
10. B. B. Fraguela, Y. Voronenko, and M. Pueschel. Automatic tuning of discrete Fourier Transforms driven by analytical modeling. In Proceedings of the International Conference on Parallel Architecture and Compilation Techniques (PACT'09), pages 271-280. IEEE Computer Society, 2009.
11. A. Y. Grama, A. Gupta, and V. Kumar. Isoefficiency: measuring the scalability of parallel algorithms and architectures. Parallel and Distributed Technology: Systems and Technology, 1(3):12-21, 1993.
12. T. Hoefler, J. Dinan, D. Buntinas, P. Balaji, B. Barrett, R. Brightwell, W. Gropp, V. Kale, and R. Thakur. Leveraging MPI's one-sided communication interface for shared-memory programming. In Recent Advances in the Message Passing Interface (EuroMPI'12), volume LNCS 7490, pages 132-141. Springer, 2012.
13. T. Hoefler and S. Gottlieb. Parallel zero-copy algorithms for Fast Fourier Transform and conjugate gradient using MPI datatypes. In Recent Advances in the Message Passing Interface (EuroMPI'10), volume LNCS 6305, pages 132-141. Springer, 2010.
14. T. Hoefler, T. Schneider, and A. Lumsdaine. Characterizing the influence of system noise on large-scale applications by simulation. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'10), pages 1-11. IEEE Computer Society, 2010.
15. T. Hoefler, C. Siebert, and A. Lumsdaine. Scalable communication protocols for dynamic sparse data exchange. In Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'10), pages 159-168. ACM, 2010.
16. ISO Fortran Committee. Fortran 2008 Standard (ISO/IEC 1539-1:2010). 2010.
17. W. Jiang, J. Liu, H.-W. Jin, D. K. Panda, W. Gropp, and R. Thakur. High performance MPI-2 one-sided communication over InfiniBand. In Proceedings of the IEEE International Symposium on Cluster Computing and the Grid (CCGRID'04), pages 531-538. IEEE Computer Society, 2004.
18. S. Karlsson and M. Brorsson. A comparative characterization of communication patterns in applications using MPI and shared memory on an IBM SP2. In Proceedings of the International Workshop on Network-Based Parallel Computing: Communication, Architecture, and Applications (CANPC'98), pages 189-201. Springer, 1998.
19. R. M. Karp, A. Sahay, E. E. Santos, and K. E. Schauser. Optimal broadcast and summation in the LogP model. In Proceedings of the ACM Symposium on Parallel Algorithms and Architectures (SPAA'93), pages 142-153. ACM, 1993.
20. S. Kumar, A. Mamidala, D. A. Faraj, B. Smith, M. Blocksome, B. Cernohous, D. Miller, J. Parker, J. Ratterman, P. Heidelberger, D. Chen, and B. D. Steinmacher-Burrow. PAMI: A parallel active message interface for the Blue Gene/Q supercomputer. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS'12), pages 763-773. IEEE Computer Society, 2012.
21. J. Larsson Traff, W. D. Gropp, and R. Thakur. Self-consistent MPI performance guidelines. IEEE Transactions on Parallel and Distributed Systems, 21(5):698-709, 2010.
22. J. Mellor-Crummey, L. Adhianto, W. N. Scherer III, and G. Jin. A new vision for Coarray Fortran. In Proceedings of the Conference on Partitioned Global Address Space Programming Models (PGAS'09), pages 5:1-5:9. ACM, 2009.
23. J. M. Mellor-Crummey and M. L. Scott. Scalable reader-writer synchronization for shared-memory multiprocessors. SIGPLAN Notices, 26(7):106-113, 1991.
24. J. M. Mellor-Crummey and M. L. Scott. Synchronization without contention. SIGPLAN Notices, 26(4):269-278, 1991.
25. A. A. Mirin and W. B. Sawyer. A scalable implementation of a finite-volume dynamical core in the community atmosphere model. International Journal of High Performance Computing Applications, 19(3):203-212, 2005.
26. MPI Forum. MPI: A Message-Passing Interface standard. Version 2. 2, 2009.
27. MPI Forum. MPI: A Message-Passing Interface standard. Version 3. 0, 2012.
28. R. Nishtala, P. H. Hargrove, D. O. Bonachea, and K. A. Yelick. Scaling communication-intensive applications on BlueGene/P using one-sided communication and overlap. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS'09), pages 1-12. IEEE Computer Society, 2009.
29. OpenFabrics Alliance (OFA). OpenFabrics Enterprise Distribution (OFED) www. openfabrics. org.
30. F. Petrini, D. J. Kerbyson, and S. Pakin. The case of the missing supercomputer performance: Achieving optimal performance on the 8,192 processors of ASCI Q. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'03). ACM, 2003.
31. S. Potluri, P. Lai, K. Tomko, S. Sur, Y. Cui, M. Tatineni, K. W. Schulz, W. L. Barth, A. Majumdar, and D. K. Panda. Quantifying performance benefits of overlap using MPI-2 in a seismic modeling application. In Proceedings of the ACM International Conference on Supercomputing (ICS'10), pages 17-25. ACM, 2010.
32. R. Ross, R. Latham, W. Gropp, E. Lusk, and R. Thakur. Processing MPI datatypes outside MPI. In Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI'09), volume LNCS 5759, pages 42-53. Springer, 2009.
33. G. Santhanaraman, P. Balaji, K. Gopalakrishnan, R. Thakur, W. Gropp, and D. K. Panda. Natively supporting true one-sided communication in MPI on multi-core systems with InfiniBand. In Proceedings of the IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGRID'09), pages 380-387. IEEE Computer Society, 2009.
34. H. Shan, B. Austin, N. Wright, E. Strohmaier, J. Shalf, and K. Yelick. Accelerating applications at scale using one-sided communication. In Proceedings of the Conference on Partitioned Global Address Space Programming Models (PGAS'12), 2012.
35. The InfiniBand Trade Association. Infiniband Architecture Specification Volume 1, Release 1. 2. InfiniBand Trade Association, 2004.
36. UPC Consortium. UPC language specifications, v1. 2, 2005. LBNL-59208.
37. J. Willcock, T. Hoefler, N. Edmonds, and A. Lumsdaine. Active Pebbles: Parallel programming for data-driven applications. In Proceedings of the ACM International Conference on Supercomputing (ICS'11), pages 235-245. ACM, 2011.
38. M. Woodacre, D. Robb, D. Roe, and K. Feind. The SGI Altix TM 3000 global shared-memory architecture, 2003.
39. T. S. Woodall, G. M. Shipman, G. Bosilca, and A. B. Maccabe. High performance RDMA protocols in HPC. In Recent Advances in Parallel Virtual Machine and Message Passing Interface (EuroPVM/MPI'06), volume LNCS 4192, pages 76-85. Springer, 2006.
40. J. Zhang, B. Behzad, and M. Snir. Optimizing the Barnes-Hut algorithm in UPC. In Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis (SC'11), pages 75:1-75:11. ACM, 2011.
41. X. Zhao, G. Santhanaraman, and W. Gropp. Adaptive strategy for one-sided communication in MPICH2. In Recent Advances in the Message Passing Interface (EuroMPI'12), pages 16-26. Springer, 2012.