Optimizing non-blocking collective operations for InfiniBand

IPDPS Miami 2008 - Proceedings of the 22nd IEEE International Parallel and Distributed Processing Symposium, Program and CD-ROM

Volumn , Issue , 2008, Pages

  Hoefler, Torsten ^a   Lumsdaine, Andrew ^a  

^a INDIANA UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

APPLICATION PROGRAMMING INTERFACES (API); APPLICATIONS; COMPUTER NETWORKS; DISTRIBUTED PARAMETER NETWORKS;

COLLECTIVE OPERATIONS; NON-BLOCKING;

PARALLEL PROCESSING SYSTEMS;

EID: 51049098070     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2008.4536138     Document Type: Conference Paper

References (36)

1. T. Hoefler, J. Squyres, G. Bosilca, G. Fagg, A. Lumsdaine, and W. Rehm, "Non-Blocking Collective Operations for MPI-2," Open Systems Lab, Indiana University, Tech. Rep., 08 2006.
2. T. Hoefler, J. Squyres, W. Rehm, and A. Lumsdaine, "A Case for Non-Blocking Collective Operations," in Frontiers of High Performance Computing and Networking - ISPA 2006 Workshops, vol. 4331/2006. Springer Berlin / Heidelberg, 12 2006, pp. 155-164. [Online]. Available: ./img/hoefler-ispa06.pdf
3. F. Petrini, D. J. Kerbyson, and S. Pakin, "The Case of the Missing Supercomputer Performance: Achieving Optimal Performance on the 8, 192 Processors of ASCI Q." in Proceedings of the ACM/IEEE Supercomputing. ACM, 2003, p. 55.
4. R. Dimitrov, "Overlapping of communication and computation and early binding: Fundamental mechanisms for improving parallel performance on clusters of workstations," Ph.D. dissertation, Mississippi State University, 2001.
5. S. Gorlatch, "Send-receive considered harmful: Myths and realities of message passing," ACM Trans. Program. Lang. Syst., vol. 26, no. 1, pp. 47-56, 2004.
6. Message Passing Interface Forum, "MPI: A Message Passing Interface Standard," 1995.
7. _, "MPI-2: Extensions to the Message-Passing Interface," Technical Report, University of Tennessee, Knoxville, 1997.
8. _, "MPI-2 Journal of Development," July 1997.
9. A. Danalis, K.-Y. Kim, L. Pollock, and M. Swany, "Transformations to parallel codes for communication-computation overlap," in SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing. Washington, DC, USA: IEEE Computer Society, 2005, p. 58.
10. L. V. Kale, S. Kumar, and K. Vardarajan, "A Framework for Collective Personalized Communication," in Proceedings of IPDPS'03, Nice, France, April 2003.
11. T. Hoefler and A. Lumsdaine, "Design, Implementation, and Usage of LibNBC," Open Systems Lab, Indiana University, Tech. Rep., 08 2006.
12. T. Hoefler, A. Lumsdaine, and W. Rehm, "Implementation and performance analysis of non-blocking collective operations for mpi," in Proceedings of the 2007 ACM/IEEE conference on Supercomputing (CDROM), 2007.
13. C. Iancu, P. Husbands, and P. Hargrove, "Hunting the overlap," in PACT '05: Proceedings of the 14th International Conference on Parallel Architectures and Compilation Techniques (PACT'05). Washington, DC, USA: IEEE Computer Society, 2005, pp. 279-290.
14. J. W. III and S. Bova, "Where's the Overlap? - An Analysis of Popular MPI Implementations," 1999. [Online]. Available: citeseer.ist.psu.edu/white99wheres.html
15. W. Lawry, C. Wilson, A. B. Maccabe, and R. Brightwell, "Comb: A portable benchmark suite for assessing mpi overlap." in CLUSTER. IEEE Computer Society, 2002, pp. 472-475.
16. T. Hoefler and A. Lumsdaine, "Design and implementation of the nbc library," Indiana University, Tech. Rep., 2006.
17. The InfiniBand Trade Association, Infiniband Architecture Specification Volume 1, Release 1.2, InfiniBand Trade Association, 2003.
18. T. Hoefler, C. Viertel, T. Mehlan, F. Mietke, and W. Rehm, "Assessing Single-Message and Multi-Node Communication Performance of InfiniBand," in Proceedings of IEEE PARELEC 2006. IEEE Computer Society, 9 2006, pp. 227-232.
19. M. J. Koop, S. Sur, Q. Gao, and D. K. Panda, "High performance MPI design using unreliable datagram for ultra-scale InfiniBand clusters," in Proceedings of the 21st annual international conference on Supercom-puting. New York, NY, USA: ACM Press, 2007, pp. 180-189.
20. A. Friedley, T. Hoefler, M. L. Leininger, and A. Lumsdaine, "Scalable High Performance Message Passing over InfiniBand for Open MPI," in Proceedings of 2007 KiCC Workshop, RWTH Aachen, December 2007.
21. M. J. Koop, S. Sur, Q. Gao, and D. K. Panda, Zero-Copy Protocol for MPI using InfiniBand Unreliable Datagram," in IEEE Cluster 2007: International Conference on Cluster Computing, Austin, TX, USA, September 17-20, 2007.
22. F. Mietke, R. Baumgartl, R. Rex, T. Mehlan, T. Hoefler, and W. Rehm, "Analysis of the Memory Registration Process in the Mellanox Infini-Band Software Stack," in Euro-Par 2006 Parallel Processing. Springer-Verlag Berlin, 8 2006, pp. 124-133.
23. J. Liu, J. Wu, and D. K. Panda, "High Performance RDMA-Based MPI Implementation over InfiniBand," Int'l Journal of Parallel Programming, 2004, 2004.
24. E. Gabriel, G. E. Fagg, G. Bosilca, T. Angskun, J. J. Dongarra, J. M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R. H. Castain, D. J. Daniel, R. L. Graham, and T. S. Woodall, "Open MPI: Goals, Concept, and Design of a Next Generation MPI Implementation," in Proceedings, 11th European PVM/MPI Users' Group Meeting, Budapest, Hungary, September 2004.
25. G. M. Shipman, T. S. Woodall, G. Bosilca, R. ch L. Graham, and A. B. Maccabe, "High performance RDMA protocols in HPC," in Proceedings, 13th European PVM/MPI Users' Group Meeting, ser. Lecture Notes in Computer Science. Bonn, Germany: Springer-Verlag, September 2006.
26. C. L. Lawson, R. J. Hanson, D. Kincaid, and F. T. Krogh, "Basic Linear Algebra Subprograms for FORTRAN usage," in In ACM Trans. Math. Soft., 5 (1979), pp. 308-323, 1979.
27. W. Gropp and E. L. Lusk, "Reproducible measurements of mpi performance characteristics," in Proceedings of the 6th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. London, UK: Springer-Verlag, 1999.
28. T. Worsch, R. Reussner, and W. Augustin, "On benchmarking collective mpi operations," in Proceedings of the 9th European PVM/MPI Users' Group Meeting on Recent Advances in Parallel Virtual Machine and Message Passing Interface. London, UK: Springer-Verlag, 2002.
29. T. Hoefler, T. Schneider, and A. Lumsdaine, "Accurately Measuring Collective Operations at Massive Scale," in Accepted to the PMEO-PDS 08 workshop in conjunction with the 22nd International Parallel and Distributed Processing Symposium (IPDPS), April 2008.
30. S. Sur, H.-W. Jin, L. Chai, and D. K. Panda, "Rdma read based rendezvous protocol for mpi over infiniband: design alternatives and benefits," in PPoPP '06: Proceedings of the eleventh ACM SIGPLAN symposium on Principles and practice of parallel programming. New York, NY, USA: ACM, 2006, pp. 32-39.
31. T. Hoefler, T. Mehlan, A. Lumsdaine, and W. Rehm, "Netgauge: A Network Performance Measurement Framework," in Proceedings of Third International Conference, HPCC 2007, vol. 4782. Springer, 9 2007, pp. 659-671. [Online]. Available: ./img/hoefler-netgauge.pdf
32. T. Hoefler, A. Lichei, and W. Rehm, "Low-Overhead LogGP Parameter Assessment for Modern Interconnection Networks," 03 2007. [Online]. Available: ./img/hoefler-pmeo07.pdf
33. Intel Corporation, "Intel Application Notes - Using the RDTSC Instruction for Performance Monitoring," Intel, Tech. Rep., 1997.
34. J. M. Squyres and A. Lumsdaine, "The Component Architecture of Open MPI: Enabling Third-Party Collective Algorithms," in 18th ACM International Conference on Supercomputing, Workshop on Component Models and Systems for Grid Applications, St. Malo, France, 2004.
35. T. Hoefler, C. Siebert, and W. Rehm, "A practically constant-time MPI Broadcast Algorithm for large-scale InfiniBand Clusters with Multicast," in Proceedings of the 21st IEEE International Parallel & Distributed Processing Symposium. IEEE Computer Society, 03 2007, p. 232. [Online]. Available: ./img/hoefler-cac07.pdf
36. T. Hoefler, T. Mehlan, F. Mietke, and W. Rehm, "Fast Barrier Synchronization for InfiniBand," in Proceedings, 20th International Parallel and Distributed Processing Symposium IPDPS 2006 (CAC 06), April 2006.