Collective communication on architectures that support simultaneous communication over multiple links

Proceedings of the ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, PPOPP

Volumn 2006, Issue , 2006, Pages 2-11

  Chan, Ernie ^a   Van De Geijn, Robert ^a   Gropp, William ^b   Thakur, Rajeev ^b  

^a University of Texas at Austin   (United States)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Algorithms; Performance

Indexed keywords

ALGORITHMS; BROADCASTING; MATHEMATICAL MODELS; PARALLEL PROCESSING SYSTEMS; TELECOMMUNICATION LINKS;

COMMUNICATION ALGORITHMS; MULTIPLE NODES; PARALLEL COMPUTATION;

TELECOMMUNICATION SYSTEMS;

EID: 33751022826     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/1122971.1122975     Document Type: Conference Paper

References (33)

1. G. Almasi, C. Archer, J. G. Castanos, J. A. Gunnels, C. C. Erway, P. Heidelberger, X. Martorell, J. E. Moreira, K. Pinnow, J. Ratterman, B. D. Steinmacher-Burow, W. Gropp, and B. Toonen. Design and implementation of message-passing services for the Blue Gene/L supercomputer. IBM J. Res. and Dev., 49(2/3):393-406, March/May 2005.
2. M. Barnett, S. Gupta, D. Payne, L. Shuler, R. A. van de Geijn, and J. Watts. Interprocessor collective communication library (intercom). In Proceedings of the Scalable High Performance Computing Conference 1994, 1994.
3. M. Barnett, R. Littlefield, D. Payne, and R. van de Geijn. On the efficiency of global combine algorithms for 2-d meshes with wormhole routing. J. Parallel Distrib. Comput., 24:191-201, 1995.
4. M. Barnett, D. Payne, and R. van de Geijn. Optimal broadcasting in mesh-connected architectures. Computer Science report TR-91-38, Univ. of Texas, 1991.
5. M. Barnett, D. Payne, R. van de Geijn, and J. Watts, Broadcasting on meshes with wormhole routing. J. Parallel Distrib. Comput., 35(2):111-122, 1996.
6. Gregory D. Benson, Cho-Wai Chu, Qing Huang, and Sadik G. Caglar. A comparison of MPICH allgather algorithms on switched networks. In Jack Dongarra, Domenico Laforenza, and Salvatore Orlando, editors, Recent Advances in Parallel Virtual Machine and Message Passing Interface, 10th European PVM/MPI Users' Group Meeting, pages 335-343. Lecture Notes in Computer Science 2840, Springer, September 2003.
7. Massimo Bernaschi, Giulio Iannello, and Mario Lauria. Experimental results about MPI collective communication operations. In Proceedings of HPCN99, 1999.
8. Ernie W. Chan, Marcel F. Heimlich, Avi Purkayastha, and Robert A. van de Geijn. On optimizing collective communication. In Proceedings of the 2004 IEEE International Conference on Cluster Computing, pages 145-155, San Diego, CA, 2004. IEEE.
9. Graham E. Fagg, Sathish S. Vadhiyar, and Jack J. Dongarra. ACCT: Automatic collective communications tuning. In Jack Dongarra, Peter Kacsuk, and Norbert Podhorszki, editors, Recent Advances in Parallel Virutal Machine and Message Passing Interface, number 1908 in Springer Lecture Notes in Computer Science, pages 354-361, September 2000.
10. G. Fox, M. Johnson, G. Lyzenga, S. Otto, J. Salmon, and D. Walker. Solving Problems on Concurrent Processors, volume I. Prentice Hall, 1988.
11. A. Gara, M. A. Blumrich, D. Chen, G. L.-T. Chiu, P. Coteus, M. E. Giampapa, R. A. Haring, P. Heidelberger, D. Hoenicke, G. V. Kopcsay, T. A. Liebsch, M. Ohmacht, B. D. Steinmacher-Burow, T. Takken, and P. Vranas. Overview of the Blue Gene/L system architecture. IBM J. Res. and Dev., 49(2/3):195-212, March/May 2005.
12. Ching-Tien Ho and S. Lennart Johnsson. Distributed routing algorithms for broadcasting and personalized communication in hypercubes. In Proceedings of the 1986 International Conference on Parallel Processing, pages 640-648. IEEE, 1986.
13. S. L. Johnsson and C. T. Ho. Optimum broadcasting and personalized communication in hypercubes. IEEE Transactions on Computers, pages 1249-1268, September 1989.
14. L. V. Kale, Sameer Kumar, and Krishnan Vardarajan. A framework for collective personalized communication. In Proceedings of the 17th International Parallel and Distributed Processing Symposium (IPDPS '03), 2003.
15. N. Karonis, B. de Supinski, I. Foster, W. Gropp, E. Lusk, and J. Bresnahan. Exploiting hierarchy in parallel computer networks to optimize collective operation performance. In Proceedings of the Fourteenth International Parallel and Distributed Processing Symposium (IPDPS '00), pages 377-384, 2000.
16. T. Kielmann, R.F.H. Hofman, H.E. Bal, A. Plaat, and R.A.F. Bhoedjang. MagPIe: MPI's collective communication operations for clustered wide area systems. In ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP'99), pages 131-140. ACM, May 1999.
17. S.L. Lillevik. The Touchstone 30 Gigaflop DELTA Prototype. In Sixth Distributed Memory Computing Conference Proceedings, pages 671-677. IEEE Computer Society Press, 1991.
18. Prasenjit Mitra, David Payne, Lance Shuler, Robert van de Geijn, and Jerrell Watts. Fast collective communication libraries, please. In Proceedings of the Intel Supercomputing Users' Group Meeting 1995, 1995.
19. D. Payne, L. Shuler, R. van de Geijn, and J. Watts. Streetguide to collective communication, unpublished manuscript.
20. Rolf Rabenseifner and Gerhard Wellein. Communication and optimization aspects of parallel programming models on hybrid architectures. International Journal of High-Performance Computing Applications, 17(1):49-62, 2003.
21. Y. Saad and M.H. Schultz. Data communications in hypercubes. J. Parallel Distrib. Comput., 6:115-135, 1989.
22. Mohak Shroff and Robert A. van de Geijn. Collmark MPI collective communication benchmark. unpublished manuscript, 2001.
23. Marc Snir, Steve Otto, Steven Huss-Lederman, David W. Walker, and Jack Dongarra. MPI: The Complete Reference, volume 1, The MPI Core. The MIT Press, 2nd edition, 1998.
24. Rajeev Thakur and William Gropp. Improving the performance of collective operations in MPICH. In Proceedings of the 10th European PVM/MPI Users' Group Conference (Euro PVN/MPI 2003), pages 257-267, September 2003.
25. Rajeev Thakur, William Gropp, and Brian Toonen. Optimizing the synchronization operations in MPI one-sided communication. International Journal of High-Performance Computing Applications, 19(2):119-128, Summer 2005.
26. Rajeev Thakur, Rolf Rabenseifner, and William Gropp. Optimization of collective communication operations in MPICH. International Journal of High-Performance Computing Applications, (19)1:49-66, Spring 2005.
27. V. Tipparaju, J. Nieplocha, and D. K. Panda. Fast collective operations using shared and remote memory access protocols on clusters. In Proceedings of the 17th International Parallel and Distributed Processing Symposium (IPDPS '03), 2003.
28. Jesper Larason Traff and Andreas Ripke. An optimal broadcast algorithm adapted to SMP clusters. In EuroPVM/MPI 2005, LNCS 3666, pages 48-56, 2005.
29. Jesper Larason Traff and Andreas Ripke. Optimal broadcast for fully connected networks. In HPCC 2005, LNCS 3726, pages 45-56, 2005.
30. Sathish S. Vadhiyar, Graham E. Fagg, and Jack Dongarra. Automatically tuned collective communication. In Proceedings of Supercomputing 2000, Dallas, TX.
31. Robert van de Geijn. On global combine operations. J. Parallel Distrib. Comput., 22:324-328, 1994.
32. Jerrell Watts and Robert van de Geijn. A pipelined broadcast for multidimensional meshes. Parallel Processing Letters, 5(2):281-292, 1995.
33. Thomas Worsch, Ralf Reussner, and Werner Augustin. On bench-marking collective MPI operations. In Dieter Kranzlmüller, Peter Kacsuk, Jack Dongarra, and Jens Volkert, editors, Recent Advances in Parallel Virtual Machine and Message Passing Interface, 9th European PVM/MPI Users' Group Meeting, pages 271-279. Lecture Notes in Computer Science 2474, Springer, September 2002.