Bandwidth efficient all-to-all broadcast on switched clusters

Proceedings - IEEE International Conference on Cluster Computing, ICCC

Volumn , Issue , 2005, Pages

  Faraj, Ahmad ^a   Patarasuk, Pitch ^a   Xin, Yuan ^a  

^a Florida State University   (United States)

Author keywords

Degree; Including MPICH and LAM MPI; Libraries; To a very large

Indexed keywords

ALL-TO-ALL BROADCAST; BANDWIDTH EFFICIENCY; CLUSTER COMPUTING; COMMUNICATION PATHS; CONNECTED NETWORKS; CUT-THROUGH; DEGREE; ETHERNET SWITCHED CLUSTERS; INCLUDING MPICH AND LAM/MPI; INTERNATIONAL CONFERENCES; LIBRARIES; SINGLE SWITCH; TO A VERY LARGE; TREE TOPOLOGY;

BANDWIDTH; BLOCK CODES; BROADCASTING; RADIO BROADCASTING; SWITCHES; TELECOMMUNICATION SYSTEMS; TOPOLOGY; WIRELESS TELECOMMUNICATION SYSTEMS;

CHLORINE COMPOUNDS;

EID: 50149106169     PISSN: 15525244     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/CLUSTR.2005.347049     Document Type: Conference Paper

References (22)

1. G. D. Benson, C. Chu, Q. Huang, and S. G. Caglar, "A Comparison of MPICH Allgather Algorithms on Switched Networks," In Proceedings of the 10th EuroPVM/MPI 2003 Conference, Venice, Italy, pages 335-343, September 2003.
2. J. Bruck, C. Ho, S. Kipnis, E. Upfal, and D. Weath-ersby, "Efficient algorithms for all-to-all communications in multiport messagepassing systems," IEEE Transactions on Parallel and Distributed Systems, 8(11), pages 1143-1156, November 1997.
3. M. Golebiewski, R. Hempel, and J. L. Traff, "Algorithms for Collective Communication Operations on SMP Clusters," In The 1999 Workshop on Cluster-Based Computing held in conjunction with 13th ACM-SIGARCH International Conference on Supercomputing (ICS'99), page 1115, June 1999.
4. W. Gropp and E. Lusk, "Reproducible Measurements of MPI Performance Characteristics." Tech. Report ANL/MCS-P755-0699, Argonne National Labratory, June 1999.
5. J. Han and C. Han, "Efficient All-to-All Broad-cast in Switch-Based Networks with Irregular Topology," The Fourth International Conference on High-Performance Computing in the Asia-Pacific Region, Beijing, China, pages 112-116, May 2000.
6. Myricom homepage, http://www.myri.com.
7. M. Jacunski, P. Sadayappan, and D.K. Panda, "All-to-All Broadcast on Switch-Based Clusters of Work-stations," Proceedings of 1999 International Parallel Processing Symposium, San Juan, Puerto Rico, April 1999.
8. S. L. Johnsson and C. T. Ho, "Optimum Broadcasting and Personalized Communication in Hypercubes", IEEE Transactions on Computers, 38(9):1249-1268, Sept. 1989.
9. T. Kielmann and R. F. H. Hofman and H. E. Bal and A. Plaat and R.A. F. Bhoedjang, "MagPIeMPI's Collective Communication Operations for Clustered Wide Area Systems," In Proceeding Seventh ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, Atlanta, GA, pages 131-140, May 1999.
10. S. Kumar and L. V. Kale, "Scaling All-to-All Multicast on Fat-tree Networks," The 10th International Conference on Parallel and Distributed Systems (IC-PADS 2004), Newport Beach, CA, pages 205-214, July 2004.
11. LAM/MPI Parallel Computing, Available at http://www.lam-mpi.org.
12. "MPICH - A Portable Implementation of MPI," Available at http://www.mcs.anl.gov/mpi/mpich.
13. The MPI Forum, "The MPI-2: Extensions to the Message Passing Interface," Available at http://www.mpi-forum.org/docs/mpi-20-html/mpi2- report.html.
14. E. Oh and I. A. Kanj, "Efficient All-to-All Broadcast Schemes in Distributed-Memory Parallel Computers," The 16th International Symposium on High Performance Computing Systems and Applications (HPCS '02), IEEE, pages 65-70, 2002.
15. D.S. Scott, "Efficient All-to-All Communication Patterns in Hypercube and Meshtopologies," the Sixth Distributed Memory Computing Conference, pages 398-403, 1991.
16. A. Tam and C. Wang, "Efficient Scheduling of Complete Exchange on Clusters," the ISCA 13th International Conference on Parallel and Distributed Computing Systems, August 2000.
17. A. Tanenbaum, "Computer Networks", 4th Edition, 2004.
18. R. Thakur and A. Choudhary, "All-to-all Communication on Meshes with Wormhole Routing," 8th International Parallel Processing Symposium (IPPS), April 1994.
19. R. Thakur, R. Rabenseifner, and W. Gropp, "Optimizing of Collective Communication Operations in MPICH," ANL/MCS-P1140-0304, Mathematics and Computer Science Division, Argonne National Laboratory, March 2004.
20. E. A. Varvarigos and D. P. Bertsekas, "Communication Algorithms for Isotropic Tasks in Hypercubes and Wraparound Meshes," Parallel Computing, 18(11):1233-1257, 1992.
21. Y. Yang and J. Wang, "Efficient all-to-all broadcast in all-port mesh and torus networks," Proceedings of 5th IEEE International Symposium on High-Performance, Computer Architecture (HPCA-5), Orlando, FL, pages 290-299, January 1999.
22. W. Yu, D. Buntinas, and D. K. Panda, "Scalable and High Performance NIC-Based Allgather over Myrinet/GM," TR-22, OSU-CISRC, April 2004.