Designing topology-aware collective communication algorithms for large scale InfiniBand clusters: Case studies with Scatter and Gather

Proceedings of the 2010 IEEE International Symposium on Parallel and Distributed Processing, Workshops and Phd Forum, IPDPSW 2010

Volumn , Issue , 2010, Pages

  Kandalla, Krishna ^a   Subramoni, Hari ^a   Vishnu, Abhinav ^b   Panda, Dhabaleswar K ^a  

^a Ohio State University   (United States)

^b PACIFIC NORTHWEST NATIONAL LABORATORY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COLLECTIVE COMMUNICATIONS; COLLECTIVE OPERATIONS; COMMUNICATION COST; COMMUNICATION MODELS; COMPUTING PLATFORM; FINITE NUMBER; INFINIBAND CLUSTERS; MESSAGE EXCHANGE; MICRO-BENCHMARK; MODERN HIGH PERFORMANCE; MULTI CORE; MULTIPLE HOPS; PERFORMANCE CHARACTERISTICS; SUPERCOMPUTING SYSTEMS; TOPOLOGY AWARE;

DISTRIBUTED PARAMETER NETWORKS; HIERARCHICAL SYSTEMS; INFORMATION THEORY; KNOWLEDGE MANAGEMENT; QUEUEING NETWORKS; TOPOLOGY;

CLUSTERING ALGORITHMS;

EID: 77954069151     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2010.5470853     Document Type: Conference Paper

References (29)

1. Texas Advanced Supercomputing Center, http://www.tacc.utexas.edu/ resources/hpc/.
2. Los Alamos National Laboratory, http://www.lanl.gov/discover/roadrunner- fastest-computer.
3. InfiniBand Trade Association, http://www.infinibandta.org/.
4. IEEE 802.3 Ethernet Working Group, "IEEE 802.3," http://www.ieee802.org/3/.
5. Intel Nehalem-EX, http://download.intel.com/pressroom/pdf/nehalem-ex.pdf.
6. AMD Magny Cours, http://blogs.amd.com/work/tag/magny-cours/.
7. Sun Microsystems, http://www.sun.com/software/sge/.
8. Frachtenberg, E. Petrini, F. Fernandez, J. Pakin, S., "STORM: Scalable Resource Management for Large-Scale Parallel Computers," in IEEE Transactions on Computers, Volume 55, Issue: 12, Dec, pp. 1572-1587.
9. Redsky: Top500 Supercomputing Sites, http://www.top500.org/system/10188.
10. MPI Forum, "MPI: A Message Passing Interface," in Proceedings of Supercomputing, 1993.
11. MVAPICH2, http://mvapich.cse.ohio-state.edu/.
12. A. R. Mamidala and R. Kumar and D. De and D. K.Panda, "MPI Collectives on Modern Multicore Clusters: Performance Optimizations and Communication Characteristics," in 8th IEEE International Symposium on Cluster Computing and the Grid, 2008, Lyon, pp. 130-137.
13. A. R. Mamidala, A. Vishnu and D. K. Panda, "Efficient Shared Memory and RDMA Based Design for MPI-Allgather over InfiniBand," in 13th European PVM/MPI User's Group Meeting, Bonn, Germany, September 17-20, 2006, Vol. 4192, 2006.
14. R. Kumar, A. R. Mamidala and D. K. Panda, "Scaling Alltoall Collective on Multi-core Systems," in IEEE International Symposium on Parallel and Distributed Processing, 2008, IPDPS, 2008, Miami, FL.
15. K. Kandalla, H. Subramoni, G. Santhanaraman, M. Koop and D. K.Panda, "Designing Multi-leader-based Allgather Algorithms for Multi-core Clusters," in IEEE International Symposium on Parallel and Distributed Processing, IPDPS, 2009, Rome.
16. T. Hoefler, T. Schneider, and A. Lumsdaine, "The Impact of Network Noise at Large-Scale Communication Performance," in Proceedings of the 2009 IEEE International Symposium on Parallel and Distributed Processing, 2009, pp. 1-8.
17. R. Thakur, R. Rabenseifner, and W. Gropp, "Optimization of Collective Communication Operations in MPICH," in Int'l Journal of High Performance Computing Applications, 2005, pp. (19)1:49-66.
18. R. Thakur and W. Gropp, "Improving the Performance of Collective Operations in MPICH," in Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science, 2003, Vol. 2840/2003, 2003, pp. 257-267.
19. MPICH2, http://www.mcs.anl.gov/research/projects/mpich2/.
20. Open-MPI, http://www.open-mpi.org/.
21. B. Jakimovski and M. Gusev, "Improving Multilevel Approach for Optimizing Collective Communications in Computational Grids," in Advances in Grid Computing - EGC, Lecture Notes in Computer Science, Volume 3470/2005, 2005, pp. 548-556.
22. C. Coti, T. Herault, and F. Cappello, "MPI Applications on Grids: A Topology Aware Approach," in Euro-Par 2009 Parallel Processing, Lecture Notes in Computer Science, Volume 5704/2009, 2009, pp. 466-477.
23. Craig A. Lee, "Topology-Aware Communication in Wide-Area Message-Passing," in Recent Advances in Parallel Virtual Machine and Message Passing Interface, Lecture Notes in Computer Science, Volume 2840/2003, 2003, pp. 644-652.
24. N. T. Karonis, B. R. de Supinski, I. T. Foster, W. Gropp and E. L. Lusk, "A Multilevel Approach to Topology-Aware Collective Operations in Computational Grids," CoRR, vol. cs.DC/0206038, 2002.
25. J. Lawrence and X. Yuan, "An MPI Tool for Automatically Discovering the Switch Level Topologies of Ethernet Clusters," in IEEE International Symposium on Parallel and Distributed Processing, 2008. IPDPS 2008, Miami, FL, April, 2008, pp. 1-8.
26. P. Patarasuk and X. Yuan, "Bandwidth Efficient Allreduce Operation on Tree Topologies," in IEEE International Symposium on Parallel and Distributed Processing, 2007. IPDPS 2007, Long Beach, CA, 2007, pp. 1-8.
27. Jesper Larsson Traff, "Hierarchical Gather/Scatter Algorithms with Graceful Degradation," in IPDPS, vol. 1, pp.80, 18th International Parallel and Distributed Processing Symposium (IPDPS'04).
28. P. Bar, C. Coti, D. Groen, T. Herault, V. Kravtsov, A. Schuster and M. Swain, "Running Parallel Applications with Topology-Aware Grid Middleware," in 5th IEEE International Conference on e-Science (eScience 2009), Oxford, UK, 2009.
29. Sameer Kumar, Yogish Sabharwal, Rahul Garg, Philip Heidelberger, "Optimization of All-to-All Communication on the Blue Gene/L Supercomputer," in Proceedings of the 2008 37th International Conference on Parallel Processing, pp. 320-329.