Designing power-aware collective communication algorithms for infiniband clusters

Proceedings of the International Conference on Parallel Processing

Volumn , Issue , 2010, Pages 218-227

  Kandalla, Krishna ^a   Mancini, Emilio P ^a   Sur, Sayantan ^a   Panda, Dhabaleswar K ^a  

^a The Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COLLECTIVE COMMUNICATIONS; COMMUNICATION OPERATION; COMMUNICATION PHASIS; DESIGN SOFTWARES; DYNAMIC VOLTAGE AND FREQUENCY SCALING; FINE-GRAINED POWER; INFINIBAND CLUSTERS; MAINTENANCE COST; MICROBENCHMARKS; MULTICORE ARCHITECTURES; PARALLEL APPLICATION; POWER CONSUMED; POWER CONSUMPTION; POWER-AWARE; SUPERCOMPUTING SYSTEMS; THEORETICAL MODELS;

BENCHMARKING; MAINTENANCE; NETWORK ARCHITECTURE; SOFTWARE DESIGN;

CLUSTERING ALGORITHMS;

EID: 78649607564     PISSN: 01903918     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPP.2010.78     Document Type: Conference Paper

References (27)

1. InfiniBand Trade Association, http://www.infinibandta.org/.
2. IEEE 802.3 Ethernet Working Group, "IEEE 802.3," http: //www.ieee802.org/3/.
3. Mellanox Technologies, "InfiniBand and TCP in the Data-Center."
4. MPI Forum, "MPI: A Message Passing Interface," in Proc. of Supercomputing, 1993.
5. M. Y. Lim et al, "Adaptive, Transparent Frequency and Voltage Scaling of Communication Phases in MPI Programs," in Proc. of the 2006 ACM/IEEE Conf. on Supercomputing, Tampa, Florida, 2006.
6. Vincent W. Freeh and David K. Lowenthal, "Using Multiple Energy Gears in MPI Programs on a Power-Scalable Cluster," in Proc. of the 10th ACM SIGPLAN Symp. on Principles and Practice of Par. Prog., 2005, pp. 164-173.
7. V. W. Freeh, F. Pan, N. Kappiah, and R. S. David K. Lowenthal, "Exploring the Energy-Time Tradeoff in MPI Programs on a Power-Scalable Cluster," in Proc. of 19th IEEE Int. Par. and Dist. Processing Symposium (IPDPS'05), 2007.
8. Rong Ge et al, "Modeling and Evaluating Energy- Performance Efficiency of Parallel Processing on Multicore based Power Aware Systems," in Proc. of IEEE Int. Sym. On Par. and Dist. Processing, Rome, Italy, 2009, pp. 1-8.
9. K. W. Cameron, R. Ge, and X. Feng, "High- Performance,Power-Aware Distributed Computing for Scientific Applications," Computer, vol. 38, no. 11, pp. 40-47, November 2005. (Pubitemid 41709766)
10. MVAPICH2, http://mvapich.cse.ohio-state.edu/.
11. Top500, "Top500 Supercomputing systems," June 2010, http://www.top500.org/lists/2010/06.
12. Intel, "Intel Nehalem," http://www.intel.com/technology/ architecture-silicon/next-gen/.
13. A. R. Mamidala et al, "MPI Collectives on Modern Multicore Clusters: Performance Optimizations and Communication Characteristics," in Proc. of 8th IEEE Sym. on Cluster Comp. and Grid, 2008, pp. 130-137.
14. A. R. Mamidala, A. Vishnu and D. K. Panda, "Efficient Shared Memory and RDMA Based Design for MPI-Allgather over InfiniBand," in Recent Adv. in Par. Virtual Machine and Message Passing Interf., LNCS, Volume 4192/2006, 2006, pp. 66-75.
15. K. Kandalla, H. Subramoni, G. Santhanaraman, M. Koop and D. K.Panda, "Designing Multi-leader-based Allgather Algorithms for Multi-core Clusters," in Proc. of IEEE Int. Sym. on Parallel and Dist. Processing, Rome, Italy, 2009.
16. S. W. Son, K. Mlakowski, G. Chen, M. Kandemir, and P. Raghavan, "Reducing Energy Consumption of Parallel Aparse Matrix Applications through Integrated Link/CPU Voltage Scaling," J. of Supercomputing, vol. 41, pp. 179-213, 2007.
17. G. Chen and K. Malkowski and M. Kandemir and P. Raghavan, "Reducing Power with Performance Constraints for Parallel Sparse Applications," in Proc. of the 19th IEEE Int. Par. and Dist. Proc. Sym. (IPDPS'05), vol. 12, 2005.
18. J. Liu, D. Poff, and B. Abali, "Evaluating High Performance Communication: A Power Perspective," in Proc. of the 23rd int. conf. on Supercomputing, 2009, pp. 326-337.
19. R. Zamani et al, "A Feasibility Analysis of Power-Awareness and Energy Minimization in Modern Interconnects for High- Performance Computing," in Proc. of the 2007 IEEE Int. Conf. on Cluster Comp., 2007, pp. 118-128.
20. S. Kumar, Y. Sabharwal, R. Garg, and P. Heidelberger, "Optimization of All-to-All Communication on the Blue Gene/L Supercomputer," in Proc. of 37th Int. Conf. on Parallel Processing, 2008, pp. 320-329.
21. J. Bruck, C.-T. Ho, S. Kipnis, and D. Weathersby, "Efficient Algorithms for All-to-All Communications in Multi- Port Message-Passing Systems," in Proc. of the 6th ACM Sym. on Par. Alg. and Arch., 1994, pp. 298-309.
22. The Ohio State University, "OSU MPI Benchmarks," http: //mvapich.cse.ohio-state.edu.
23. R. Thakur, R. Rabenseifner, and W. Gropp, "Optimization of Collective Communication Operations in MPICH," in Int. J. of High Perf. Comp. App., 2005, pp. (19)1:49-66.
24. D. H. Bailey et al, "The NAS Parallel Benchmarks Summary and Preliminary Results," in Proc. of ACM/IEEE Conf. on Supercomputing, 1991, pp. 158-165.
25. CPMD, "CPMD Consortium," http://www.cpmd.org.
26. K. Kandalla, E. Mancini, S. Sur and D.K. Panda, "Designing Power-Aware Collective Communication Algorithms for InfiniBand Clusters," in OSU Tech Report. OSU-CISRC-3/10- TR06, 2010.
27. K. Kandalla et al, "Designing Topology-Aware Collective Communication Algorithms for Large Scale InfiniBand Clusters: Case Studies with Scatter and Gather," in IEEE Int. Sym. on Par. and Dist. Proc., to appear, 2010.