A message scheduling scheme for all-to-all personalized communication on Ethernet switched clusters

IEEE Transactions on Parallel and Distributed Systems

Volumn 18, Issue 2, 2007, Pages 264-276

  Faraj, Ahmad ^a   Yuan, Xin ^a   Patarasuk, Pitch ^a  

^a Florida State University   (United States)

Author keywords

All to all personalized communications; Ethernet; Scheduling

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER NETWORKS; SCHEDULING; SYNCHRONIZATION; TOPOLOGY;

ALL-TO-ALL PERSONALIZED COMMUNICATION (AAPC); ETHERNET SWITCHED CLUSTERS; MESSAGE SCHEDULING SCHEME;

PERSONAL COMMUNICATION SYSTEMS;

EID: 33846868410     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPDS.2007.19     Document Type: Article

References (25)

1. S. Bokhari, "Multiphase Complete Exchange: A Theoretical Analysis," IEEE Trans. Computers, vol. 45, no. 2, pp. 220-229, Feb. 1996.
2. H.G. Dietz, T.M. Chung, T.I. Mattox, and T. Muhammad, "Purdue's Adapter for Parallel Execution and Rapid Synchronization: The TTL_PAPERS Design," technical report, School of Electrical Eng., Purdue Univ., Jan. 1995
3. V.V. Dimakopoulos and N.J. Dimopoulos, "Communications in Binary Fat Trees," Proc. Int'l Conf. Parallel and Distributed Computing Systems, pp. 383-388, Sept. 1995.
4. A. Faraj and X. Yuan, "Automatic Generation and Tuning of MPI Collective Communication Routines," Proc. 19th ACM Int'l Conf. Supercomputing (ICS '05), pp. 393-402, June 2005.
5. E. Gabrielyan and R.D. Hersch, "Network Topology Aware Scheduling of Collective Communications," Proc. 10th Int'l Conf. Telecomm., pp. 1051-1058, Feb. 2003.
6. S. Hinrichs, C. Kosak, D.R. O'Hallaron, T. Stricker, and R. Take, "An Architecture for Optimal All-to-All Personalized Communication," Proc. Sixth Ann. ACM Symp. Parallel Algorithms and Architectures, pp. 310-319, June 1994.
7. S.L. Johnsson and C.T. Ho, "Optimum Broadcasting and Personalized Communication in Hypercubes," IEEE Trans. Computers, vol. 38, no. 9, pp. 1249-1268, Sept. 1989.
8. L.V. Kale, S. Kumar, and K. Varadarajan, "A Framework for Collective Personalized Communication," Proc. Int'l Parallel and Distributed Processing Symp., (CDROM), Apr. 2003.
9. A. Karwande, X. Yuan, and D.K. Lowenthal, "An MPI Prototype for Compiled Communication on Ethernet Switched Clusters," J. Parallel and Distributed Computing, vol. 65, no. 10, pp. 1123-1133, Oct. 2005.
10. LAM/MPI Parallel Computing, http://www.lam-mpi.org/, 2006.
11. C.C. Lam, C.H. Huang, and P. Sadayappan, "Optimal Algorithms for All-to-All Personalized Communication on Rings and Two Dimensional Tori," J. Parallel and Distributed Computing, vol. 43, no. 1, pp. 3-13, 1997.
12. R. Libeskind-Hadas, D. Mazzoni, and R. Rajagopalan, "Optimal Contention-Free Unicast-Based Multicasting in Switch-Based Networks of Workstations," Proc. 11th Int'l Parallel Processing Symp., pp. 358-364, 1998.
13. C. Lin, "Efficient Contention-free Broadcast in Heterogeneous Network of Workstations with Multiple Send and Receive Costs," Proc. Eighth IEEE Int'l Symp. Computers and Comm., pp. 1277-1284, 2003.
14. W. Liu, C. Wang, and K. Prasanna, "Portable and Scalable Algorithms for Irregular All-to-All Communication," J. Parallel and Distributed Computing, vol. 62, no. 10, pp. 1493-1526, Oct. 2002.
15. The MPI Forum, The MPI-2: Extensions to the Message Passing Interface, July 1997, available at http://www.mpi-forum.org/docs/mpi-20-html/ mpi2-report.html.
16. R. Ponnusamy, R. Thakur, A. Chourdary, and G. Fox, "Scheduling Regular and Irregular Communication Patterns on the CM-5," Supercomputing, pp. 394-402, 1992.
17. N.S. Sundar, D.N. Jayasimha, D.K. Panda, and P. Sadayappan, "Hybrid Algorithms for Complete Exchange in 2D Meshes," Proc. Int'l Conf. Supercomputing, pp. 181-188, 1996.
18. D.S. Scott, "Efficient All-to-All Communication Patterns in Hypercube and Mesh Topologies," Proc. Sixth Distributed Memory Computing Conf., pp. 398-403, 1991.
19. A. Tam and C. Wang, "Efficient Scheduling of Complete Exchange on Clusters," Proc. ISCA 13th Int'l Conf. Parallel and Distributed Computing Systems, pp. 111-116, Aug. 2000.
20. A. Tam and C. Wang, "Contention-Aware Communication Schedule for High-Speed Communication," Cluster Computing J., vol. 6, no. 4, pp. 339-353, Oct. 2003.
21. A. Tanenbaum, Computer Networks, fourth ed. Prentice Hall, 2004
22. R. Thakur and A. Choudhary, "All-to-All Communication on Meshes with Wormhole Routing," Proc. Eighth Int'l Parallel Processing Symp. (IPPS), pp. 561-565, 1994.
23. R. Thakur, R. Rabenseifner, and W. Gropp, "Optimizing of Collective Communication Operations in MPICH," ANL/MCSP1140-0304, Math. and Computer Science Division, Argonne Nat'l Laboratory, Mar. 2004.
24. E.A. Varvarigos and D.P. Bertsekas, "Communication Algorithms for Isotropic Tasks in Hypercubes and Wraparound Meshes," Parallel Computing, vol. 18, no. 11, pp. 1233-1257, Nov. 1992.
25. X. Yuan, R. Melhem, and R. Gupta, "Algorithms for Supporting Compiled Communication," IEEE Trans. Parallel and Distributed Systems, vol. 14, no. 2, pp. 107-118, Feb. 2003.