Collective communication operations: Experimental results vs. theory

Concurrency Practice and Experience

Volumn 10, Issue 5, 1998, Pages 359-386

  Bernaschi, Massimo ^a   Iannello, Giulio ^b  

^a IBM   (Italy)

^b UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

DATA COMMUNICATION SYSTEMS; PARALLEL ALGORITHMS;

COLLECTIVE COMMUNICATION OPERATIONS; GENERIC COMMUNICATION;

PARALLEL PROCESSING SYSTEMS;

EID: 0347174834     PISSN: 10403108     EISSN: None     Source Type: Journal    
DOI: 10.1002/(SICI)1096-9128(19980425)10:5<359::AID-CPE323>3.0.CO;2-7     Document Type: Article

References (22)

1. V. Bala, J. Bruck, R. Cypher, P. Elustondo, A. Ho, C.T. Ho, S. Kipnis and M. Snir, 'CCL: a portable and tunable collective communication library for scalable parallel computers', IEEE Trans. Parallel Distrib. Syst., 6(2), 154-164 (1995).
2. Message Passing Interface Forum, 'Document for standard message-passing interface', Tech. Rep. CS-93-214, University of Tennessee, Nov. 1993.
3. J. Li and M. Chen, 'Compiling communication-efficient programs for massively parallel machines', IEEE Trans. Parallel Distribed Systems, 3, 361-375 (1991).
4. M. Barnett, R. Littlefield, D.G. Payne and R. van de Geijn, 'Global combine on mesh architectures with wormhole', Proc. of 7th Int. Parallel Processing Symp., IEEE Computer Society Press, Newport Beach, CA, 13-16 April 1993, pp. 156-162.
5. S.H. Bokhari and H. Berryman, 'Complete exchange on a circuit switched mesh', Proc. of Scalable High Performance Computing Conf., 1992, pp. 300-306.
6. N.S. Sundar, D.N. Jayasimha, D.K. Panda and P. Sadayappan, 'Complete exchange in 2D meshes', Proc. of Scalable High Performance Computing Conf., Knoxville, TN, 23-25 May, 1994, pp. 406-413.
7. M. Barnett, S. Gupta, D.G. Payne, L. Shuler, R. van de Geijn and J. Watts, 'Building a high-performance collective communication library', Proc. of Supercomputing '94, Washington DC, 14-18 Nov. 1994, pp. 107-116.
8. A. Bar-Noy and S. Kipnis, 'Designing broadcasting algorithms in the postal model for message-passing systems', Proc. of the 4th Annual ACM Symp. on Parallel Algorithms and Architectures, June 1992, pp. 11-22.
9. R.M. Karp, A. Sahay, E.E. Santos and K.E. Schauser, 'Optimal broadcast and summation in the LogP model', Proc. of the 5th Annual ACM Symp. on Parallel Algorithms and Architectures, June 1993, pp. 142-153.
10. A. Bar-Noy, S. Kipnis and B. Schieber, 'Optimal computation of census functions in the postal model', Discrete Appl. Math., 58, 213-222 (1995).
11. J. Bruck, C.T. Ho, S. Kipnis and D. Weathersby, 'Efficient algorithms for all-to-all communications in multi-port message-passing systems', Proc. of the 6th Annual ACM Symp. on Parallel Algorithms and Architectures, ACM Press, Cape May, NJ, 27-29 June 1994, pp. 298-309.
12. A. Alexandrov, M. Ionescu, K.E. Schauser and C. Scheiman, 'LogGP: Incorporating long messages into the LogP model - One step closer towards a realistic model of parallel computation', Proc. of the 7th Annual ACM Symp. on Parallel Algorithms and Architectures, ACM Press, Santa Barbara, CA, 17-19 July 1995, pp. 95-105.
13. J. Bruck, L. de Coster, N. Dewulf, C.T. Ho and R. Lauwereins, 'On the design and implementation of broadcast and global combine operations using the postal model', Proc. of the 6th IEEE Symp. on Parallel and Distributed Processing, 1994, pp. 594-602.
14. D.E. Culler, Karp, D.A. Patterson, A. Sahay, K.E. Schauser, E. Santos, R. Subramonian and T. von Eicken, 'LogP: towards a realistic model of parallel computation', Proc. of the 4th SIGPLAN Symp. on Principles and Practices of Parallel Programming, ACM, May 1993, pp. 1-12.
15. S. Konstantinidou and E. Upfal, 'Experimental comparison of multistage networks', IBM, Almaden Research Center Report RJ 8451, November 1991.
16. C.P. Kruskal and M. Snir, 'The performance of multistage interconnection networks for multi-processors', IEEE Trans. Comput., C-32(12), (1983).
17. IBM AIX PVMe User's Guide and Subroutine Reference, SH23-0019-01, 1993.
18. V.S. Sunderam, G.A. Geist, J. Dongarra and R. Manchek, 'The PVM concurrent computing system: evolution, experiences and trends', Parallel Comput., 20(4), (1994).
19. M. Bernaschi, 'The requirements of a high performance implementation of PVM', Future Gener. Comput. Syst., 12(1), (1996).
20. C. Huang, E.P. Kasten and P.K. McKinley, 'Design and implementation of multicast operations for ATM-based high performance computing', Proc. of Supercomputing '94, Washington DC, 14-18 Nov. 1994, pp. 164-173.
21. A.D. Knies, F.B. Barriuso, W.J. Harrod and G.B. Adams III, 'SLICC: A low latency interface for collective communications', Proc. of Supercomputing '94, Washington DC, 14-18 Nov. 1994, pp. 89-96.
22. N.J. Boden, D. Cohen, R.E. Felderman, A.E. Kalawik, C.L. Seitz, J.N. Seizovic and W.-K. Su, 'Myrinet - a gigabit-per-second local-area network', IEEE Micro, 15(1), 29-36 (1995).