MPI collective algorithm selection and quadtree encoding

Parallel Computing

Volumn 33, Issue 9, 2007, Pages 613-623

  Pješivac Grbović, Jelena ^a   Bosilca, George ^a   Fagg, Graham E ^a   Angskun, Thara ^a   Dongarra, Jack J ^a  

^a University of Tennessee   (United States)

Author keywords

Algorithm selection problem; MPI collective operations; Performance evaluation; Performance optimization; Quadtree encoding

Indexed keywords

DECISION TREES; ENCODING (SYMBOLS); MESSAGE PASSING; PROBLEM SOLVING;

AUTOMATIC DECISION FUNCTION GENERATION; DECISION FUNCTIONS; MPI COLLECTIVE ALGORITHMS; QUADTREE ENCODING;

PARALLEL ALGORITHMS;

EID: 34548691020     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.parco.2007.06.005     Document Type: Article

References (22)

1. R. Rabenseifner, Automatic MPI counter profiling of all users: First results on a CRAY T3E 900-512, in: Proceedings of the Message Passing Interface Developer's and User's Conference, 1999, pp. 77-85.
2. Worringen J. Pipelining and overlapping for MPI collective operations. IEEE Conference on Local Computer Network (2003), IEEE Computer Society, Boon/Königswinter, Germany 548-557
3. Huse L.P. Collective communication on dedicated clusters of workstations. Recent Advances in Parallel Virtual Machine and Message Passing Interface (1999), Springer-Verlag 469-476
4. Rabenseifner R., and Träff J.L. More efficient reduction algorithms for non-power-of-two number of processors in message-passing parallel systems. Recent Advances in Parallel Virtual Machine and Message Passing Interface. LNCS vol. 3241 (2004), Springer-Verlag
5. S. Juhász, F. Kovács, Asynchronous distributed broadcasting in cluster environment, in: Recent Advances in Parallel Virtual Machine and Message Passing Interface, LNCS, vol. 3241, 2004, pp. 164-172.
6. E.W. Chan, M.F. Heimlich, A. Purkayastha, R.M. van de Geijn, On optimizing of collective communication, in: Cluster, 2004.
7. Thakur R., and Gropp W. Improving the performance of collective operations in MPICH. Recent Advances in Parallel Virtual Machine and Message Passing Interface. LNCS vol. 2840 (2003), Springer-Verlag 257-267
8. Kielmann T., Hofman R.F.H., Bal H.E., Plaat A., and Bhoedjang R.A.F. MagPIe: MPI's collective communication operations for clustered wide area systems. Proceedings of ACM SIGPLAN Symposium (1999), ACM Press 131-140
9. Bernaschi M., Iannello G., and Lauria M. Efficient implementation of reduce-scatter in MPI. Journal of Systems Architecture 49 3 (2003) 89-108
10. G.E. Fagg, E. Gabriel, G. Bosilca, T. Angskun, Z. Chen, J. Pješivac-Grbović, K. London, J. Dongarra, Extending the MPI specification for process fault tolerance on high performance computing systems, in: Proceedings of the International Supercomputer Conference (ISC), Primeur, 2004.
11. MPICH-A portable implementation of MPI, .
12. E. Gabriel, G.E. Fagg, G. Bosilca, T. Angskun, J.J. Dongarra, J.M. Squyres, V. Sahay, P. Kambadur, B. Barrett, A. Lumsdaine, R.H. Castain, D.J. Daniel, R.L. Graham, T.S. Woodall, Open MPI: Goals, concept, and design of a next generation MPI implementation, in: Recent Advances in Parallel Virtual Machine and Message Passing Interface, Budapest, Hungary, 2004, pp. 97-104.
13. G. Fagg, G. Bosilca, J. Pješivac-Grbović, T. Angskun, J. Dongarra, Tuned: A flexible high performance collective communication component developed for open mpi, in: Proceedings of Austrian-Hungarian Workshop on Distributed and Parallel Systems (DAPSYS), Innsbruck, Austria, 2006.
14. Almasi G., Archer C., Castanos J., Gunnels J., Erway C., Heidelberger P., Martorell X., Moreira J., Pinnow K., and Ratterman J. Design and implementation of message-passing services for the Blue Gene/L supercomputer. IBM Journal of Research and Development 49 2 (2005) 393-406
15. Petrini F., Coll S., Frachtenberg E., and Hoisie A. Hardware- and software-based collective communication on the quadrics network. IEEE International Symposium on Network Computing and Applications (2001) 00-24
16. Eijkhout V., Fuentes E., Edison T., and Dongarra J.J. The component structure of a self-adapting numerical software system. International Journal of Parallel Programming 33 2 (2005) 137-143
17. Vuduc R., Demmel J.W., and Bilmes J.A. Statistical models for empirical search-based performance tuning. International Journal of High Performance Computing Applications 18 1 (2004) 65-94
18. J. Pješivac-Grbović, T. Angskun, G. Bosilca, G.E. Fagg, J.J. Dongarra, Decision trees and MPI collective algorithm selection problem, Tech. Rep. UT-CS-06-586, The University of Tennessee at Knoxville, Computer Science Department, 2006, .
19. SKaMPI: Special Karlsruher MPI Benchmark, .
20. OCC-Optimized Collective Communication Library, .
21. Pješivac-Grbović J., Angskun T., Bosilca G., Fagg G.E., Gabriel E., and Dongarra J.J. Performance analysis of MPI collective operations. Proceedings of IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 15 (2005), IEEE Computer Society, Washington, DC, USA p. 272.1
22. Gropp W., and Lusk E.L. Reproducible measurements of MPI performance characteristics. Recent Advances in Parallel Virtual Machine and Message Passing Interface (1999), Springer-Verlag 11-18