Exploiting Distributed-Memory and Shared-Memory Parallelism on Clusters of SMPs with Data Parallel Programs

International Journal of Parallel Programming

Volumn 31, Issue 1, 2003, Pages 3-19

  Benkner, Siegfried ^a   Sipkova, Viera ^a  

^a UNIVERSITY OF VIENNA   (Austria)

Author keywords

HPF; Hybrid parallelization; MPI; OpenMP; SMP clusters

Indexed keywords

COMPUTER PROGRAMMING LANGUAGES; DATA STORAGE EQUIPMENT; DATA TRANSFER; OPTIMIZATION; PROGRAM COMPILERS;

DISTRIBUTED MEMORY; PARALLEL PROGRAMS; SHARED MEMORY MULTIPROCESSORS (SMP);

PARALLEL PROCESSING SYSTEMS;

EID: 0347133254     PISSN: 08857458     EISSN: None     Source Type: Journal    
DOI: 10.1023/A:1021782118861     Document Type: Conference Paper

References (25)

1. Message Passing Interface Forum, MPI: A Message-Passing Interface Standard, Vers. 1.1, June 1995, MPI-2: Extensions to the Message-Passing Interface, 1997.
2. Message Passing Interface Forum, MPI: A Message-Passing Interface Standard, Vers. 1.1, June 1995, MPI-2: Extensions to the Message-Passing Interface, 1997.
3. The OpenMP Forum, OpenMP Fortran Application Program Interface, Version 1.1, November 1999, http://www.openmp.org.
4. F. Cappello and D. Etieble, MPI versus MPI+OpenMP on the IBM SP for the NAS Benchmarks, In Proceedings of SC 2000: High Performance Networking and Computing Conference, Dallas (November 2000).
5. O. Haan, Matrix Transpose with Hybrid OpenMP/MPI Parallelization. Technical Report, http://www.spscicomp.org/2000/userpres.html#haan, 2000.
6. R. D. Loft, S. J. Thomas, and J. M. Dennis, Terascale Spectral Element Dynamical Core for Atmospheric General Circulation Models. In Proceedings SC2001, Denver (November 2001).
7. P. V. Luong, C. P. Breshears, and L. N. Ly, Costal Ocean Modeling of the U.S. West Coast with Multiblock Grid and Dual-Level Parallelism. In Proceedings of SC2001, Denver (November 2001).
8. High Performance Fortran Forum, High Performance Fortran Language Specification, Version 2.0, Department of Computer Science, Rice University (1997).
9. S. Benkner, VFC: The Vienna Fortran Compiler, Scientific Programming, 7(1):67-81 (1999).
10. S. Benkner, HPF+-High Performance Fortran for Advanced Scientific and Engineering Applications, Future Generation Computer Systems, Vol. 15 (3) (1999).
11. S. Benkner, P. Mehrotra, J. Van Rosendale, and H. Zima, High-Level Management of Communication Schedules in HPF-like Languages, In Proceedings of the International Conference on Supercomputing (ICS'98), pp. 109-116, Melbourne, Australia, ACM Press (July 13-17, 1998).
12. S. Benkner, Optimizing Irregular HPF Applications Using Halos, Concurrency: Practice and Experience, Wiley (2000).
13. S. Benkner and T. Brandes, Exploiting Data Locality on Scalable Shared Memory Machines with Data Parallel Programs, In Euro-Par 2000 Parallel Processing, Lecture Notes in Computer Science 1900, Munich, Germany (September 2000).
14. H. Moritsch and S. Benkner, High Performance Numerical Pricing Methods, In Fourth Int'l. HPF Users Group Meeting, Tokyo (October 2000).
15. E. Dockner, H. Moritsch, G. Ch. Pflug, and A. Swietanowski, AURORA financial management system: From Model Design to Implementation, Technical report AURORA TR1998-08, University of Vienna (June 1998).
16. S. Benkner and T. Brandes. High-Level Data Mapping for Clusters of SMPs, In Proceedings 6th International Workshop on High-Level Parallel Programming Models and Supportive Environments, San Francisco, Springer-Verlag (April 2001).
17. T. Brandes and F. Zimmermann, ADAPTOR - A Transformation Tool for HPF Programs, In K. M. Decker and R. M. Rehmann (eds.), Programming Environments for Massively Parallel Distributed Systems, Birkhäuser Verlag (1994).
18. D. S. Henty, Performance of Hybrid Message-Passing and Shared-Memory Parallelism for Discrete Element Modeling, In Proceedings of SC 2000: High Performance Networking and Computing Conference, Dallas (November 2000).
19. Silicon Graphics Inc. MIPSpro Power Fortran 77 Programmer's Guide: OpenMP Multiprocessing Directives, Technical Report Document 007-2361-007 (1999).
20. J. Bircsak, P. Craig, R. Crowell, Z. Cvetanovic, J. Harris, C. Nelson, and C. Offner, Extending OpenMP for NUMA Machines, In Proceedings of SC 2000: High Performance Networking and Computing Conference, Dallas (November 2000).
21. B. Chapman, P. Mehrotra, and H. Zima, Enhancing OpenMP with Features for Locality Control, In Proc. ECWMF Workshop "Towards Teracomputing - The Use of Parallel Processors in Meteorology" (1998).
22. M. Leair, J. Merlin, S. Nakamoto, V. Schuster, and M. Wolfe, Distributed OMP - A Programming Model for SMP Clusters, In Eighth International Workshop on Compilers for Parallel Computers, pp. 229-238, Aussois, France (January 2000).
23. J. Merlin, D. Miles, and V. Schuster, Extensions to OpenMP for SMP Clusters. In Proceedings of the Second European Workshop on OpenMP, EWOMP (2000).
24. Y. Hu, H. Lu, A. Cox, and W. Zwaenepel, Openmp for networks of smps, In Proceedings of IPPS. (1999).
25. M. Sato, S. Satoh, K. Kusano, and Y. Tanaka, Design of openmp compiler for an smp cluster, In Proceedings EWOMP'99, pp. 32-39 (1999).