Performance modeling of communication and computation in hybrid MPI and OpenMP applications

Simulation Modelling Practice and Theory

Volumn 15, Issue 4, 2007, Pages 481-491

  Adhianto, Laksono ^a   Chapman, Barbara ^a  

^a University of Houston   (United States)

Author keywords

Cluster; MPI; OpenMP; Performance modeling; SMP

Indexed keywords

CLUSTER ANALYSIS; COMPUTATIONAL COMPLEXITY; COMPUTATIONAL METHODS; OPTIMIZATION; PROGRAM COMPILERS; TELECOMMUNICATION SYSTEMS;

MPI; OPENMP; PERFORMANCE MODELING; SYSTEM PROFILES;

PARALLEL PROGRAMMING;

EID: 33947361066     PISSN: 1569190X     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.simpat.2006.11.014     Document Type: Article

References (43)

1. Adve V.S., and Vernon M.K. Parallel program performance prediction using deterministic task graph analysis. ACM Transactions On Computer Systems 22 1 (2004) 94-136
2. Alexandrov A., Ionescu M.F., Schauser K.E., and Scheiman C. Loggp: incorporating long messages into the logp model: one step closer towards a realistic model for parallel computation. SPAA '95: Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures (1995), ACM Press, New York, NY, USA 95-105
3. Benkner S., and Sipkov'a V. Exploiting distributed-memory and shared-memory parallelism on clusters of smps with data parallel programs. International Journal of Parallel Programming 31 1 (2003) 3-19
4. Bova S.W., Breshears C.P., Gabb H., Kuhn B., Magro B., Eigenmann R., Gaertner G., Salvini S., and Scott H. Parallel programming with message passing and directives. Computing in Science and Engineering 3 5 (2001) 22-37
5. J.M. Bull, Measuring synchronisation and scheduling overheads in openmp, in: In European Workshop on OpenMP (EWOMP1999), Lund, Sweden, 1999.
6. I.J. Bush, C.J. Noble, R.J. Allan, Mixed openmp and mpi for parallel fortran applications, in: In European Workshop on OpenMP (EWOMP2000), Edinburgh, UK, 2000.
7. F. Cappello, D. Etiemble, Mpi versus mpi + openmp on ibm sp for the nas benchmarks, in: In SC2000, Supercomputing 2000, November, Dallas, 2000.
8. Edmond Chow, David Hysom. Assessing performance of hybrid mpi/openmp programs on smp clusters. Technical Report UCRL-JC-143957, Lawrence Livermore National Laboratory, May 2001.
9. Culler D., Karp R., Patterson D., Sahay A., Schauser K.E., Santos E., Subramonian R., and Eicken T.v. Logp: towards a realistic model of parallel computation. PPOPP '93: Proceedings of the fourth ACM SIGPLAN symposium on Principles and practice of parallel programming (1993), ACM Press, New York, NY, USA 1-12
10. N. Drosinos, N. Koziris. Performance comparison of pure MPI vs hybrid MPI-OpenMP parallelization models on SMP clusters, in: Proceedings of the 18th International Parallel and Distributed Processing Symposium 2004 (IPDPS 2004), Santa Fe, New Mexico, April 2004, p. 15.
11. Message Passing Interface Forum. .
12. Gibbons P.B., Matias Y., and Ramachandran V. Can sharedmemory model serve as a bridging model for parallel computation?. SPAA '97: Proceedings of the ninth annual ACM symposium on Parallel algorithms and architectures (1997), ACM Press, New York, NY, USA 72-83
13. L. Giraud, Combining shared and distributed memory programming models on clusters of symmetric multiprocessors: some basic promising experiments. Working Note WN/PA/01/19, CERFACS, Toulouse, France, 2001.
14. Pallas GmbH. Pallas mpi benchmarks - pmb. .
15. Gropp W.D., and Lusk E. Reproducible measurements of MPI performance characteristics. In: Dongarra J., Luque E., and Margalef T. (Eds). Recent Advances in Parallel Virtual Machine and Message Passing Interface. Lecture Notes in Computer Science vol. 1697 (1999), Springer Verlag 11-18 6th European PVM/MPI Users' Group Meeting, Barcelona, Spain, September 1999
16. Helman D.R., and Jaacute J. Prefix computations on symmetric multiprocessors. Journal of Parallel and Distributed Computing 61 2 (2001) 265-278
17. D.S. Henty, Performance of hybrid message-passing and shared-memory parallelism for discrete element modeling, in: Supercomputing 2000, 2000.
18. Hockney R.W. The communication challenge for mpp: Intel paragon and meiko cs-2. Parallel Computation 20 3 (1994) 389-398
19. M.D. Jones, R. Yao, Parallel osem reconstruction speed with mpi, openmp, and hybrid mpi-openmp programming models, in: In IEEE Nuclear Science Symposium and Medical Imaging Conference Record, Rome, Italy, October 2004.
20. Thilo Kielmann, Henri E. Bal, Kees Verstoep, Fast measurement of logp parameters for message passing platforms, in: IPDPS Workshops, 2000, pp. 1176-1183.
21. Rick Kufrin, Perfsuite: an accessible, open source, performance analysis environment for linux, in: 6th International Conference on Linux Clusters (LCI- 2005), Chapel Hill, NC, April 2005.
22. M. Kühnemann, T. Rauber, G. Rünger, A source code analyzer for performance prediction, in: Proceedings of the IPDPS-Workshop on Massively Parallel Processing (CDROM), IEEE, 2004.
23. Piero Lanucara, Sergio Rovida, Conjugate-gradients algorithms: an mpiopenmp implementation on, in: First European Workshop on OpenMP, 1999, pp. 76-78.
24. Mahinthakumar G., and Saied F. A hybrid MPI-OpenMP implementation of an implicit finite-element code on parallel architectures. International Journal of High Performance Computing Applications 16 4 (2002) 371-393
25. Amitava Majumdar, Parallel performance study of monte carlo photon transport code on shared-, distributed-, and distributed-shared-memory architectures, in: IPDPS, 2000, p. 93.
26. Marin G., and Mellor-Crummey J. Cross-architecture performance predictions for scientific applications using parameterized models. SIGMETRICS 2004/PERFORMANCE 2004: Proceedings of the joint international conference on Measurement and modeling of computer systems (2004), ACM Press, New York, NY, USA 2-13
27. McKinley K.S. A compiler optimization algorithm for shared-memory multiprocessors. IEEE Transactions on Parallel and Distributed Systems 9 8 (1998) 769-787
28. P. Mucci, K. London, The Mpbench Report, 1998.
29. Odom J., Hollingsworth J.K., DeRose L., Ekanadham K., and Sbaraglia S. Using dynamic tracing sampling to measure long running programs. SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing (2005), IEEE Computer Society, Washington, DC, USA 59
30. Oliker L., Li X., Husbands P., and Biswas R. Effects of ordering strategies and programming paradigms on sparse matrix computations. SIAM Rev. 44 3 (2002) 373-393
31. Open64. .
32. OpenMP. .
33. OpenUH. .
34. Ralf Reussner, Peter Sanders, Lutz Prechelt, and Matthias Muller. Skampi: A detailed, accurate MPI benchmark. In PVM/MPI, 1998, pp. 52-59.
35. Reussner R., Sanders P., and Träff J.L. Skampi: a comprehensive benchmark for public benchmarking of mpi. Scientific Programming 10 1 (2002) 55-65
36. Shen X., Zhong Y., and Ding C. Locality phase prediction. ASPLOS-XI: Proceedings of the 11th international conference on Architectural support for programming languages and operating systems (2004), ACM Press, New York, NY, USA 165-176
37. Snavely A., Carrington L., Wolter N., Labarta J., Badia R., and Purkayastha A. A framework for performance modeling and prediction. Supercomputing'02: Proceedings of the 2002 ACM/IEEE conference on Supercomputing (2002), IEE Computer Society Press, Los Alamitos, CA, USA 1-17
38. SPHINX. .
39. Tai1 C.H., Zhao Y., and Liew K.M. Parallel-multigrid computation of unsteady incompressible viscous flows using a matrix-free implicit method and high-resolution characteristics-based scheme. Computer Methods in Applied Mechanics and Engineering 194 36-38 (2005) 3949-3983
40. M.B. van Gijzen. Two level parallelism in a stream-function model for global ocean circulation. Technical Report TR/PA/03/09, CERFACS, Toulouse, France, 2003.
41. Huang W. and Tafti D.K.A parallel computing framework for dynamic power balancing in adaptive mesh refinement applications. In Parallel CFD99, Wiiliamsburg, VA, May 1999.
42. Weinand A. Eclipse - an open source platform for the next generation of development tools. NODe '02: Revised Papers from the International Conference NetObjectDays on Objects, Components, Architectures, Services, and Applications for a Networked World (2003), Springer-Verlag, London, UK 3
43. Wolf M.E., Maydan D.E., and Chen D.-K. Combining loop transformations considering caches and scheduling. Proceedings of the 29th annual ACM/IEEE international symposium on Microarchitecture (1996), IEEE Computer Society 274-286