Performance modeling of communication and computation in hybrid MPI and OpenMP applications

Proceedings of the International Conference on Parallel and Distributed Systems - ICPADS

Volumn 2, Issue , 2006, Pages 3-8

  Adhianto, Laksono ^a   Chapman, Barbara ^a  

^a University of Houston   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

PERFORMANCE EVALUATION; RUNTIME SYSTEM;

COMPUTATIONAL METHODS; COMPUTER SIMULATION; OPTIMIZATION; PARAMETER ESTIMATION;

PARALLEL PROGRAMMING;

EID: 34047216159     PISSN: 15219097     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/ICPADS.2006.81     Document Type: Conference Paper

References (38)

1. V. S. Adve and M. K. Vernon. Parallel program performance prediction using deterministic task graph analysis. ACM Trans. Comput. Syst., 22(1):94-136, 2004.
2. A. Alexandrov, M. F. Ionescu, K. E. Schauser, and C. Scheiman. Loggp: incorporating long messages into the logp model: one step closer towards a realistic model for parallel computation. In SPAA '95: Proceedings of the seventh annual ACM symposium on Parallel algorithms and architectures, pages 95-105, New York, NY, USA, 1995. ACM Press.
3. S. Benkner and V. Sipková. Exploiting distributed-memory and shared-memory parallelism on clusters of smps with data parallel programs. International Journal of Parallel Programming, 31(1):3-19, 2003.
4. S. W. Bova, C. P. Breshears, H. Gabb, B. Kuhn, B. Magro, R. Eigenmann, G. Gaertner, S. Salvini, and H. Scott. Parallel programming with message passing and directives. Computing in Science and Engineering, 3(5):22-37, /2001.
5. J. Bull. Measuring synchronisation and scheduling over-heads in openmp. In European Workshop on OpenMP (EWOMP1999), Lund, Sweden, 1999.
6. I. J. Bush, C. J. Noble, and R. J. Allan. Mixed openmp and mpi for parallel fortran applications. In European Workshop on OpenMP (EWOMP2000), Edinburgh, UK, 2000.
7. F. Cappello and D. Etiemble. Mpi versus mpi+openmp on ibm sp for the nas benchmarks. In SC2000, Supercomputing 2000, November, Dallas, 2000.
8. E. Chow and D. Hysom. Assessing performance of hybrid mpi/openmp programs on smp clusters. Technical Report UCRL-JC-143957, Lawrence Livermore National Laboratory, May 2001.
9. D. Culler, R. Karp, D. Patterson, A. Sahay, K. E. Schauser, E. Santos, R. Subramonian, and T. von Eicken. Logp: towards a realistic model of parallel computation. In PPOPP '93: Proceedings of the fourth ACM SIGPLAN symposium on Principles and practice of parallel programming, pages 1-12, New York, NY, USA, 1993. ACM Press.
10. N. Drosinos and N. Koziris. Performance Comparison of Pure MPI vs Hybrid MPI-OpenMP Parallelization Models on SMP Clusters. In Proceedings of the 18th International Parallel and Distributed Processing Symposium 2004 (IPDPS 2004), page 15, Santa Fe, New Mexico, Apr. 2004.
11. M. P. I. Forum, http://www.mpi-forum.org.
12. P. B. Gibbons, Y. Matias, and V. Ramachandran. Can shared-memory model serve as a bridging model for parallel computation? In SPAA '97: Proceedings of the ninth annual ACM symposium on Parallel algorithms and architectures, pages 72-83, New York, NY, USA, 1997. ACM Press.
13. L. Giraud. Combining shared and distributed memory programming models on clusters of symmetric multiprocessors: Some basic promising experiments. Working Note WN/-PA/01/19, CERFACS, Toulouse, France, 2001.
14. P. GmbH. Pallas mpi benchmarks - pmb, http://www.pallas.de/pages/pmbd. htm.
15. D. R. Helman and J. Jaacute;J. Prefix computations on symmetric multiprocessors. J. Parallel. Distrib. Comput., 61(2):265-278, 2001.
16. D. S. Henty. Performance of hybrid message-passing and shared-memory parallelism for discrete element modeling. In Supercomputing 2000, pages 50-50, 2000.
17. M. D. Jones and R. Yao. Parallel osem reconstruction speed with mpi, openmp, and hybrid mpi-openmp programming models. In IEEE Nuclear Science Symposium and Medical Imaging Conference Record, Rome, Italy, October 2004.
18. T. Kielmann, H. E. Bal, and K. Verstoep. Fast measurement of logp parameters for message passing platforms. In IPDPS Workshops, pages 1176-1183, 2000.
19. R. Kufrin. Perfsuite: An accessible, open source, performance analysis environment for linux. In 6th International Conference on Linux Clusters (LCI-2005), Chapel Hill, NC, April 2005.
20. M. Kühnemann, T. Rauber, and G. Rũnger. A Source Code Analyzer for Performance Prediction. In Proc. of the JPDPS-Workshop on Massively Parallel Processing (CDROM). IEEE, 2004.
21. P. Lanucara and S. Rovida. Conjugate-gradients algorithms: An mpi-openmp implementation on. In First European Workshop on OpenMP, pages 76-78, 1999.
22. G. Mahinthakumar and F. Saied. A Hybrid MPI-OpenMP Implementation of an Implicit Finite-Element Code on Parallel Architectures. International Journal of High Performance Computing Applications, 16(4):371-393, 2002.
23. A. Majumdar. Parallel performance study of monte carlo photon transport code on shared-, distributed-, and distributed-shared-memory architectures. In IPDPS, pages 93-, 2000.
24. G. Marin and J. Mellor-Crummey. Cross-architecture performance predictions for scientific applications using parameterized models. In SIGMETRICS 2004/PERFORMANCE 2004: Proceedings of the joint international conference on Measurement and modeling of computer systems, pages 2-13, New York, NY, USA, 2004. ACM Press.
25. K. S. McKinley. A compiler optimization algorithm for shared-memory multiprocessors. IEEE Trans. Parallel Distrib. Syst., 9(8):769-787, 1998.
26. J. Odom, J. K. Hollingsworth, L. DeRose, K. Ekanadham, and S. Sbaraglia. Using dynamic tracing sampling to measure long running programs. In SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing, page 59, Washington, DC, USA, 2005. IEEE Computer Society.
27. L. Oliker, X. Li, P. Husbands, and R. Biswas. Effects of ordering strategies and programming paradigms on sparse matrix computations. SIAM Rev., 44(3):373-393, 2002.
28. OpenMP. http://www.openmp.org.
29. OpenUH. http://www.cs.uh.edu/õpenuh.
30. R. Reussner, P. Sanders, L. Prechelt, and M. Muller. Skampi: A detailed, accurate MPI benchmark. In PVM/MPI, pages 52-59, 1998.
31. X. Shen, Y. Zhong, and C. Ding. Locality phase prediction. In ASPLOS-XI: Proceedings of the 11th international conference on Architectural support for programming languages and operating systems, pages 165-176, New York, NY, USA, 2004. ACM Press.
32. A. Snavely, L. Carrington, N. Wolter, J. Labarta, R. Badia, and A. Purkayastha. A framework for performance modeling and prediction. In Supercomputing '02: Proceedings of the 2002 ACM/IEEE conference on Supercomputing, pages 1-17, Los Alamitos, CA, USA, 2002. IEEE Computer Society Press.
33. SPHINX, http://www.llnl.gov/casc/sphinx/sphinx.html.
34. C. H. Tail, Y. Zhao, and K. M. Liew. Parallel-multigrid computation of unsteady incompressible viscous flows using a matrix-free implicit method and high-resolution characteristics-based scheme. Computer Methods in Applied Mechanics and Engineering, 194(36-38):3949-3983, 2005.
35. M. B. van Gijzen. Two level parallelism in a stream-function model for global ocean circulation. Technical Report TR/-PA/03/09, CERFACS, Toulouse, France, 2003.
36. H. W. and T. D. K. A parallel computing framework for dynamic power balancing in adaptive mesh refinement applications. In Parallel CFD99, Wiiliamsburg, VA, May 1999.
37. A. Weinand. Eclipse - an open source platform for the next generation of development tools. InNODe '02: Revised Papers from the International Conference NetObjectDays on Objects, Components, Architectures, Services, and Applications for a Networked World, page 3, London, UK, 2003. Springer-Verlag.
38. M. E. Wolf, D. E. Maydan, and D.-K. Chen. Combining loop transformations considering caches and scheduling. In Proceedings of the 29th annual ACM/IEEE international symposium on Microarchitecture, pages 274-286. IEEE Computer Society, 1996.