MPI for Python: Performance improvements and MPI-2 extensions

Journal of Parallel and Distributed Computing

Volumn 68, Issue 5, 2008, Pages 655-662

  Dalcín, Lisandro ^a   Paz, Rodrigo ^a   Storti, Mario ^a   D'Elía, Jorge ^a  

^a Facultad de Ciencias Naturales e Instituto M Lillo   (Argentina)

Author keywords

High level languages; Message passing; MPI; Parallel Python

Indexed keywords

COMPUTER NETWORKS; HIGH LEVEL LANGUAGES; OBJECT ORIENTED PROGRAMMING; PARALLEL PROCESSING SYSTEMS; SPECIFICATION LANGUAGES;

MESSAGE PASSING INTERFACES (MPI); NUMERIC ARRAYS; PYTHON PROGRAMMING LANGUAGES;

MESSAGE PASSING;

EID: 41449101853     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jpdc.2007.09.005     Document Type: Article

References (31)

1. Amundson J., Spentzouris P., Qiang J., and Ryne R. Synergia: a 3D accelerator modelling tool with 3D space charge. J. Comput. Phys. 211 1 (2006) 229-248
2. P. Barrett, J. Hunter, P. Greenfield, Matplotlib-a portable Python plotting package, Astronomical Data Analysis Software & Systems XIV, 2004.
3. Beazley D.M., and Lomdahl P.S. Feeding a large scale physics application to Python. Proceedings of 6th International Python Conference. San Jose, California (1997) 21-29
4. Beowulf.org, The Beowulf cluster site, 〈http://www.beowulf.org/〉, 2007.
5. L. Dalcín, MPI for Python, 〈http://www.mpi4py.scipy.org/〉, 2007.
6. Dalcín L., Paz R., and Storti M. MPI for Python. J. Parallel Distributed Comput. 65 9 (2005) 1108-1115
7. Gabriel E., Fagg G.E., Bosilca G., Angskun T., Dongarra J.J., Squyres J.M., Sahay V., Kambadur P., Barrett B., Lumsdaine A., Castain R.H., Daniel D.J., Graham R.L., and Woodall T.S. Open MPI. goals, concept, and design of a next generation MPI implementation. Proceedings of the 11th European PVM/MPI Users' Group Meeting. Budapest, Hungary (2004) 97-104
8. W. Gropp, S. Huss-Lederman, A. Lumsdaine, E. Lusk, B. Nitzberg, W. Saphir, M. Snir, MPI-The Complete Reference: Volume 2, The MPI-2 Extensions, second ed., vol. 2, The MPI-2 Extensions, MIT Press, Cambridge, MA, USA, 1998.
9. Gropp W., Lusk E., Doss N., and Skjellum A. A high-performance, portable implementation of the MPI message passing interface standard. Parallel Comput. 22 6 (1996) 789-828
10. Hinsen K. The Molecular Modelling Toolkit: a new approach to molecular simulations. J. Comput. Chem. 21 2 (2000) 79-85
11. K. Hinsen, ScientificPython: Home page, 〈http://starship.python.net/∼hinsen/ScientificPython/〉, 2007.
12. J.D. Hunter, Matplotlib, 〈http://matplotlib.sourceforge.net/〉, 2003-2007.
13. E. Jones, T. Oliphant, P. Peterson, et al., SciPy: open source scientific tools for Python, 〈http://www.scipy.org/〉, 2001-2007.
14. Kepner J. A multi-threaded fast convolver for dynamically parallel image filtering. J. Parallel Distributed Comput. 63 3 (2003) 360-372
15. Kepner J., and Ahalt S. MatlabMPI. J. Parallel Distributed Comput. 64 8 (2004) 997-1005
16. H.P. Langtangen, Python Scripting for Computational Science, Simula Research Lab, Department of Informatics, University of Oslo, 2006.
17. Message Passing Interface Forum, Message Passing Interface (MPI) Forum Home Page, 〈http://www.mpi-forum.org/〉, 1994.
18. P. Miller, pyMPI: putting the py in MPI, 〈http://pympi.sourceforge.net/〉, 2000-2007.
19. MPI Forum, MPI: a message passing interface standard, Internat. J. Supercomputer Appl. 8 (3/4) (1994) 159-416.
20. MPI Forum, MPI2: a message passing interface standard, High Performance Comput. Appl. 12 (1-2) (1998) 1-299.
21. MPICH Team, MPICH: a portable implementation of MPI, 〈http://www-unix.mcs.anl.gov/mpi/mpich/〉, 2007.
22. O. Nielsen, Pypar Home page, 〈http://datamining.anu.edu.au/∼ole/pypar/〉, 2002-2007.
23. T. Oliphant, NumPy: Numerical Python, 〈http://numpy.scipy.org/〉, 2005-2007.
24. Open MPI Team, Open MPI: open source high performance computing, 〈http://www.open-mpi.org/〉, 2007.
25. F. Pérez, IPython: an Enhanced Python Shell 〈http://ipython.scipy.org/〉, 2001-2007.
26. F. Pérez, B. Granger, IPython: a system for interactive scientific computing, Comput. Sci. Eng. 9 (3) (2007) 21-29.
27. M. Snir, S. Otto, S. Huss-Lederman, D. Walker, J. Dongarra, MPI-The Complete Reference: Volume 1, The MPI Core, second ed., vol. 1, The MPI Core, MIT Press, Cambridge, MA, USA, 1998.
28. Sonzogni V.E., Yommi A.M., Nigro N.M., and Storti M.A. A parallel finite element program on a Beowulf cluster. Adv. in Eng. Software 33 7-10 (2002) 427-443
29. M.A. Storti, Aquiles cluster at CIMEC, 〈http://www.cimec.org.ar/aquiles〉, 2005-2007.
30. M.A. Storti, N. Nigro, R. Paz, L. Dalcín, E. López, PETSc-FEM: a general purpose, parallel, multi-physics FEM program, 〈http://www.cimec.org.ar/petscfem〉, 1999-2007.
31. G. van Rossum, Python programming language, 〈http://www.python.org/〉, 1990-2007.