FG-MPI: Fine-grain MPI for multicore and clusters

Proceedings of the 2010 IEEE International Symposium on Parallel and Distributed Processing, Workshops and Phd Forum, IPDPSW 2010

Volumn , Issue , 2010, Pages

  Kamal, Humaira ^a   Wagner, Alan ^a  

^a UNIVERSITY OF BRITISH COLUMBIA   (Canada)

Author keywords

Communication; Fine grain; Message passing; MPI; MPICH2; Multicore; Parallel programming

Indexed keywords

COARSE-GRAINED; COMMUNICATION SUBSYSTEMS; HASKELL; HIGH PERFORMANCE COMPUTING; INTER-NODE COMMUNICATION; MESSAGE PASSING INTERFACE; MPI; MPI PROCESS; MULTI CORE; MULTI-CORE SYSTEMS; ON CHIPS; OPERATING SYSTEMS; POSIX THREADS; PROGRAMMING LANGUAGE; PROGRAMMING MODELS; REAL-WORLD APPLICATION;

COMMUNICATION; COMPUTER OPERATING SYSTEMS; DISTRIBUTED PARAMETER NETWORKS; LINGUISTICS; MESSAGE PASSING; MIDDLEWARE; PROGRAM INTERPRETERS;

PARALLEL PROGRAMMING;

EID: 77954078032     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPSW.2010.5470773     Document Type: Conference Paper

References (30)

1. V. R. Basili, J. C. Carver, D. Cruzes, L. M. Hochstein, J. K. Hollingsworth, F. Shull, and M. V. Zelkowitz, "Understanding the highperformance- computing community: A software engineer's perspective," IEEE Softw., vol. 25, no. 4, pp. 29-36, 2008.
2. OpenMP, "The OpenMP Application Program Interface," Available from http://openmp.org/wp/about-openmp/.
3. J. Armstrong, B. Dacker, T. Lindgren, and H. Millroth, "Erlang - White Paper," Available from http://erlang.org/whitepaper.html.
4. GHC, "Data Parallel Haskell," Available from http://www.haskell.org/haskellwiki/GHC/Data-Parallel-Haskell.
5. Google, "The Go Programming Language," Availablefromhttp:// golang.org/.
6. E. Lusk, "MPI on a hundred million processors...Why not?" Talk at Clusters and Computational Grids for Scientific Computing 2008, Available from http://www.cs.utk.edu/∼dongarra/ccgsc2008/talks/Talk10-Lusk.pdf, September 2008.
7. Argonne National Laboratory, "MPICH2: A high performance and portable implementation of MPI standard," Available from http://www.mcs.anl.gov/research/projects/mpich2/index.php.
8. CoSMoS, "Complex systems modelling and simulation infrastructutre," Available from http://www.cosmos-research.org/.
9. M. Pettersson, K. F. Sagonas, and E. Johansson, "The HiPE/x86 Erlang Compiler: System description and performance evaluation," in FLOPS, 2002, pp. 228-244.
10. D. Buntinas, W. Gropp, and G. Mercier, "Design and evaluation of Nemesis, a scalable, low-latency, message-passing communication subsystem," in CCGRID '06: Proceedings of the Sixth IEEE International Symposium on Cluster Computing and the Grid. Washington, DC, USA: IEEE Computer Society, 2006, pp. 521-530. [Online]. Available: http://dx.doi.org/10.1109/CCGRID.2006.31. (Pubitemid 44761749)
11. D. Buntinas, G. Mercier, and W. Gropp, "Implementation and evaluation of shared-memory communication and synchronization operations in MPICH2 using the Nemesis communication subsystem," Parallel Comput., vol. 33, no. 9, pp. 634-644, 2007.
12. R. von Behren, J. Condit, F. Zhou, G. C. Necula, and E. Brewer, "Capriccio: scalable threads for internet services," in SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles. New York, NY, USA: ACM, 2003, pp. 268-281.
13. E. Toernig, "Coroutine library," Available from http://www.goron.de/∼froese/coro/coro.html.
14. J. M. Mellor-Crummey and M. L. Scott, "Algorithms for scalable synchronization on shared-memory multiprocessors," ACM Transactions on Computer Systems, vol. 9, pp. 21-65, 1991.
15. P. Balaji, D. Buntinas, D. Goodell, W. Gropp, S. Kumar, E. Lusk, R. Thakur, and J. L. Traff, "MPI on a million processors," in Proceedings of the 16th European PVM/MPI Users' Group Conference, September 2009.
16. C. Huang, O. Lawlor, and L. V. Kale, "Adaptive MPI," in In Proceedings of the 16th International Workshop on Languages and Compilers for Parallel Computing LCPC 03, 2003, pp. 306-322.
17. A. Pant, H. Jafri, and V. Kindratenko, "Phoenix: A runtime environment for high performance computing on chip multiprocessors," Parallel, Distributed, and Network-Based Processing, Euromicro Conference on, vol. 0, pp. 119-126, 2009.
18. V. Kumar, A. Grama, A. Gupta, and G. Karypis, Introduction to parallel computing: design and analysis of algorithms. Redwood City, CA, USA: Benjamin-Cummings Publishing Co., Inc., 1994.
19. U. of Kent, "Occam-pi: Blending the best of CSP and the pi-calculus," Available from http://www.cs.kent.ac.uk/projects/ofa/kroc/.
20. C. G. Ritson, A. T. Sampson, and F. R. M. Barnes, "Multicore scheduling for lightweight communicating processes," in COORDINATION, 2009, pp. 163-183.
21. U. of Kent, "Source code for bird flocking simulation," Available from http://projects.cs.kent.ac.uk/projects/kroc/svn/kroc/trunk/tests/ ccsp-comparisons.
22. E. Demaine, "A threads-only MPI implementation for the development of parallel programs," in Proceedings of the 11th International Symposium on High Performance Computing Systems, 1997, pp. 153-163.
23. P. Bhargava, "MPI-LITE: Multithreading support for MPI," Available from http://pcl.cs.ucla.edu/projects/sesame/mpilite/mpilite.html, 1997.
24. K. Shen, H. Tang, and T. Yang, "Adaptive two-level thread management for fast MPI execution on shared memory machines," in Supercomputing '99: Proceedings of the 1999 ACM/IEEE conference on Supercomputing (CDROM). New York, NY, USA: ACM, 1999, p. 49.
25. H. Tang, K. Shen, and T. Yang, "Compile/run-time support for threaded MPI execution on multiprogrammed shared memory machines," SIGPLAN Not., vol. 34, no. 8, pp. 107-118, 1999.
26. H. Tang and T. Yang, "Optimizing threaded MPI execution on SMP clusters," in ICS '01: Proceedings of the 15th international conference on Supercomputing. New York, NY, USA: ACM, 2001, pp. 381-392.
27. W. Gropp, E. Lusk, N. Doss, and A. Skjellum, "A high-performance, portable implementation of the MPI message passing interface standard," Parallel Computing, vol. 22, no. 6, pp. 789-828, Sept. 1996.
28. W. D. Gropp and E. Lusk, User's Guide for MPICH, a Portable Implementation of MPI, Mathematics and Computer Science Division, Argonne National Laboratory, 1996, ANL-96/6.
29. L. V. Kale and S. Krishnan, "CHARM++: A portable concurrent object oriented system based on C++," University of Illinois at Urbana- Champaign, Champaign, IL, USA, Tech. Rep., 1993.
30. P. H. Welch, "Process oriented design for java: Concurrency for all," in ICCS '02: Proceedings of the International Conference on Computational Science-Part II. London, UK: Springer-Verlag, 2002, p. 687.