Program transformation and runtime support for threaded MPI execution on shared-memory machines

ACM Transactions on Programming Languages and Systems

Volumn 22, Issue 4, 2000, Pages 673-700

  Tang, Hong ^a,b   Shen, Kai ^a,b   Yang, Tao ^a,b  

^a UNIVERSITY OF CALIFORNIA   (United States)

^b University of California   (United States)

Author keywords

B.3.2 Memory Structures : Design Styles Shared memory; D.1.3 Programming Techniques : Concurrent Programming Parallel programming; D.3.2 Programming Languages : Language Classifications Concurrent, distributed, and parallel languages

Indexed keywords

EID: 0003576826     PISSN: 01640925     EISSN: None     Source Type: Journal    
DOI: 10.1145/363911.363920     Document Type: Article

References (35)

1. ANDERSON, T. E. 1990. The performance of spin lock alternatives for shared-money multiprocessors. IEEE Trans. Parall. Distrib. Syst. 1, 1 (Jan.), 6-16.
2. ARORA, N. S., BLUMOFE, R. D., AND PLAXTON, C. G. 1998. Thread scheduling for multiprogrammed multiprocessors. In Proceedings of the 10th Symposium on Parallel Algorithms and Architectures. Puerto Vallarta, Mexico, 119-29.
3. BRIGHTWELL, R. AND SKJELLUM, A. 1996. MPICH on the T3D: a case study of high performance message passing. Tech. rep., Computer Sci. Dept., Mississippi State Univ.
4. BRUCK, J., DOLEV, D., HO, C.-T., ROŞU, M.-C., AND STRONG, R. 1997. Efficient message passing interface (MPI) for parallel computing on clusters of workstations. Journal of Parallel and Distributed Computing 40, 1 (10 Jan.), 19-34.
5. CANNON, L. E. 1969. A cellular computer to implement the kalman filter algorithm. Ph.D. thesis, Department of Electrical Engineering, Montana State University, Bozeman, MT. Available from UMI, Ann Arbor, MI.
6. CROVELLA, M., DAS, P., DUBNICKI, C., LEBLANC, T., AND MARKATOS, E. 1991. Multiprogramming on multiprocessors. In Proceedings of the 3rd IEEE Symposium on Parallel and Distributed Processing. IEEE, 590-597.
7. CULLER D. E., SINGH, J. P., AND GUPTA, A. 1999. Parallel Computer Architecture A Hardware/Software Approach, 1 ed. Morgan Kaufmann Publishers, San Francisco, CA.
8. FEITELSON, D. 1997. Job scheduling in multiprogrammed parallel systems. Tech. Rep. Research Report RC 19790, IBM.
9. FERRARI, A. AND SUNDERAM, V. 1995. TPVM: distributed concurrent computing with lightweight processes. In Proceedings of IEEE High Performance Distributed Computing. IEEE, Washington, D.C., 211-218.
10. FOSTER, I., KESSELMAN, C., AND TUECKE, S. 1996. The Nexus approach to integrating multithreading and communication. Journal of Parallel and Distributed Computing 37, 1 (25 Aug.), 70-82.
11. GROPP, W. AND LUSK, E. 1997. A high-performance MPI implementation on a shared-memory vector supercomputer. Parallel Computing 22, 11 (Jan.), 1513-1526.
12. GROPP, W., LUSK, E. DOSS, N., AND SKJELLUM, A. 1996. A high-performance, portable implementation of the MPI message passing interface standard. Parallel Computing 22, 6 (Sept.), 789-828.
13. HERLIHY, M. 1991. Wait-free synchronization. ACM Trans. Program. Lang. Syst. 11, 1 (Jan.), 124-149.
14. JIANG, D., SHAN, H., AND SINGH, J. P. 1997. Application restructuring and performance portability on shared virtual memory and hardware-coherent multiprocessors. In Proceedings of the 6th ACM Symposium on Principles and Practice of Parallel Programming. ACM, New York, 217-29.
15. KERNIGHAN, B. W. AND RITCHIE, D. M. 1988. The C Programming Language , 2 ed. Prentice Hall, Inc, Englewood Cliffs, NJ.
16. KONTOTHANASSIS, L. I., WISNIEWSKI, R. W., AND SCOTT, M. L. 1997. Scheduler-conscious synchronization. ACM Trans. Comput. Syst. 15, 1 (Feb.), 3-40.
17. LEUTENEGGER, S. T. AND VERNON, M. K. 1990. The performance of multiprogrammed multiprocessor scheduling algorithms. In Proceedings of ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. New York, 226.
18. LUMETTA, S. S. AND CULLER, D. E. 1998. Managing concurrent access for shared memory active messages. In Proceedings of the International Parallel Processing Symposium. Orlando, Florida 272-8.
19. MASSALIN, H. AND PU, C. 1991. A lock-free multiprocessor OS kernel. Tech. Rep. CUCS-005-91, Computer Science Department, Columbia University. June.
20. MPI-FORUM. 1999. MPI Forum, http://www.mpi-forum.org.
21. NCSA. 1999. NCSA note on SGI Origin 2000 IRIX 6.5. http://www.ncsa.uiuc.edu/SCD/ Consulting/Tips/Scheduler.html.
22. NEC. 1999. MPI for NEC Supercomputers, http://www.ccrl-nece.technopark.gmd.de/∼mpich/.
23. NICHOLS, B., BUTTLAR, D., AND FARRELL, J. P. 1996. Pthread Programming, 1 ed. O'Reilly & Associates.
24. OUSTERHOUT, J. 1982. Scheduling techniques for concurrent systems. In Proceedings of the 3rd International Conference of Distributed Computing Systems. IEEE, 22-30.
25. PATTERSON, D. A. AND HENNESSY, J. L. 1998. Computer Organization & Design, 2 ed. Morgan Kaufmann Publishers, San Francisco, CA.
26. PRAKASH, S. AND BAGRODIA, R. 1998. MPI-SIM: using parallel simulation to evaluate MPI programs. In Proceedings of Winter simulation. Washington, DC., 467-474.
27. PROTOPOPOV, B. AND SKJELLUM, A. 1998. A multi-threaded message passing interface(MPI) architecture: performance and program issues. Tech. rep., Computer Science Department, Mississippi State Univ.
28. SALO, E. 1998. Personal communication.
29. SHEN, K., TANG, H., AND YANG, T. 1999. Adaptive two-level thread Management for fast MPI execution on shared memory machines. In Proceedings of ACM/IEEE SuperComputing '99. ACM/IEEE, New York. Will be available from www.cs.ucsb.edu/research/tmpi.
30. SKJELLUM, A., PROTOPOPOV, B., AND HEBERT, S. 1996. A thread taxonomy for MPI. MPIDC.
31. SNIR, M., OTTO, S., HUSS-LEDERMAN, S., WALKER, D., AND DONGARRA, J. 1996. MPI: The Complete Reference. MIT Press.
32. TUCKER, A. AND GUPTA, A. 1989. Process control and scheduling issues for multiprogrammed shared-memory multiprocessors. In Proceedings of the 12th ACM Symposium on Operating System Principles. ACM, New York.
33. YUE, K. K. AND LILJA, D. J. 1998. Dynamic processor allocation with the Solaris operating system. In Proceedings of the International Parallel Processing Symposium. Orlando, Florida.
34. ZAHORJAN, J. AND MCCANN, C. 1990. Processor scheduling in shared memory multiprocessors. In Proceedings of the ACM SIGMETRICS International Conference on Measurement and Modeling of Computer Systems. ACM, New York, 214-225.
35. ZHOU, H. AND GEIST, A. 1997. LPVM: a step towards multithread PVM. Concurrency - Practice and Experience.