Finding, expressing and managing parallelism in programs executed on clusters of workstations

Computer Communications

Volumn 22, Issue 11, 1999, Pages 998-1016

  Goscinski, A M ^a  

^a DEAKIN UNIVERSITY   (Australia)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER PROGRAMMING LANGUAGES; COMPUTER SYSTEMS PROGRAMMING; COMPUTER WORKSTATIONS; DATA STORAGE EQUIPMENT; PROGRAM COMPILERS; RESPONSE TIME (COMPUTER SYSTEMS);

DISTRIBUTED SHARED MEMORY (DSM);

PARALLEL PROCESSING SYSTEMS;

EID: 0032686588     PISSN: 01403664     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0140-3664(99)00072-9     Document Type: Article

References (98)

1. Flynn M.J. Some Computer Organizations and Their Effectiveness. IEEE Transactions on Computers. C-21:1972;948-960.
2. Flynn M.J., Rudd K.W. Parallel Architectures. ACM Computing Surveys. 28:(1):1996;67-70.
3. Bell G. Observations on supercomputing alternatives: did the MPP bandwagon lead to a cul-de-sac? Communications of the ACM. 39:(3):1996;11-15.
4. K. Hwang, Clusters and MPPs for scalable parallel computing, Invited Paper, IEEE Second International Conference on Algorithms and Architectures for Parallel Processing (ICA3PP), Singapore, June 1996.
5. Woodward P.R. Perspectives on supercomputing: three decades of change. Computer. 29:(10):1996;99-111.
6. Z. Xu, K. Hwang, MPPs and clusters for scalable computing, Proceedings of the Second International Symposium on Parallel Architectures, Algorithms, and Networks (I-SPAN'96), Beijing, June 1996.
7. U. Trottenberg, Are Multiworkstations replacing supercomputers or massively parallel systems? Questions, Facts and a Result, GDM D Spiegel 1'93 D The Journal of the German National Research Center for Computer Science (GMD), 1993.
8. G.E. Culler, A. Arpaci-Gusseau, R. Arparci-Gusseau, B. Chun, S. Lumetta, A. Maimraring, R. Martin, C. Yoshikawa, F. Wong, Parallel Computing on the Berkeley NOW, 1998.
9. G. Ridge, G. Becker, P. Merkey, T. Sterling, Beowulf: harnessing the power of parallelism in a pile-of-PCs, Proceedings of the Aerospace, 1997.
10. A. Barak, A. Braverman, O. Laden, Performance of PVM with the MOSIX pre-emptive process migration, Proceedings of the Seventh Israeli Conference on Computer Science and Software Engineering, Herzliya, June 1996.
11. D. De Paoli, A. Goscinski, M. Hobbs, G. Wickham, Microkernel and kernel server support for parallel execution and global scheduling on a distributed system, Proceedings of the IEEE First International Conference on Algorithms and Architectures for Parallel Processing, Brisbane, April 1995.
12. Blackford L.S., Cleary A., Petitet A., Whaley R.C., Demmel J., Dhillon I., Ren H., Stanley K., Dongarra J., Hammarling S. Practical experience in the numerical dangers of heterogeneous computing. ACM Transactions on Mathematical Software. 23:(2):1997;133-147.
13. Z. Xu, K. Hwang, Coherent parallel programming in C//, Proceedings of the 1997 Conference on Advances in Parallel and Distributed Computing, Shanghai, March 1997.
14. Furht B. Parallel computing: glory and collapse. Computer. 12:1994;74-75.
15. Goscinski A. Parallel Processing on Clusters of Workstations, Networks-The Next Milennium. 1997;World Scientific, Singapore.
16. Lewis T. Supercomputers are not so super. Computer. 27:(11):1994;5-6.
17. Bal H.E. Programming Distributed Systems. 1990;Prentice-Hall, Englewood Cliffs, NJ.
18. H.E. Bal, J.G. Steiner, A.S. Tanenbaum, Programming languages for distributed computing systems, ACM Computing Surveys, September 1989.
19. Gehani N.H., Roome W.D. Concurrent C. Software Practice and Experience. 16:(9):1986;841-844.
20. Ahuja S., Carriero N., Gelernter D. Linda and friends. IEEE Computer. August:1986;26-34.
21. A. Black, N. Hutchins, E. Jul, H. Levy, Object structure in the emerald system, SIGPLAN Notices, in: Proceedings of the Object-Oriented Programming Systems, Languages and Applications 1986, vol. 21, no. 11, Portland, OR, 1986.
22. Occam Programming Manual. 1984;Prentice-Hall, Englewood Cliffs, NJ. pp. 60-70.
23. P. Hudak, Para-functional programming, IEEE Computer 19 (8) (1986).
24. Shapiro E. Concurrent Prolog: a progress report. Computer. 19:(8):1986;44-58.
25. *MOD-A language for distributed programming. IEEE Transactions on Software Engineering. SE-6:(6):1980;563-571.
26. Jul E., Levy H., Hutchins N., Black A. Fine-grained mobility in the Emerald system. ACM Transactions on Computer Systems. 6:(1):1988;1061-1078.
27. Tsujino Y., Ando M., Araki T., Takura N. Concurrent C: a programming language for distributed systems. Software Practice and Experience. 14:(11):1984;1061-1078.
28. Brinch Hansen P. Distributed processes: a concurrent programming concept. Communications of the ACM. 21:(11):1978;934-941.
29. Bal H.E. Brazier F.M.T., Johansen D. A comparitive study of five parallel programming languages, Distributed Open Systems. 1994;IEEE.
30. N. Carriero, D. Gelernter, Applications experience with Linda, Proceedings of the ACM/SIGPLAN PPEALS 1998 on Parallel Programming: Experience with Applications, Languages and Systems, New Haven, July 1988.
31. Carriero N., Gelernter D. Linda in context. Communications of the ACM. 32:(4):1989;444-458.
32. Bal H.E., Tanenbaum A.S., Kaashoek M.F. Orca: a language for distributed programming. SIGPLAN Notices. 25:(5):1990;17-24.
33. Koelbel C., Loveman D., Steele G., Zosel M. The High Performance Fortran Handbook. 1994;MIT Press, Cambridge, MA.
34. Subhlok J., Yang B. A new model for integrated nested task and data parallel programming. ACM SIGPLAN Notices. 32:(7):1997;1-12.
35. C. Pleier, The distributed C development environment, Technical Report TVM-I9324, Technische Universitat Munchien, September 1993.
36. Chandria R., Gupta A., Hennessy J. COOL: an object-based language for parallel programming. IEEE Computer. 27:(8):1994;13-26.
37. Beguelin D., Dongarra J., Geist A., Manchek R., Otto S., Walpole J. PVM: Experiences, Current Status and Future Direction. 1993;ACM.
38. J.J. Dongarra, S.W. Otto, M. Snir, D. Walker, An introduction to the MPI standard, University Technical Report CS-95-274, University of Tennessee, January 1995.
39. R. Butler, E. Lusk, User's guide to the p4 parallel programming system, Technical Report ANL-92/17, Aragonne National Laboratory, 1992.
40. Sunderam V. Bode A., Dongarra J., Sunderam V. The PVM System: Status, Trends, and Directions, Parallel Virtual Machine - EuroPVM ′96. 1996;Springer, Berlin.
41. A. Petrie, R. Kerr, A qualitative comparison of Network Linda and PVM, Technical Report, Computing Service, University of Newcastle upon Tyne, July 1994.
42. R. Butler, E. Lusk, Monitors, messages, and clusters: the p4 parallel programming system, Technical Report Preprint MCS-P362-0493 to appear in Parallel Computing (April 1994), Aragonne National Laboratory, 1993.
43. MPIF, Message Passing Interface Forum, MPI: A Message Passing Interface Standard, Computer Science Technical Report CS-94-230, University of Tennessee, April 1994.
44. Grop W., Lusk E. Why are PVM and MPI so different. Bubak M., Dongarra J., Wasnievski J. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 1997;. Lecture Notes in Computer Science 1332.
45. Snir M., Otto S., Huss-Lederman S., Dongarra J. MPI: The Complete Reference. 1996;MIT Press, Cambridge, MA.
46. Hempel R. Bode A., Dongarra J., Ludwig T., Sunderam V. The Status of the MPI Message-Passing Standard and Its Relation to PVM, Parallel Virtual Machine-EuroPVM '96. 1996;Springer, Berlin.
47. Geist G.A. Bode A., Dongarra J., Ludwig T., Sunderam V. Advanced Programming in PVM, Parallel Virtual Machine-EuroPVM '96. 1996;Springer, Berlin.
48. Li K., Hudak P. Memory coherence in shared virtual memory systems. ACM Transactions on Computer Systems. 7:(4):1989;321-359.
49. L. Iftode, J.P. Singh, Shared virtual memory: progress and challanges, Technical Report TR-552-97, Department of Computer Science, Princeton University, October 1997.
50. J. Silcock, Programmer friendly and efficient distributed shared memory integrated into a distributed operating system, PhD Thesis, Deakin University, January 1998.
51. K. Li, IVY: a shared virtual memory system for parallel computing, Proceedings of the 1988 International Conference on Parallel Processing, 1988.
52. Carter, Efficient distributed shared memory based on multi-protocol release consistency, PhD Thesis, Rice University, September 1993.
53. Amza C., Cox A.L., Dwarkadas S., Keleher P., Lu H., Rajmony R., Zwaenepoel W. TreadMarks: shared memory computing on networks of workstations. Computer. 29:(2):1996;18-28.
54. P. Koleher, Lazy release consistency for distributed shared memory, PhD Thesis, Rice University, January 1995.
55. P. Koleher, Private Communication, April 1996.
56. 3PP′97, Melbourne, December 1997.
57. J. Silcock, A. Goscinski, Invalidation-based distributed shared memory integrated into a distributed operating system, Proceedings of IASTED the International Conference on Parallel and Distributed Systems-Euro-PDS97, Barcelona, June 1997.
58. Wolfe M. Parallelising compilers. ACM Computing Surveys. 28:(1):1996;261-262.
59. Girkar M. C. Polychronopoulos extracting task-level parallelism. ACM Transactions on Programming Languages and Systems. 17:(4):1995;600-634.
60. D. Bacon, S.L. Graham, O.J. Sharp, Compiler transformations for high-performance computing, Technical Report UCB/CSD-93-781, Department of Computer Science, University of California, Berkeley, 1993.
61. Kumar V., Grama A., Gupta A., Karypis G. Introduction To Parallel Computing: Design and Analysis. 1994;Benjamin/Cummings, Melno Park, CA.
62. Wolfe M. High Performance Compilers for Parallel Computing. 1996;Addison-Wesley, Reading, MA.
63. V. Chaudhary, C. Xu, S. Roy, J. Ju, V. Sinha, L. Luo, Design and evaluation of an environment ape for automatic parallelization of programs, Proceedings of the Second International Symposium on Parallel Architectures, Algorothms, and Networks (I-SPAN'960), IEEE Computer Society Press, June 1996.
64. A. Goscinski, Identification of coarse-graine units of parallelism in programs and their parallel execution on distributed systems, Research proposal, Technical Report TRC 94/Dec, School of Computing and Mathematics, Deakin University, December 1994.
65. M. Gupta, P. Banerjee, Paradigm: a compiler for automated data partitioning on multicomputers, Proceedings of the Seventh ACM International Conference on Supercomputing, ACM, New York, 1993.
66. A. Goscinski, D. Evans, Towards a Parallelising Compiler in Support of Parallel Execution on Distributed Systems, Proceedings of the Sup'Eur 96 Conference on High Performance Computing in Europe on IBM Platforms, September 1996.
67. K.D. Cooper, M.W. Hall, R.T. Hood, K. Kennedy, K.S. McKinley, J.M. Mellor-Crummey, L. Torczon, S.K. Warren, The ParaScope parallel programming environment, Proceedings of the IEEE 81 (2) (1993).
68. D. Padua, private communication, 1996.
69. Banerjee P., et al. The paradigm compiler for distributed-memory multicomputers. Computer. 28:(10):1995;37-47.
70. R.P. Wilson, R.S. French, C.S. Wilson, S.P. Amarasinghe, J.M. Anderson, S.W.K. Tjiang, S.-W. Liao, C.-W. Tseng, M.W. Hall, M.S. Lam, J.L. Hennessy, SUIF: An Infrastructure for Research on Parallelising and Optimising Compilers, Stanford University, .
71. Evans D.J., Goscinski A.M. Automatic identification of parallel units and synchronisation points in programs for parallel execution on a distributed system. Computer Systems: Science and Engineering. 12:(5):1997;307-315.
72. Polychronopoulos et al., Parafrase-2: An environment for parallelizing, partitioning, synchronizing, and scheduling programs on multiprocessors, Proceedings of the 18th International Conference on Parallel Processing, vol. 2, Penn State University Press, University Park, Pa, 1989.
73. SUIF Compiler System, Version 1.0. The SUIF library - a set of core routines for manipulating SUIF data structures .
74. Aho A.V., Sethi R., Ullma J.D. Compilers: Principles, Techniques and Tools. 1988;Addison-Wesley, Reading, MA.
75. Geist G.A. Advanced capabilities in PVM 3.4. Bubak M., Dongarra J., Wasnievski J. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 1997;Springer, Berlin. Lecture Notes In Computer Science 1332.
76. Fagg G.E., London K.S., Dongarra J.J. Taskers and general resource managers: PVM supporting DCE process management. Bode A., Dongara J., Ludwig T., Sunderam V. Parallel Virtual Machine-EuroPVM'96. 1996;Springer, Berlin.
77. S.W. Otto, Processor virtualization an migration for PVM, Proceedings of the Second Workshop on Environments and Tools for Parallel Scientific Computing, Townsend, Tennessee, May 1994.
78. J. Casas, R. Konuru, S.W. Otto, R. Prouty, J. Walpole, Adaptive load migration systems for PVM, Proceedings of Supercomputing '94, Washington DC, November 1994.
79. J. Casas, D. Clark, P. Galbiati, R. Konuru, S. Otto, R. Prouty, J. Walpole, MIST: PVM with transparent migration and checkpointing, Proceedings of the Third Annual PVM Users' Group Meeting, Pittsburgh, Pennsylvania, May 1995.
80. A. Sinap, Message passing with MPI, Proceedings of the High Performance Computing in Europe on IBM Platforms, Krakow, September 1996.
81. Geist G.A., Kohl J.A., Papadopoulos P.M., Scott S.L. Beyond PVM 3.4: what we've learned, what's next, and why. Bubak M., Dongarra J., Wasnievski J. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 1997;Springer, Berlin. Lecture Notes in Computer Science 1332.
82. J. Dongarra, A. Geist, J.A. Kohl, P.M. Papadopoulos, V. Sunderam, HARNESS: Heterogeneous Adaptable Reconfigurable Networked SystemS, Oak Ridge National Laboratory, Oak Ridge, TN, March 1998.
83. Anderson T.E., Culler D.E., Patterson D.A. A case for NOW (Networks of Workstations). IEEE Micro. February:1995;54-64.
84. Goscinski A. Distributed Operating Systems. The Logical Design. 1991;Addison-Wesley, Reading, MA.
85. A. Barak, O. Laden, Y. Yarom, The NOW MOSIX and its Preemptive Process Migration Scheme, , 1995.
86. Rough J., Goscinski A., De Paoli D. PVM on the RHODOS distributed operating system. Bubak M., Dongarra J., Wasnievski J. Recent Advances in Parallel Virtual Machine and Message Passing Interface. 1997;Springer, Berlin. Lecture Notes in Computer Science 1332.
87. A. Goscinski, J. Silcock, An easy to program and use DSM environment, Proceedings of the 10th IASTED International Conference on Parallel and Distributed Computing and Systems, Las Vegas, Nevada, October 1998.
88. S.-C. Huang, Z.M. Kedem, Supporting a flexible parallel programming model on a network of workstations, Proceedings of the 16th IEEE International Conference on Distributed Computing Systems, Hong Kong, June 1996.
89. 3PP, Singapore, June 1996.
90. Hobbs M., Goscinski A. The RHODOS remote process creation facility supporting parallel execution on distributed system. Journal of High Performance Computing. 3:(1):1996;23-30.
91. A. Bode, Load balancing in distributed memory multiprocessors, Proceedings of the Conference on Advanced Computer Technology, Reliable Systems and Applications, May, 1991.
92. M. Hobbs, A. Goscinski, Supporting parallel processing on the RHODOS cluster of workstations, Proceedings of the International Symposium on Parallel Architectures, Algorithms and Networks, I-SPAN'97, Taipei, Taiwan, December 1997.
93. A. Goscinski, Towards a global computer: improving the overall distributed system performance and the computational services provided to users by employing global scheduling and parallel execution, Technical Report C93/Dec, School of Computing and Mathematics, Deakin University, 1993.
94. D. De Paoli, A. Goscinski, P. Joyce, M. Hobbs, Performance comparison of process migration with remote process creation and execution in RHODOS, Proceedings of the IEEE International Conference on Distributed Computer Systems, Hong Kong, May 1996.
95. D. De Paoli, A. Goscinski, M. Hobbs, P. Joyce, G. Wickham, An execution environment supporting parallel processing on a distributed system, Proceedings of the Third Australasian Conference on Parallel and Real-Time Systems, Brisbane, 30 September-1 October 1996.
96. M. Hobbs, A. Goscinski, A Concurrent Process Creation service to support SPMD based parallel processing on COWs. Concurrency: Practice and Experience, under review.
97. De Paoli D., Goscinski A. The RHODOS migration facility. Journal of Systems Software. 1998;51-65.
98. P. Joyce, A. Goscinski, Group communication in RHODOS, Proceedings of the IEEE Singapore International Conference on Networks, Singapore, April 1997.