Advanced environments for parallel and distributed applications: A view of current status

Parallel Computing

Volumn 28, Issue 12, 2002, Pages 1637-1662

  D'ambra, Pasqua ^a   Danelutto, Marco ^b   Di Serafino, Daniela ^c   Lapegna, Marco ^d  

^a CNR   (Italy)

^b UNIVERSITY OF PISA   (Italy)

^c SECOND UNIVERSITY OF NAPLES   (Italy)

^d UNIVERSITY OF NAPLES FEDERICO II   (Italy)

Author keywords

Parallel and distributed computing; Problem solving environments; Programming environments

Indexed keywords

COMPUTER ARCHITECTURE; COMPUTER HARDWARE; COMPUTER PROGRAMMING; COMPUTER SOFTWARE; PROBLEM SOLVING;

SOFTWARE ARCHITECTURE;

PARALLEL PROCESSING SYSTEMS;

EID: 0036892940     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8191(02)00199-0     Document Type: Article

References (121)

1. Carnegie Mellon Software Engineering Institute, .
2. Bass L., Clements P., Kazman R. Software Architecture in Practice. 1997;Addison-Wesley.
3. Garlan D., Perry D. Introduction to the special issue on software architecture. IEEE Transactions on Software Engineering. 21:1995;269-274.
4. Top500.org, Top500 supercomputer sites, .
5. J. Hsieh, V. Mashayekhi, R. Rooholamini, Architectural and performance evaluation of GigaNet and Myrinet interconnections on clusters of small-scale SMP servers, in: Proceedings of SuperComputing 2000, 2000.
6. QSNet, .
7. The Myricom home page: .
8. Messina P. High-performance computers: The next generation (Part I). Computers in Physics. 11:1997;454-466.
9. Messina P. High-performance computers: The next generation (Part II). Computers in Physics. 11:1997;598-610.
10. USA Interagency WG on Information Technology Research and Development, Networking and Information Technology Research and Development, 2002. Available from .
11. Object Management Group, Common Object Request Broker Architecture (CORBA/IIOP), version 3.0, OMG specification document, 2002. Available from , see also the CORBA home page: .
12. Object Management Group, Common Object Request Broker Architecture (CORBA/IIOP), version 3.0, OMG specification document, 2002. Available from , see also the CORBA home page: .
13. Foster I., Kesselman C. Globus: a metacomputing infrastructure toolkit. International Journal of Supercomputer Applications. 11:1997;115-128. see also the Globus Project home page: .
14. Foster I., Kesselman C. Globus: a metacomputing infrastructure toolkit. International Journal of Supercomputer Applications. 11:1997;115-128. see also the Globus Project home page: .
15. Grimshaw A., Ferrari A., Knabe F., Humphrey M. Legion: an operating system for wide-area computing. IEEE Computer. 32:1999;29-37.
16. Basney J., Livny M. Deploying a high throughput computing cluster. Buyya R. Performance Cluster Computing. vol. 1:1999;Prentice Hall PTR. see also the CONDOR Project home page: .
17. Basney J., Livny M. Deploying a high throughput computing cluster. Buyya R. Performance Cluster Computing. vol. 1:1999;Prentice Hall PTR. see also the CONDOR Project home page: .
18. Wolski R., Spring N., Hayes J. The network weather service: a distributed resource performance forecasting service for metacomputing. Future Generation Computer Systems. 15:1999;757-768.
19. USA NSF Middleware Initiative, .
20. Foster I., Kesselman C., Tuecke S. The anatomy of the Grid: enabling scalable virtual organizations. International Journal of Supercomputer Applications. 15:2001.
21. Fox G. Peer-to-peer networks. Computing in Science and Engineering. 3(3):2001;75-77.
22. Fox G., Gannon D. Computational Grids. Computing in Science and Engineering. 4:2001;74-77.
23. GNU, GCC home page: .
24. The Portland Group home page: .
25. Au P., Darlington J., Ghanem M., Guo Y., To H., Yang J. Co-ordinating heterogeneous parallel computation. Bouge L., Fraigniaud P., Mignotte A., Robert Y. Euro-Par'96. 1996;601-614.
26. 3L: a structured high level programming language and its structured support. Concurrency Practice and Experience. 7(3):1995;225-255.
27. S. Chakrabarti, J. Demmel, D. Yelick, Modeling the benefits of mixed data and task parallelism, Lapack Working Note 97, Technical Report CS-95-289, University of Tennessee, 1995. Available from .
28. McDonald S., Szafron D., Schaeffer J., Bromling S. Generating parallel program frameworks from parallel design patterns. Bode A., Ludwing T., Karl W., Wismüller R. Euro-Par 2000 Parallel Processing. vol. 1900:2000;95-105 Springer-Verlag.
29. Pelagatti S. Structured Development of Parallel Programs. 1998;Taylor and Francis.
30. Danelutto M. Efficient support for skeletons on workstation clusters. Parallel Processing Letters. 11(1):2001;41-56.
31. Szyperski C. Component software: beyond object-oriented programming. 1998;ACM Press.
32. Gamma E., Helm R., Johnson R., Vissides J. Design Patterns: Elements of Reusable Object-Oriented Software. 1994;Addison Wesley.
33. Dongarra J.J., Walker D.W. The quest for Petascale computing. Computing in Science and Engineering. 3(3):2001;32-39.
34. R. Stevens, Applications for PetaFLOPs, PetaFLOPs II Conference, 1999. Available from .
35. Ambrosiano J., Quinlan D., Armstrong R.A. Software interoperability. ASCI Technology Prospectus on Simulation and Computational Science. 1:2001;25-35.
36. M. Horsmann, M. Kirtland, DCOM Architecture, Microsoft White Paper, 1997. Available from .
37. Englander R. Developing Java Beans. 1997;O'Really & Associates.
38. Monson-Haefel R. Enterprise Java Beans. third ed. 2001;O'Really & Associates.
39. The Common Component Architecture Forum home page: .
40. R. Armstrong, D. Gannon, A. Geist, K. Keahey, S. Kohn, L. McInnes, S. Parker, B. Smolinski, Toward a common component architecture for high-performance scientific computing, in: Proceedings of the 1999 Conference on High Performance Distributed Computing. Available from .
41. Markus S. et al. An agent-based Netcentric framework for multidisciplinary problem solving environments. International Journal of Computational Engineering Science. 1:2000;33-60. see also GasTurbnLab home page: .
42. Markus S. et al. An agent-based Netcentric framework for multidisciplinary problem solving environments. International Journal of Computational Engineering Science. 1:2000;33-60. see also GasTurbnLab home page: .
43. Joshi A., Ramakrishnan N., Houstis E.N. Multiagent recommender systems in networked scientific computing. Houstis E.N., Rice J.R., Gallopoulos E., Bramley R. Enabling Technologies for Computational Science. Frameworks, Middleware and Environments. 2000;213-223 Kluwer Academic Publishers.
44. Petitet A. et al. Numerical libraries and the Grid. International Journal of High Performance Applications and Supercomputing. 15:2001;359-374.
45. M. Snir et al., MPI: The Complete Reference, 2-volume set, MIT Press, 1998. See also the MPI standard home page: .
46. M. Snir et al., MPI: The Complete Reference, 2-volume set, MIT Press, 1998. See also the MPI standard home page: .
47. Geist A. et al. PVM - Parallel Virtual Machine. 1994;MIT Press.
48. D.C. Schmidt, The ADAPTIVE communication environment: object-oriented network programming components for developing client/server applications, in: 11th and 12th Sun Users Group Conference, 1993-94. Available from , see also the Adaptive Communication Environment (ACE) home page: .
49. D.C. Schmidt, The ADAPTIVE communication environment: object-oriented network programming components for developing client/server applications, in: 11th and 12th Sun Users Group Conference, 1993-94. Available from , see also the Adaptive Communication Environment (ACE) home page: .
50. MPICH home page: .
51. LAM-MPI home page: .
52. M. Cole, Algorithmic Skeletons: Structured Management of Parallel Computations, Pitman, Research Monographs in Parallel and Distributed Computing, 1989.
53. Cole M. A skeletal approach to exploitation of parallelism. Jesshope C. Proceedings of CONPAR'88. British Computer Society Workshop Series. 1989;Cambridge University Press.
54. Danelutto M., Meglio R.D., Orlando S., Pelagatti S., Vanneschi M. A methodology for the development and support of massively parallel programs. Future Generation Computer Systems. 8(1-3):1992;205-220.
55. Bacci B., Danelutto M., Pelagatti S., Vanneschi M. SkIE: a heterogeneous environment for HPC applications. Parallel Computing. 25:1999;1827-1852.
56. Darlington J., Field A.J., Harrison P., Kelly P.H.J., Sharp D.W.N., Wu Q., While R.L. Parallel programming using skeleton functions. Bode M.R.A., Wolf G. PARLE'93 Parallel Architectures and Languages Europe. Lecture Notes in Computer Science. vol. 694:1993;Springer-Verlag.
57. Darlington J., Guo Y., To H.W., Yang J. Parallel skeletons for structured composition. Fifth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming. 1995;ACM Press.
58. J. Darlington, Y. Guo, H.W. To, Q. Wu, J. Yang, M. Kohler, Fortran-S: a uniform functional interface to parallel imperative languages, in: Third Parallel Computing Workshop (PCW'94), Fujitsu Laboratories Ltd., 1994.
59. Darlington J., Ghanem M., To H.W. Structured parallel programming. Programming Models for Massively Parallel Computers. 1993;IEEE Computer Society Press.
60. Burkhart H., Gutzwiller S. Steps towards reusability and portability in parallel programming. Decker K.M., Rehmann R.M. (Eds.), Programming Environments for Massively Parallel Distributed Systems. 1994;147-157 Birkhauser.
61. Schaeffer J., Szafron D., Lobe G., Parsons I. The enterprise model for developing parallel applications. IEEE Parallel and Distributed Technology. 1(3):1993;85-96.
62. T. Bratvold, Skeleton-based parallelisation of functional programs, Ph.D. thesis, Heriot-Watt University, 1994.
63. Serot J. Embodying parallel functional skeletons: an experimental implementation on top of MPI. Lengauer G., Griebl M. (Eds.), Euro-Par'97 Parallel Processing. Lecture Notes in Computer Science. vol. 1300:1997;629-633 Springer-Verlag.
64. J. Serot, D. Ginhac, J. Derutin, SKiPPER: a skeleton-based parallel programming environment for real-time image processing applications, in: Proceedings of the 5th International Parallel Computing Technologies Conference (PaCT'99), 1999.
65. M. Südholt, The transformational derivation of parallel programs using data-distribution algebras and skeletons, Ph.D. thesis, Technische Universität Berlin, 1997. Available from .
66. B. Bacci, S. Gorlatch, C. Lengauer, S. Pelagatti, Skeletons and transformations in an integrated parallel programming environment, in: Proceedings of the 5th International Parallel Computing Technologies Conference (PaCT'99), 1999.
67. Bacci B., Danelutto M., Orlando S., Pelagatti S., Vanneschi M. Summarising an experiment in parallel programming language design. Hertzberger B., Serazzi G. (Eds.), High-Performance Computing and Networking. vol. 919:1995;8-13.
68. D. Szafron, J. Schaeffer, Experimentally assessing the usability of parallel programming systems, in: Programming Environments for Massively Parallel Distributed Systems, Birkhauser, 1994, pp. 203-212.
69. Carriero N., Gelernter D. Linda in context. Communications of the ACM. 32(4):1989;444-458.
70. S. McDonald, J. Anvik, D. Szafron, J. Schaeffer, S. Bromling, K. Tan, From patterns to frameworks to parallel programs, this issue.
71. Massingill B.L., Mattson T.G., Sanders B.A. A pattern language for parallel application programs. Bode A., Ludwig T., Karl W., Wismuller R. (Eds.), Euro-Par 2000 Parallel Processing. Lecture Notes in Computer Science. vol. 1900:2000;678-681 Springer-Verlag.
72. B.L. Massingill, Experiments with program parallelization using archetypes and stepwise refinement, Technical Report TR 98-012, University of Florida, CISE, 1998.
73. B.L. Massingill, T.G. Mattson, B.A. Sanders, A pattern language for parallel application languages, Technical Report TR 99-022, University of Florida, CISE, 1999.
74. The POOMA home page: .
75. K. Keahey, D. Gannon, PARDIS: a CORBA-based architecture for application-level parallel distributed computation, in: Proceedings of Supercomputing '97, 1997. Available from .
76. P. Beaugendre, T. Priol, C. René, Cobra: a CORBA-compliant programming environment for high-performance computing, Technical Report PI 1141, INRIA, 1998. Available from .
77. B.A. Allan et al., The CCA core specification in a distributed memory SPMD framework, Concurrency and Computation-Practice & Experience 14 (5) (2002) 323-345. Available from .
78. M. Govindaraju, S. Krishnan, K. Chiu, A. Slominski, D. Gannon, R. Bramley, XCAT 2.0: a component based programming model for Grid Web services, Technical Report 562, Indiana University, Bloomington, Indiana, 2002, see also XCAT home page: .
79. M. Govindaraju, S. Krishnan, K. Chiu, A. Slominski, D. Gannon, R. Bramley, XCAT 2.0: a component based programming model for Grid Web services, Technical Report 562, Indiana University, Bloomington, Indiana, 2002, see also XCAT home page: .
80. M. Vanneschi, ASSIST: an environment for parallel and distributed portable applications, Technical Report TR-02-07, Department of Computer Science, University of Pisa, Italy, 2002. Available from .
81. M. Vanneschi, The programming model of ASSIST, an environment for parallel and distributed portable applications, this issue.
82. Global Grid Forum, Application Programming Models home page: .
83. Berman F. et al. The GrADS project: software support for high-level Grid application development. International Journal of High Performance Computing Applications. 15(4):2001;327-344. see also the GrADS home page: .
84. Berman F. et al. The GrADS project: software support for high-level Grid application development. International Journal of High Performance Computing Applications. 15(4):2001;327-344. see also the GrADS home page: .
85. Rice J.R. Mathematical Software. 1971;Academic Press.
86. Cody W.J. Observations on the mathematical software effort. in Cowell W.R. (Ed.), Sources and Development of Mathematical Software. 1984;Prentice-Hall.
87. Problem Solving Environments home page: .
88. Di Serafino D., Maddalena L., Messina P., Murli A. Some perspectives on high-performance mathematical software. De Leone R., Murli A., Pardalos P.M., Toraldo G. (Eds.), High Performance Algorithms and Software in Nonlinear Optimization. 1998;1-23 Kluwer Academic Publishers.
89. Houstis E.N., Rice J.R., Gallopoulos E., Bramley R. (Eds.), Enabling Technologies for Computational Science. Frameworks, Middleware and Environments. 2000;Kluwer Academic Publishers.
90. Di Serafino D., Maddalena L., Murli A. PINEAPL: a European project to develop a parallel numerical library for industrial applications. Lengauer C., Griebl M., Gorlatch S. (Eds.), Euro-Par'97 Parallel Processing. Lecture Notes in Computer Science. vol. 1300:1997;1333-1339 Springer-Verlag.
91. De Bono I., Di Serafino D., Ducloux E. Using a general-purpose numerical library to parallelize an industrial application: design of high-performance lasers. Pritchard D., Reeve J. (Eds.), Euro-Par'98 Parallel Processing. Lecture Notes in Computer Science. vol. 1470:1998;812-820 Springer-Verlag.
92. Arnone L., D'Ambra P., Filippone S. A parallel version of KIVA-3 based on general-purpose numerical software and its use in two-stroke engine applications. International Journal of Computer Research. 10:2001;31-46. (special issue on Industrial Applications of Parallel Computing).
93. Gallopoulos E., Houstis E., Rice J.R. Computer as thinker/doer: problem-solving environments for computational science. IEEE Computational Science and Engineering. 1(2):1994;11-23.
94. Houstis E.N., Rice J.R. Future problem solving environments for computational science. Mathematics and Computers in Simulation. 54:2000;243-257.
95. Balay S., Gropp W.D., Curfman McInnes L., Smith B.F. Efficient management of parallelism in object oriented numerical software libraries. Arge E., Bruaset A.M., Langtangen H.P. Modern Software Tools in Scientific Computing. 1997;163-202 Birkhauser Press. see also PETSc home page: .
96. Balay S., Gropp W.D., Curfman McInnes L., Smith B.F. Efficient management of parallelism in object oriented numerical software libraries. Arge E., Bruaset A.M., Langtangen H.P. Modern Software Tools in Scientific Computing. 1997;163-202 Birkhauser Press. see also PETSc home page: .
97. Houstis E.N. et al. Parallel ELLPACK: a problem solving environment for PDE based applications on multicomputer platforms. ACM Transaction of Mathematical Software. 24:1998;30-73. see also Parallel ELLPACK home page: .
98. Houstis E.N. et al. Parallel ELLPACK: a problem solving environment for PDE based applications on multicomputer platforms. ACM Transaction of Mathematical Software. 24:1998;30-73. see also Parallel ELLPACK home page: .
99. Lawson C.L., Hanson R.J., Kincaid D., Krogh F.T. Basic linear algebra subprograms for FORTRAN usage. ACM Transactions on Mathematical Software. 5:1979;308-323.
100. Dongarra J.J., Du Croz J., Hammarling S., Hanson R.J. An extended set of FORTRAN basic linear algebra subprograms. ACM Transactions on Mathematical Software. 14:1988;1-17.
101. Dongarra J.J., Du Croz J., Duff I.S., Hammarling S. A set of level 3 basic linear algebra subprograms. ACM Transactions on Mathematical Software. 16:1990;1-17.
102. Anderson E. LAPACK Users' Guide. third ed. 1999;SIAM.
103. Rice J.R., Boisvert R.F. Solving Elliptic Problems Using ELLPACK. 1984;Springer-Verlag.
104. Dabdub D., Chandy K.M., Hewett T.T. Managing specificity and generality: tailoring general archetypal PSEs to specific users. Houstis E.N., Rice J.R., Gallopoulos E., Bramley R. (Eds.), Enabling Technologies for Computational Science. Frameworks, Middleware and Environments. 2000;65-77 Kluwer Academic Publishers.
105. Spezzano G., Talia D., Di Gregorio S. A parallel cellular tool for interactive modeling and simulation. IEEE Computational Science and Engineering. 3(3):1996;33-43.
106. E.N. Houstis, A.C. Catlin, N. Dhanjani, The WebPDELab server: a problem solving environment for PDE-based applications, IMACS, in press, see also WebPDELab home page: .
107. E.N. Houstis, A.C. Catlin, N. Dhanjani, The WebPDELab server: a problem solving environment for PDE-based applications, IMACS, in press, see also WebPDELab home page: .
108. D. Arnold et al., Users' Guide to NetSolve V1.4.1, Technical Report ICL-UT-02-05, Innovative Computing Department, University of Tennessee, Knoxville, Tennessee, 2002, see also NetSolve home page: .
109. D. Arnold et al., Users' Guide to NetSolve V1.4.1, Technical Report ICL-UT-02-05, Innovative Computing Department, University of Tennessee, Knoxville, Tennessee, 2002, see also NetSolve home page: .
110. Nakada H., Sato M., Sekiguchi S. Design issues of network enabled server systems for the Grid. Buyya R., Baker M. Grid Computing-GRID 2000. Lecture Notes in Computer Science. vol. 1971:2000;4-17 Springer-Verlag. see also Ninf home page: .
111. Nakada H., Sato M., Sekiguchi S. Design issues of network enabled server systems for the Grid. Buyya R., Baker M. Grid Computing - GRID 2000. Lecture Notes in Computer Science. vol. 1971:2000;4-17 Springer-Verlag. see also Ninf home page: .
112. Nimrod home page: .
113. MetaNEOS home page: .
114. C. Johnson, S. Parker, D. Weinstein, Large-scale computational science applications using the SCIRun problem solving environment, Supercomputer (2000). Available from , see also SCIRun home page: .
115. C. Johnson, S. Parker, D. Weinstein, Large-scale computational science applications using the SCIRun problem solving environment, Supercomputer (2000). Available from , see also SCIRun home page: .
116. M. Miller, C. Moulding, J. Dongarra, C. Johnson, Grid-enabling problem solving environments: a case study of SCIRun and NetSolve, in: Proceedings of High Performance Computing Symposium 2001 - Grand Challenges in Computer Simulation (HPC 2001), High Performance Simulation Environments, 2001, Seattle, Washington, pp. 98-103.
117. Walker D.W., Li M., Rana O.F., Shields M.S., Huang Y. The software architecture of a distributed problem-solving environment. Concurrency Practice and Experience. 12:2000;1455-1480.
118. Rana O.F., Li M., Walker D.W., Shields M.S. An XML-based component model for generating scientific applications and performing large scale simulations in a metacomputing environment. Czarnecki K., Eisenecker U.W. (Eds.), Generative and Component-Based Software Engineering. Lecture Notes in Computer Science. vol. 1799:2000;210-224 Springer-Verlag.
119. Li M., Rana O.F., Walker D.W. Wrapping MPI-based lagacy codes as Java/CORBA components. Future Generation Computer Systems. 18(2):2001;213-223.
120. C. René, T. Priol, MPI code encapsulation using parallel CORBA object, in: Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing (IEEE), 1999, p. 3-10.
121. B. Norris et al., Parallel components for PDEs and optimization: some issues and experiences, this issue.