Compiling High Performance Fortran for distributed-memory architectures

Parallel Computing

Volumn 25, Issue 13, 1999, Pages 1785-1825

  Benkner, Siegfried ^a,b   Zima, Hans ^b  

^a NEC LABORATORIES EUROPE   (Germany)

^b UNIVERSITY OF VIENNA   (Austria)

Author keywords

[No Author keywords available]

Indexed keywords

CODES (SYMBOLS); COMPUTER ARCHITECTURE; COMPUTER SYSTEMS PROGRAMMING; DATA ACQUISITION; DATA REDUCTION; DATA STORAGE EQUIPMENT; FORTRAN (PROGRAMMING LANGUAGE); PROGRAM COMPILERS; RESPONSE TIME (COMPUTER SYSTEMS);

CODE GENERATION;

PARALLEL PROCESSING SYSTEMS;

EID: 0033285824     PISSN: 01678191     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8191(99)00074-5     Document Type: Article

References (76)

1. V.S. Adve. High performance fortran compilation techniques for parallelizing scientific codes. in: Proceedings of the 1998 ACM/IEEE SC98 Conference, 1998. Orlando Florida, USA, 7-13 November, 1998, ACM Press, New york and IEEE Computer Society Press, London, 1998.
2. E. Albert, K. Knobe, J.D. Lukas, G.L. Steele Jr., Compiling fortran 8x array features for the connection machine computer system, in: Proceedings of the Symposium on Parallel Programming: Experience with Applications, Languages, and Systems (PPEALS), New Haven, CT, July 1988, pp. 42-56.
3. C. Ancourt, F. Coelho, F. Irigoin, R. Keryell, A linear algebra framework for static HPF code distribution, in: Proceedings of the Fourth Workshop on Compilers for Parallel Computers, December 1993.
4. F. André, J.-L. Pazat, H. Thomas, PANDORE: A system to manage data distribution. in: International Conference on Supercomputing, Amsterdam, The Netherlands, June 1990, pp. 380-388.
5. P. Banerjee, J.A. Chandy, M. Gupta, J.G. Holm, A. Lain, D.J. Palermo, S. Ramaswamy, E. Su, The PARADIGM compiler for distributed-memory message-passing multicomputers, in: Proceedings of the First International Workshop on Parallel Processing, Bangalore, India, December, 1994.
6. S. Benkner, Handling block-cyclic distributed arrays in Vienna Fortran 90, in: Proceedings of the IFIP WG 10.3 Working Conference on Parallel Architectures and Compilation Techniques (PACT'95), Limassol, Cyprus, June 1995.
7. S. Benkner, S. Andel, R. Blasko, P. Brezany, A. Celic, B.M. Chapman, M. Egg, T. Fahringer, J. Hulman, Y. Hou, E. Kelc, E. Mehofer, H. Moritsch, M. Paul, K. Sanjari, V. Sipkova, B. Velkov, B. Wender, H.P. Zima, Vienna Fortran Compilation System - Version 1.2 - User's Guide, Institute for Software Technology and Parallel Systems, University of Vienna, October 1995.
8. S. Benkner, P. Mehrotra, J. Van Rosendale, H.P. Zima, High-level management of communication schedules in HPF-like languages, in: Proceedings of the International Conference on Supercomputing, Melbourne, Australia, July 1998.
9. S. Benkner, P. Mehrotra, J. Van Rosendale, H.P. Zima, High-level management of communication schedules in HPF-like languages, NASA Contractor Report 201740, ICASE, Hampton, VA, September 1997. Also available as Technical Report, TR 97-5, Institute for Software Technology and Parallel Systems, University of Vienna, April 1997.
10. S. Benkner, Vienna Fortran 90 and its Compilation, Ph.D. thesis, Technical Report TR 94-8, University of Vienna, Institute of Software Technology and Parallel Systems, November 1994.
11. S. Benkner, VFC: The Vienna Fortran Compiler, Scientific Programming, Winter 1998 (to appear).
12. S. Benkner, HPF+: High Performance Fortran for Advanced Scientific and Engineering Applications, Future Generation Computer Systems, Elsevier, Amsterdam, 1999 (to appear).
13. V. Bouchitte, P. Boulet, A. Darte, Y. Robert, Evaluating array expressions on massively parallel machines with communication/computation overlap, in: Proceedings CONPAR 94-VAPP VI, 713-724, 1994.
14. Z. Bozkus, A. Choudhary, G. Fox, T. Haupt, S. Ranka, Fortran 90D/HPF compiler for distributed memory MIMD computers: design, implementation, and performance results, in: Proceedings of the 1993 ACM International Conference on Supercomputing, July 1993.
15. Z. Bozkus, L. Meadows, S. Nakamoto, V. Schuster, M. Young, PGHPF - An optimizing High Performance Fortran compiler for distributed memory machines, in: R. Schreiber, P. Mehrotra (Eds.), Scientific Programming (special issue), High Performance Fortran Comes of Age, Vol.6/1, Spring 1997, pp. 29-40.
16. T. Brandes, F. Zimmermann, Adaptor - A transformation tool for HPF programs, Programming Environments for Massively Parallel Distributed Systems: Working Conference of the IFIP WG10.3, April 25-29, 1994, Ascona, Italy, Birkhäuser Boston, pp. 91-96.
17. T. Brandes, C. Germain, A Tracing Protocol for Optimizing Data Parallel Irregular Computations, Lecture Notes in Computer Science, Vol. 1470, 1998.
18. L.C. Breebaart. E.M. Paalvast, H.J. Sips, The booster approach to annotating parallel algorithms, in: Proceedings of the 1991 International Conference on Parallel Processing, Vol. II, Software, CRC Press, August 1991, pp. II-276-II-277.
19. B. Chapman, M. Haines, P. Mehrotra, J. Van Rosendale, H. Zima, Opus: A coordination language for multidisciplinary applications, Scientific Programming 6/4 345-362, Winter 1997.
20. B. Chapman, P. Mehrotra, H. Zima, Programming in Vienna Fortran, Scientific Programming 1/1, 31-50, Fall 1992.
21. B. Chapman, P. Mehrotra, H. Zima, Extending HPF for advanced data parallel applications, IEEE Parallel and Distributed Technology, Fall 1994, pp. 59-70.
22. B. Chapman, P. Mehrotra, H. Zima, Enhancing OpenMP with Features for Locality Control, Technical Report, Institute for Software Technology and Parallel Systems, University of Vienna, 1999.
23. S. Chatterjee, J.R. Gilbert, F.J.E. Long, R. Schreiber, S.-H. Teng, Generating local addresses and communication sets for data-parallel programs, J. Parallel Distributed Comput. 26 (1995) 72-84.
24. R. Das, J. Saltz, A manual for PARTI runtime primitives - Revision 2, Internal Research Report, University of Maryland, December 1992.
25. R. Das, A. Susman, P. Havlak, J. Saltz, Compiler analysis and optimization of indirect array accesses, in: Proceedings of the Fifth Workshop on Compilers for Parallel Computers, Malaga, Spain, June 1995.
26. R. Das, J. Saltz, R. von Hanxleden, Slicing analysis and indirect access to distributed arrays, in: Proceedings of the Sixth Workshop on Languages and Compilers for Parallel Computing, Springer, Berlin, August 1993, pp. 152-168.
27. G. Fox, S. Hiranandani, K. Kennedy, C. The related Koelbel, U. Kremer, C. Tseng, and M. Wu, Fortran D language specification, Department of Computer Science Rice COMP TR90079, Rice University, March 1991.
28. H.M. Gerndt, Array distribution in SUPERB, in: Proceedings of the Third International Conference on Supercomputing 1989, pp. 164-174.
29. H.M. Gerndt, H.P. Zima, Optimizing Communication in SUPERB, Proc. Conpar 90-VAPP IV, Lecture Notes in Computer Science, 457, pp. 300-311.
30. S.K.S. Gupta, S.D. Kaushik, C.-H. Huang, P. Sadayappan, Compiling array expressions for efficient execution on distributed-memory machines, J. Parallel Distributed Comput. 32 (2) (1996) 155-172.
31. M. Gupta, S. Midkiff, E. Schonberg, V. Seshadri, D. Shields, K.-Y. Wang, W.-M. Ching, T. Ngo, An HPF compiler for the IBM SP2, in: Proceedings of the Fifth Workshop on Compilers for Parallel Computers, 22-38 June 1995.
32. M. Gupta, E. Schonberg, H. Srinivasan, A unified framework for optimizing communication in data-parallel programs, IEEE Trans. Parallel Distributed Sys. 7 (7) (1996) 689-704.
33. M.W. Hall, S. Hirandani, K. Kennedy, C.-W. Tseng, Inter-procedural compilation of Fortran D for MIMD distributed-memory machines, in: Proceedings of Supercomputing (SC'92), Minneapolis, November, 1992.
34. R. von Hanxleden, K. Kennedy, C. Koelbel, R. Das, J. Saltz, Compiler analysis for Irregular Problems in fortran D, in: Proceedings of the Fifth Workshop on Languages and Compilers for Parallel Computing, New Haven, CT, August 1992.
35. R. von Hanxleden, K. Kennedy, Give-N-Take: A balanced code placement framework, in: ACM SIGPLAN '94 Program Language Design and Implementation, June 1994.
36. P. Hatcher, A. Lapadula, R. Jones, M. Quinn, J. Anderson, A production quality C* compiler for hypercube machines, in: ACM SIGPLAN Symposium on Principles Practice of Parallel Programming, April 1991, pp. 73-82.
37. High Performance Fortran Forum, High Performance Fortran Language Specification Version 1.0., Technical Report, Rice University, Houston, TX, 3 May, 1993.
38. High Performance Fortran Forum, High Performance FORTRAN Language Specification, Version 2.0, Technical Report, Rice University, Houston, TX, January 1997.
39. S. Hiranandani, K. Kennedy, C. Tseng, Compiling fortran D for MIMD distributed-memory machines, Communications of the ACM 35 (8) (1992) 66-80.
40. K. Ikudome, G. Fox, A. Kolawa, J. Flower, An automatic and symbolic parallelization system for distributed memory parallel computers, in: Proceedings of The Fifth Distributed-Memory Computing Conference, Charleston, SC, April 1990, pp. 1105-1114.
41. Japan Association of High Performance Fortran, http://www.tokyo.rist.or.jp shunchan/index-e.html.
42. T. Kamachi, A. Müller, R. Rühl, Y. Seo, K. Suehiro, M. Tamura, Kemari: A portable High Performance Fortran system for distributed-memory parallel processors, in: R. Schreiber, P. Mehrotra (Eds.), Scientific Programming (special issue), High Performance Fortran Comes of Age, Vol. 6/1, Spring 1997, pp. 41-58.
43. S.D. Kaushik, C.-H. Huang, P. Sadayappan, Efficient index set generation for compiling HPF array statements on distributed-memory machines, J. Parallel Distributed Comput. 38 (2) (1996) 237-247.
44. K. Kennedy, U. Kremer, Automatic data layout for distributed-memory machines, ACM Trans. Programming Languages Syst. 20 (4) (1998) 869-916.
45. K. Kennedy, N. Nedeljkovic, A. Sethi, A linear-time algorithm for computing the memory access sequence in data-parallel programs, in: Fifth ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP), Santa Barbara, CA, 19-21 July, 1995, ACM SIGPLAN Notices, Vol. 30(8), No. 8, ACM, New York, 1995, pp. 102-111.
46. J. Knoop, E. Mehofer, Inter-procedural distribution assignment placement: more than just enhancing intra-procedural placing techniques, in: Proceedings of the 1997 International Conference on Parallel Architectures and Compilation Techniques, 26-37, IEEE Computer Society Press, London, November 10-14, 1997.
47. C. Koelbel, Compiling Programs for Nonshared Memory Machines, Ph.D. Dissertation, Purdue University, West Lafayette, IN, November 1990.
48. C. Koelbel, P. Mehrotra, Compiling global name-space parallel loops for distributed execution, IEEE Trans. Parallel Distributed Sys. 2 (4) (1991) 440-451.
49. C. Koelbel, P. Mehrotra, J. Saltz, H. Berryman, Parallel loops on distributed machines, in: Proceedings of the Fifth Distributed Memory Computing Conference, Charleston, SC, April 1990, pp. 1097-1104.
50. A. Lain, P. Banerjee, Exploiting spatial regularity in irregular iterative applications, in: Proceedings of the Ninth International Parallel Processing Symposium, Santa Barbara, CA, April 1995.
51. J. Li, M. Chen, Generating explicit communication from shared-memory program references, in: Proceedings of Supercomputing'90, New York, November 1990, pp. 865-876.
52. W. Li, K. Pingali, Access normalization: Loop restructuring for numa computers, ACM Trans. Comput. Sys. 11 (4) (1993) 353-375.
53. P. Mehrotra, J. Van Rosendale, Compiling high-level constructs to distributed memory architectures, in: Proceedings of the Fourth Conference on Hypercube Concurrent Computers and Applications, March 1989.
54. P. Mehrotra, J. VanRosendale, Programming distributed memory architectures using Kali. in: A. Nicolau, D. Gelernter, T. Gross, D. Padua (Eds.), Advances in Languages and Compilers for Parallel Processing, Pitman/MIT-Press, London, 1991, pp. 364-384.
55. P. Mehrotra, J. Van Rosendale, H. Zima, High Performance Fortran: History, Status and Future, in: E. Zapata, D. Padua (Eds.), Parallel Computing (special issue) on Languages and Compilers for Parallel Computers, Vol. 24, No. 3-4, 1998, pp.325-354.
56. P. Mehrotra, J. Van Rosendale, H. Zima, Language support for multidisciplinary applications, IEEE Comput. Sci. Engrg. 5 (2) (1998) 64-75.
57. J.H. Merlin, Adapting fortran 90 array programs for distributed memory architectures, in: H.P. Zima, (Ed.), Proceedings of the First International ACPC Conference, Salzburg, Austria, Lecture Notes in Computer Science, vol. 591, Springer, Berlin, 1991, pp. 184-200.
58. MIMDizer User's Guide, Version 7.02, Placerville, CA, 1991.
59. OpenMP Consortium, OpenMP Fortran Application Program Interface, Version 1.0, October 1997.
60. D. Pase, MPP Fortran programming model, in: High Performance Fortran Forum, January 1992.
61. R. Ponnusamy, J. Saltz, A. Choudhary, Runtime Compilation Techniques for Data Partitioning and Communication Schedule Reuse, Technical Report, UMIACS-TR-93-32, University of Maryland, April 1993.
62. K. Roe, P. Mehrotra, Evaluation of High Performance Fortran for CAS applications, in: Proceedings for the Workshop on CAS Applications, NASA Ames Research Center, August 1996, pp. 133-138.
63. A. Rogers, K. Pingali, Process decomposition through locality of reference, in: Conference on Programming Language Design and Implementation, Portland, OR, June 1989, pp. 69-80.
64. M. Rosing, R.W. Schnabel, R.P. Weaver, Expressing complex parallel algorithms in DINO, in: Proceedings of the Fourth Conference on Hypercubes, Concurrent Computers, and Applications, 1989, pp. 553-560.
65. R. Rühl, M. Annaratone, Parallelization of fortran code on distributed-memory parallel processors, in: Proceedings of the International Conference on Supercomputing, ACM, New York, June 1990.
66. J. Saltz, K. Crowley, R. Mirchandaney, H. Berryman, Run-time scheduling and execution of loops on message passing machines, J. Parallel Distributed Comput. 8 (2) (1990) 303-312.
67. J. Saltz, R. Das, B. Moon, S. Sharma, Y-S. Hwang, R. Ponnusamy, M. Uysal, A Manual for the CHAOS Runtime Library, Technical Report, University of Maryland, College Park, MD 20742, May 1994.
68. H. Sips, W. Denissen, K. van Reeuwijk, Analysis of local enumeration and storage schemes in HPF, Parallel Computing 24 (3/4) (1998) 355-382.
69. J.M. Stichnoth, D. O'Hallaron, T. Gross, Generating communication for array statements: Design implementation, and evaluation, J. Parallel Distributed Comput. 21 (1) (1994) 150-159.
70. A. Thirumalai, J. Ramanujam, Fast address sequence generation for data parallel programs using integer lattices, Advances in Languages and Compilers for Parallel Computing, Lecture Notes in Computer Science, Springer, Berlin, 1996.
71. M. Ujaldon, E.L. Zapata, B. Chapman, H. Zima, Vienna fortran/HPF extensions for sparse and irregular problems and their compilation, IEEE Trans. Parallel Distributed Sys. 8 (11) November 1997.
72. A. Venkatachar, J. Ramanujam, A. Thirumalai, Communication generation for block-cyclic distributions, Parallel Processing Lett. 7 (2) (1997) 195-202.
73. H. Zima, H. Bast, M. Gerndt, Superb: A tool for semi-automatic MIMD/SIMD parallelization, Parallel Computing 6 (1988) 1-18.
74. H. Zima, P. Brezany, B. Chapman, P. Mehrotra, A. Schwald, Vienna Fortran - A Language Specification, Internal Report 21, ICASE, Hampton, VA, March 1992.
75. H. Zima, B. Chapman, Supercompilers for Parallel and Vector Computers, ACM Press Frontier Series, Addison-Wesley, New York, 1990.
76. H. Zima, B. Chapman, Compiling for distributed memory systems, in: Proceedings of the IEEE, Special Section on Languages and Compilers for Parallel Machines, February 1993, pp. 264-287.