Array Operation Synthesis to Optimize HPF Programs on Distributed Memory Machines

Journal of Parallel and Distributed Computing

Volumn 61, Issue 4, 2001, Pages 467-500

  Hwang, Gwan Hwan ^a   Lee, Jenq Kuen ^b   Ju, Roy Dz Ching ^c  

^a NATIONAL CHI NAN UNIVERSITY   (Taiwan)

^b NATIONAL TSING HUA UNIVERSITY   (Taiwan)

^c INTEL CORPORATION   (United States)

Author keywords

HPF compiler; array operation synthesis; distributed memory machines; compiler optimization; parallelizing compiler

Indexed keywords

EID: 0038194616     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1006/jpdc.2000.1680     Document Type: Article

References (34)

1. Adams J. C., Brainerd W. S., Martin J. T., Smith B. T., Wagener J. L. Fortran 90 Handbook Complete ANSI/ISO Reference. 1992;McGraw-Hill, New York.
2. J. M. Anderson and M. S. Lam, Global optimizations for parallelism and locality on scalable parallel machines, in Proc. of the ACM SIGPLAN Conference on Programming Language Design and Implementation, 1993, pp. 112-125.
3. V. Balasundaram and K. Kennedy, A technique for summarizing data access and its use in parallelism enhancing transformations, in Proc. of ACM SIGPLAN Conference on Programming Language Design and Implementation, 1989, pp. 41-53.
4. Bixby R., Kennedy K., Kremer U. Automatic data layour using 0-1 intefer programming. Proc. of the International Conference on Parallel Architectures and Compilation Techniques. August 1994;Montreal, Canada.
5. Budd T. A. An APL compiler for a vector processor. ACM Trans. Programm. Lang. Syst. 6:July 1984;297-313.
6. S. Chatterjee, G. E. Blelloch, and A. L. Fisher, Size and access inference for data-parallel programs, in Proc. of ACM SIGPLAN Conference on Programming Language Design and Implementation, 1991, pp. 130-144.
7. Chatterjee S. Compiling nested data-parallel programs for shared-memory multiprocessors. ACM Trans. Programm. Lang. Syst. 15:July 1993;400-462.
8. S. Chatterjee, J. R. Gilbert, R. Schreiber, and S. H. Teng, Automatic array alignment in data-parallel programs, in Proc. of the Twentieth Annual SIGPLAN-SIGACT Symposium on Principles of Programming Languages, 1993, pp. 16-28.
9. Koelbel C., Loveman D., Schreiber R., Steele G., Zosel M. The High Performance Fortran Handbook. 1994;MIT Press, Cambridge.
10. C. Koelbel, Compile-time generation of regular communications patterns, in Proc. of Supercomputing, 1991, pp. 101-110.
11. Gilbert J. R., Schreiber R. Optimal expression evaluation for data parallel architectures. J. Parallel Distrib. Comput. 13:Sept. 1991;58-64.
12. L. J. Guibas and D. K. Wyatt, Compilation and delayed evaluation in APL, in Proc. of the Fifth Annual ACM Symp. on Principles of Programming Languages, 1978, pp. 1-8.
13. D. Gannon, J. K. Lee, B. Shei, S. Sarukkai, S. Narayan, N. Sundaresan, D. Atapatta, and, F. Bodin, SIGMA II: A tool kit for building parallelizing compilers and performance analysis systems, in, Proc. of Programming Environments for Parallel Computing Conference, Edinburgh, 1992.
14. Gupta M., Banerjee P. Demonstration of automatic data partitioning techniques for parallelizing compilers on multicomputers. IEEE Trans. Parallel Distributed Syst. 3:Mar. 1992;179-193.
15. G. H. Hwang, J. K. Lee, and R. D.-C. Ju, An array operation synthesis scheme to optimize Fortran 90 programs, in Proc. of ACM SIGPLAN Conference on Principles and Practice of Parallel Programming, 1995, pp. 112-122.
16. Hwang G. H., Lee J. K., Ju R. D.-C. A function-composition approach to synthesize Fortran 90 array operations. J. Parallel Distrib. Comput. 54:1998;1-47.
17. G. H. Hwang, J. K. Lee, and R. D.-C. Ju, Array operation synthesis to optimize HPF programs, in Proc. of International Conference on Parallel Processing, Vol. 3, 1996, pp. 1-8.
18. G. H. Hwang, J. K. Lee, and, R. D.-C. Ju, Integrating automatic data alignment and array operation synthesis to optimize data parallel programs, in, The 10 th International Workshop on Languages and Compilers for Parallel Computing, 1997.
19. G. H. Hwang, and, J. K. Lee, An expression-rewriting framework to generate communication sets for HPF programs with block-cyclic distribution, in, International Parallel Processing Symposium, 1998.
20. R. D.-C. Ju, C. L. Wu, and P. Carini, The synthesis of array functions and its use in parallel computation, in Proc. of International Conference on Parallel Processing, 1992, pp. 293-296.
21. Ju R. D.-C. The Optimization and Parallelization of Array Language Programs. Aug. 1992;University of Texas at Austin.
22. Knob K., Lukas J. D., Steele G. L. Data optimization: Allocation of arrays to reduce communication on SIMD Machines. J. Parallel Distrib. Comput. 2:Feb 1990;102-118.
23. J. K. Lee, and, D. Gannon, Object-oriented parallel programming: experiments and results, in, Proc. of Supercomputing '91, New Mexico, November, 1991.
24. E. C. Lewis, C. Lin, and, L. Snyder, The implementation and evaluation of fusion and contraction in array languages, in, Proc. of ACM SIGPLAN'98 Conference on Programming Language Design and Implementation, June 1998.
25. Li J., Chen M. The data alignment phase in compiling programs for distributed-memory machines. J. Parallel Distrib. Comput. 13:1991;213-221.
26. Li J., Chen M. Compiling communication-efficient programs for massively parallel machines. IEEE Tran. Parallel Distrib. Syst. 2:July 1991.
27. A. Mohamer, G. Fox, G. Laszewski, M. Parashar, T. Haupt, K. Mills, Y. Lu, N. Lin, and, N. Yeh, Applications Benchmark Set for Fortran-D and High Performance Fortran, Technical Report, SCCS327, NPAC, Syracuse University.
28. Press W. H., Teukolsky S. A., Vetterling W. T., Flannery B. P. Numerical Recipes in Fortran90: The Art of Parallel Scientific Computer. Fortran Numerical Recipes. 2:1996;Cambridge Univ. Press, Cambridge.
29. Rice J. R., Jing J. Purdue University Tech. Rep. 1990.
30. G. Roth, and, K. Kennedy, Loop fusions in high performance Fortran, in, Proc of the 12th ACM International Conference on Supercomputing, Melbourne, July 13-17, 1998.
31. T. J. Sheffler, R. Schreiber, J. R. Gilbert, and S. Chatterjee, Aligning parallel arrays to reduce communication, in Proc of Frontiers '95, McLean, VA, February 1995, pp. 324-331.
32. Zima H., Chapman B. Compiling for distributed-memory systems. Proc. IEEE. 81:Feb. 1993;264-287.
33. Waters R. C. Automatic transformation of series expressions into loops. ACM Trans. Programm. Lang. Syst. 13:Jan. 1991;52-98.
34. Wu J. J. Optimization and Transformation Techniques for High Performance Fortran. 1995;Yale University.