A unified framework for optimizing communication in data-parallel programs

IEEE Transactions on Parallel and Distributed Systems

Volumn 7, Issue 7, 1996, Pages 689-704

  Gupta, Manish ^a   Schonberg, Edith ^a   Srinivasan, Harini ^a  

^a IBM T J WATSON RESEARCH CENTER   (United States)

Author keywords

Array section descriptors; Communication optimizations; Data availability; Data flow analysis; Data parallelism; High Performance Fortran; Partial redundancy elimination

Indexed keywords

DATA REDUCTION; DISTRIBUTED COMPUTER SYSTEMS; FORTRAN (PROGRAMMING LANGUAGE); OPTIMIZATION; PROGRAM COMPILERS; SYSTEMS ANALYSIS; VECTORS;

AVAILABLE SECTION DESCRIPTOR; BIDIRECTIONAL PROBLEM; CONTROL FLOW PATH; DATA PARALLEL PROGRAMS; GLOBAL ARRAY DATA FLOW ANALYSIS; PARTIAL REDUNDANCIES; PARTIAL REDUNDANCY ELIMINATION;

PARALLEL PROCESSING SYSTEMS;

EID: 0030190221     PISSN: 10459219     EISSN: None     Source Type: Journal    
DOI: 10.1109/71.508249     Document Type: Article

References (33)

1. A.V. Aho, R. Sethi, and J.D. Ullman, Compilers: Principles, Techniques, and Tools. Addison-Wesley, 1986.
2. F.E. Allen and J. Cocke, "A Program Data How Analysis Procedure," Comm. of the ACM, vol. 19, no. 3, pp. 137-147, Mar. 1976.
3. S.P. Amarasinghe and M.S. Lam, "Communication Optimization, and Code Generation for Distributed Memory Machines," Proc. ACM SIGPLAN '93 Conf. On Programming Language Design and Implementation, Albuquerque, New Mexico, June 1993.
4. V. Balasundaram, "A Mechanism for Keeping Useful Internal Information in Parallel Programming Tools: The Data Access Descriptor," J. Parallel and Distributed Computing, vol. 9, no. 2, pp. 154-170, June 1990.
5. M. Burke, "An Interval-Cased Approach to Exhaustive and Incremental Interprocedural Data-Flow Analysis," ACM Trans. Programming Languages and Systems, vol. 12, no. 3, pp. 341-395, July 1990.
6. D. Callahan and K. Kennedy, "Analysis of Interprocedural Side Effects in a Parallel Programming Environment," Proc First Int'l Conf. Supercomputing, Athens, Greece, 1987.
7. S. Chatterjee, J.R. Gilbert, R. Schreiber, and S.H. Teng, "Optimal Evaluation of Array Expressions on Massively Parallel Machines," Proc. Second Workshop Languages, Compilers, and Runtime Environments for Distributed Memory Multiprocessors, Boulder, CO., Oct. 1992.
8. F.C. Chow, "A Portable Machine-Independent Global Optimizer-Design and Measurements," PhD thesis, Computer Systems Laboratory, Stanford Univ., Dec. 1983.
9. D.M. Dhamdhere, B.K. Rosen, and F.K. Zadeck, "How to Analyze Large Programs Efficiently and Informatively," Proc. ACM SIGPLAN '92 Conf. Programming Language Design and Implementation, San Francisco, Ca., June 1992.
10. High Performance Fortran Forum, High Performance Fortran Language Specification, Version 1.0, Technical Report CRPC-TR92225, Rice Univ., May 1993.
11. C. Gong, R. Gupta, and R. Melhern, "Compilation Techniques for Optimizing Communication in Destributed-Memory Systems," Proc. 1933 Int'l Conf. On Parallel Processing, St. Charles, IL., Aug. 1993.
12. E. Granston and A. Veidenbaum, "Detecting Redundant Acccesses To Array Data," Proc. Supercomputing '91, pp. 854-965, 1991.
13. T. Gross and P. Steenkiste, "Structured Dataflow Analysis for Arrays and Its Use in an Optimizing Complier," Software-Practice and Experience, vol. 20, no. 2, pp. 133-155, Feb. 1990.
14. M. Gupta and P. Banerjee, "A Methodology for High-Level Synthesis of Communication on Multicomputers," Proc. Sixth ACM Int'l Conf. Supercomputing, Washington D.C., July 1992.
15. M. Gupta, S. Midkiff, E. Schonberg, V. Seshadri, K.Y. Wang, D. Sheilds, W.M. Ching, and T. Ngo, "An HPF Compiler for the IBM SP2," Proc. Supercomputing '95, San Diego, CA., Dec. 1992.
16. M. Gupta and E. Schonberg, "A Framework for Exploiting Data Availability to Optimize Communication," Proc. Sixth Workshop on Languages and Compilers for Parallel Computing, Portland, OR., Aug. 1993.
17. P. Havlak and K. Kennedy, "An Implementation of Interprocedural Bounded Regular Section Analysis, IEEE Trans. Parallel and Distributed Systems, vol. 2, no. 3, pp. 350-360, July 1991.
18. S. Hiranandani, K. Kennedy, and C. Tseng, "Compiling Fortran D for MIMD Distributed-Memory Machines," Comm. ACM, vol. 35, no. 8, pp. 66-80, Aug. 1992.
19. J. Knoop, O. Rëthing, and B. Steffen, "Lazy Code Motion," Proc. ACM SIGPLAN '92 Conf. Programming Language Design and Implementation, San Francisco, CA., June 1992.
20. S.M. Joshi and D.M. Dhamdhere, "A Composite Hoisting-Strength Reduction Transformation for Global Program Optimization (parts 1 and 2)," Int'l J. Computer Mathematics, pp. 22-41 and 111-126, 1992.
21. C. Koebel, "Compiling Programs for Nonshared Memory Machines," PhD thesis, Purdue Univ., Aug. 1990.
22. C. Koelbel and P. Mehotra, "Compiling Global Name-Space Parallel Loops for Distributed Execution," IEEE Trans. Parallel and Distributed Systems, vol. 2, no. 4, pp. 440-451, Oct. 1991.
23. J. Li and M. Chen, "Compiling Global Name-Space Parallel Loops for Distributed Execution, IEEE Trans. Parallel and Distributed Systems, vol. 2, no. 3, pp. 361-376, July 1991.
24. E. Morel and C. Renvoise, "Global Optimization by Suppression of Partial Redundancies," Comm. ACM, vol. 22, no. 2, pp. 96-103, Feb. 1979.
25. M.J. Quinn and P.J. Hatcher, Data-Parallel Programming on Multicomputers, IEEE Software, vol. 7, pp. 69-76, Sept. 1990.
26. A. Rogers and K. Pingali, "Process Decomposition Through Locality of Reference," Proc. SIGPLAN '89 Conf. Programming Language Design and Implementation, pp. 69-80, June 1989.
27. C. Rosene, Incremental Dependence Analysis, PhD thesis, Rice Univ., Mar. 1990.
28. E. Su, D.J. Palermo, and P. Banerjee, "Automating Parallelization of Regular Computations for Distributed Memory Multicomputers in the PARADIGM Compiler," Proc. 1993 Int'l Conf. Parallel Processing, St. Charles, IL., Aug. 1993.
29. R.E. Tarjan, "Testing Flow Graph Reducibility," J Computer and System Sciences, vol. 9, no. 3, pp. 355-365, Dec. 1974.
30. R.v. Hanxleden and K. Kennedy, "Give-n-Take - A Balanced Code Placement Framework," Proc. ACM SIGPLAN '94 Conf. Programming Language Design and Implementation, Orlando, FL, June 1994.
31. R.v. Hanxleden, K. Kennedy, C. Koelbel, R. Das, and J. Saltz, "Compiler Analysis for Irregular Problems in Fortran D," Proc. Fifth Workshop on Languages and Compilers for Parallel Computing, New Haven, CT., Aug. 1992.
32. M. Wolfe and U. Banerjee, "Data Dependence and its Application to Parallel Processing," Int'l J. Parallel Programming, vol. 16, no. 2, pp. 137-178, Apr. 1987.
33. H. Zima, H. Bast, and M. Gerndt, "SUPERB: A Tool for Semi-Automatic MIMD/SIMD Parallelization," Parallel Computing, vol. 6, pp. 1-18, 1988.