A Matrix-Based Approach to Global Locality Optimization

Journal of Parallel and Distributed Computing

Volumn 58, Issue 2, 1999, Pages 190-235

  Kandemir, Mahmut ^a   Choudhary, Alok ^b   Ramanujam, J ^c   Banerjee, Prith ^b  

^a Syracuse University   (United States)

^b Northwestern University   (United States)

^c LOUISIANA STATE UNIVERSITY   (United States)

Author keywords

Array restructuring; Data reuse; Data transformations; Locality; Loop tranformations; Memory hierarchy; Parallelism

Indexed keywords

EID: 0008323676     PISSN: 07437315     EISSN: None     Source Type: Journal    
DOI: 10.1006/jpdc.1999.1552     Document Type: Article

References (59)

1. A. Abu-Sufah, D. Kuck, and D. Lawrie, On the performance enhancement of paging systems through program analysis and transformations, IEEE Trans. Comput. C-30 (5) (1981), 341-356.
2. A. V. Aho, R. Sethi, and J. Ullman, "Compilers: Principles, Techniques, and Tools," 2nd ed., Addison-Wesley, Reading, MA, 1986.
3. J. Anderson, "Automatic Computation and Data Decomposition for Multiprocessors," Ph. D. dissertation, Stanford University, March 1997. [Technical ReportCSL-TR-97-179, Computer Systems Laboratory, Stanford University]
4. J. Anderson, S. Amarasinghe, and M. Lam, Data and computation transformations for multiprocessors, in "Proc. 5th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP '95), July 1995."
5. J. Anderson and M. Lam, Global optimizations for parallelism and locality on scalable parallel machines, in "Proc. SIGPLAN Conference on Programming Language Design and Implementation (PLDI '93), pages 112-125, June 1993."
6. D. Bacon, J-H. Chow, D. Ching, R. Ju, K. Muthukumar, and V. Sarkar, a compiler framework for restructuring data declarations to enhance cache and TLB effectiveness, in "Proc. GASCON '94 Conference, Toronto, Canada, November 1994."
7. U. Banerjee, Unimodular transformations of double loops, in "Proc. Advances in Languages and Compilers for Parallel Processing" (A. Nicolau et al., Eds.), MIT Press, Cambridge, MA, 1991.
8. A. Bik and H. Wijshoff, "On a Completion Method for Unimodular Matrices," Technical Report 94-14, Dept. of Computer Science, Leiden University, 1994.
9. W. Blume, R. Doallo, R. Eigenmann, J. Grout, J. Hoeflinger, T. Lawrence, J. Lee, D. Padua, Y. Paek, B. Pottenger, L. Rauchwerger, and P. Tu, Advanced program restructuring for high-performance computers with Polaris, IEEE Comput. (December 1996), 78-82.
10. W. Blume and R. Eigenmann, An overview of symbolic analysis techniques needed for the effective parallelization of the PERFECT benchmarks, in "Proc. 1994 International Conference on Parallel Processing (ICPP '94), pages II.233-II.238, August, 1994."
11. D. Callahan, S. Carr, and K. Kennedy, Improving register allocation for subscripted variables, in "Proc. SIGPLAN Conference on Programming Language Design and Implementation (PLDI '90)," Assoc. Comput. Mach., New York, 1990.
12. S. Carr and K. Kennedy, Improving the ratio of memory operations to floating-point operations in loops, ACM Trans. Program. Lang. Syst. 16 (6) (November 1994), 1769-1810.
13. R. Chandra, D. Chen, R. Cox, D. Maydan, N. Nedeljkovic, and J. M. Anderson, Data-distribution support on distributed-shared memory multiprocessors, in "Proc. Programming Language Design and Implementation (PLDI '97), Las Vegas, NV, 1997."
14. S. Chatterjee, J. Gilbert, R. Schreiber, and S. Teng, Optimal Evaluation of Array Expressions on Massively parallel Machines, ACM Trans. Programming Lang. Systems 17 (1) (January 1995), 123-156.
15. M. Cierniak and W. Li, Unifying data and control transformations for distributed shared memory machines, in "Proc. SIGPLAN '95 Conference on Programming language Design and Implementation (PLDI '95), June 1995."
16. M. Cierniak and W. Li, Recovering logical data and code structures, Technical Report 591. Dept. of Computer Science, University of Rochester, July 1995.
17. S. Coleman and K. McKinley, Tile size selection using cache organization and data layout, in "Proc. SIGPLAN '95 Conference on Programming Language Design and Implementation (PLDI '95), June 1995."
18. M. Dion, C. Randriamaro, and Y. Robert, Compiling affine nested loops: how to optimize the residual communications after the alignment phase, Journal of Parallel and Distributed Computing (JPDC) 38 (2) (1996), 176-187.
19. J. Ferrante, V. Sarkar, and W. Thrash, On estimating and enhancing cache effectiveness, in "Proc. Languages and Compilers for Parallel Computing(LCPC '91), pages 328-343, 1991."
20. D. Gannon, W. Jalby, and K. Gallivan, Strategies for cache and local memory management by global program transformations, Journal of Parallel and Distributed Computing 5 (1988), 587-616.
21. J. Garcia, E. Ayguade, and J. Labarta, A novel approach towards automatic data distribution, in "Proc. Supercomputing '95, San Diego, December 1995."
22. M. Haghighat and C. Polychronopoulos, Symbolic analysis: A basis for parallelization, optimization, and scheduling of programs, in "Proc. 6th Annual Workshop on Languages and Compilers for Parallel Computing (LCPC '93), Portland, OR, 1993."
23. J. Hennessy and D. Patterson, "Computer Architecture: A Quantitiative Approach," 2nd ed., Morgan Kaufmann Publishers, San Mateo, CA, 1995.
24. C.-H. Huang and P. Sadayappan, Communication-free partitioning of nested loops, J. Parallel Distrib. Comput. 19 (1993), 90-102.
25. T. Jeremiassen and S. Eggers, Reducing false sharing on shared memory multiprocessors through compile time data transformations, in "Proc. 5th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming (PPoPP '95), July, 1995."
26. Deleted in proof.
27. M. Kandemir, A. Choudhary, N. Shenoy, P. Banerjee, and J. Ramanujam, A hyperplane based approach for optimizating spatial locality in loop nests, in "Proc. 1998 ACM International Conference on Supercomputing (ICS '98), July 1998."
28. M. Kandemir, A. Choudhary, J. Ramanujam, and P. Banerjee, A matrix-based approach to the global locality optimization problem, in "Proc. international Conference on parallel Architectures and Compilation Techniques (PACT '98), October 14-17, 1998, Paris, France."
29. M. Kandemir, J. Ramanujam, A. Choudhary, and P. Banerjee, An iteration space transformation algorithm based on explicit data layout representation for optimizing locality, in "Proc. Languages & Compilers for Parallel Computing (LCPC '98), Chapel Hill, NC, August 1998."
30. M. Kandemir, J. Ramanujam, and A. Choudhary, A compiler algorithm for optimizing locality in loop nests, in "Proc. 11th ACM International Conference on Supercomputing (ICS '97), pages 269-276. Vienna, Austria, July 1997."
31. M. Kandemir, J. Ramanujam, and A. Choudhary, Compiler algorithms for optimizing locality and parallelism on shared and distributed memory machines, in "Proc. 1997 Int. Conf. Parallel Architectures and Compilation Techniques (PACT '97), pages 236-247, San Francisco, CA, November 1997."
32. W. Kelly, V. Maslov, W. Pugh, E. Rosser, T. Shpeisman, and David Wonnacott, "The Omega Library Interface Guide," Technical Report CS-TR-3445, CS Dept., University of Maryland, College Park, March 1995.
33. K. Kennedy and U. Kremer, Automatic data layout for High Performance Fortan, in "Proc. Supercomputing '95, San Diego, CA, December 1995."
34. I. Kodukula and K. Pingali, Transformations of imperfectly nested loops, in "Proc. Supercomputing, November 1996."
35. I. Kodukula, N. Ahmed, and K. Pingali, Data-centric multi-level blocking, in "Proc. Programming Language Design and Implementation (PLDI '97), June 1997."
36. B. Kolman, "Introductory Linear Algebra with Applications," Prentice-Hall, Englewood Cliffs, NJ, 1997.
37. M. Lam, E. Rothberg, and M. Wolf, The cache performance of blocked algorithms, in "Proc. 4th Int. Conf. Architectural Support for Programming Languages and Operating Systems (ASPLOS '91), April 1991."
38. S-T. Leung and J. Zahorjan, "Optimizing Data Locality by Array Restructuring," Technical Report TR 95-09-01, Dept. Computer Science and Engingeering, University of Washington, Sept. 1995.
39. W. Li, "Compiling for NUMA Parallel Machines," Ph.D. thesis, Cornell University, Ithaca, NY, 1993.
40. J. Li and M. Chen, Compiling communication efficient programs for massively parallel machines, J. Parallel Distrib. Comput. 2 (3) (1991), 361-376.
41. V. Maslov, De-linearization: An effecient way to break multi-loop dependence equations, in "Proc. the SIGPLAN '92 Conference on Programming Language Design and Implementation (PLDI'92), San Francisco, CA, June 1992."
42. A. McKeller and E. Coffman, The organization of matrices and matrix operations in a paged multiprogramming environment, Comm. CACM 12 (3) (1969), 153-165.
43. K. McKinley, S. Carr, and C. W. Tseng, Improving data locality with loop transformations, ACM Trans. Programming Lang. Systems, 1996.
44. M. O'Boyle and P. Knijnenburg, Non-singular data transoformations: Definition, validity, applications, in "Proc. 6th Workshop on Compilers for Parallel Computers (CPC '96), pages 287-297, 1996."
45. M. O'Boyle and P. Knijnenburg, Integrating loop and data transformations for global optimisation, in "Proc. International Conference on Parallel Architectures and Compilation Techniques (PACT '98), October 14-17, 1998, Paris, France."
46. A. Porterfield, "Software Methods for Improvement of Cache Performance on Supercomputer Applications," Ph.D. thesis, Rice University, Houston, May 1989.
47. J. Ramanujam and P. Sadayappan, Compile-time techniques for data distribution in distributed memory machines, IEEE Trans. Parallel Distrib. Systems 2 (4) (Oct. 1991), 472-482.
48. G. Rivera and C.-W. Tseng, Data transformations for eliminating conflict misses, in "Proc. the 1998 ACM SIGPLAN Conference on Programming Language Design and Implementation (PLDI '98), Montreal, Canada, June 1998."
49. V. Sarkar, G. R. Gao, and S. Han, Locality analysis for distributed shared-Memory multiprocessors, in "Proc. 9th Workshop on Languages and Compilers for Parallel Computing (LCPC '96), Santa Clara, CA, August 1996."
50. A. Schrijver, "Theory of Linear and Integer Programming," Wiley, New York, 1986.
51. Deleted in proof.
52. S. Tandri and T. Abdelrahman, Automatic partitioning of data and computations on scalable shared memory multiprocessors, in "Proc. 1997 International Conference on Parallel Processing (ICPP '97), Bloomingdale, IL, pages 64-73, August 1997."
53. C.-W. Tseng, J. Anderson, S. Amarasinghe, and M. Lam, Unified compilation techniques for shared and distributed address space machines, in "Proc. ACM International Conference on Supercomputing (ICS '95), July 1995."
54. J. Torrellas, M. S. Lam, and J. L. Hennessey, False sharing and spatial locality in multiprocessor caches, IEEE Trans. Comput. 43 (6) (June 1994), 651-663.
55. E. Torrie, C-W. Tseng, M. Martonosi, and M. W. Hall, Evaluating the impact of advanced memory systems on compiler-parallelized codes, in "Proc. International Conference on Parallel Architectures and Compilation Techniques (PACT '95), June 1995."
56. M. Wolf and M. Lam, A data locality optimizing algorithm, in "Proc. ACM SIGPLAN 91 Conf. Programming Language Design and Implementation (PLDI '91), pages 30-44, June 1991."
57. M. Wolf, D. Maydan, and D.-K. Chen, Combining loop transformations considering caches and scheduling, in "Proc. MICRO '96, pages 274-286, 1996."
58. M. Wolfe, More iteration space tiling, in "Proc. Supercomputing '89, pages 655-664, November 1989."
59. M. Wolfe, "High Performance Compilers for Parallel Computing," Addison-Wesley, Reading, MA, 1996.