Integrated loop optimizations for data locality enhancement of tensor contraction expressions

Proceedings of the ACM/IEEE 2005 Supercomputing Conference, SC'05

Volumn 2005, Issue , 2005, Pages 13-17

  Sahoo, Swarup Kumar ^a   Krishnamoorthy, Sriram ^a   Panuganti, Rajkiran ^a   Sadayappan, P ^a  

^a Ohio State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMPUTER PERIPHERAL EQUIPMENT; MATHEMATICAL TRANSFORMATIONS; OPTIMIZATION; PROBLEM SOLVING; TENSORS;

DATA LOCALITY ENHANCEMENT; PRUNING STRATEGIES; TENSOR CONTRACTION;

PROGRAM COMPILERS;

EID: 33845445660     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/SC.2005.35     Document Type: Conference Paper

References (38)

1. KNITRO. A non-linear optimization solver. www.ziena.com/documentation. html.
2. N. Ahmed, N. Mateev, and K. Pingali. Synthesizing transformations for locality enhancement of imperfectly nested loops. In Proc. of ACM Intl. Conf. on Supercomputing, 2000.
3. N. Ahmed, N. Mateev, and K. Pingali. Tiling imperfectlynested loops nests. In Proc. of SC 2000, 2000.
4. L. Almagor, K. D. Cooper, A. Grosul, T. J. Harvey, S. W. Reeves, D. Subramanian, L. Torczon, and T. Waterman. Finding effective compilation sequences. In LCTES '04: Proceedings of the 2004 ACM SIGPLAN/SIGBED conference on Languages, compilers, and tools, pages 231-239, 2004.
5. J. M. Anderson, S. P. Amarasinghe, and M. S. Lam. Data and Computation Transformations for Multiprocessors. In Proc. of the Fifth ACM SIGPLAN Symposium on Principles and Practice of Parallel Processing, July 1995.
6. O. Baumgartner, D. Bernholdt, D. Cociorva, R. Harrison, S. Hirata, C. Lam, M. Nooijen, R. Pitzer, J. Ramanujam, and P. Sadayappan. A High-Level Approach to Synthesis of High-Performance Codes for Quantum Chemistry. In Proc. of Supercomputing 2002, November 2002.
7. J. Chame and S. Moon. A tile selection algorithm for data locality and cache interference. In ICS '99, pages 492-499. ACM Press, 1999.
8. D. Cociorva, G. Baumgartner, C. Lam, P. Sadayappan, J. Ramanujam, M. Nooijen, D. Bernholdt, and R. Harrison. Space-Time Trade-Off Optimization for a Class of Electronic Structure Calculations. In Proc. of ACM SIGPLAN PLDI, pages 177-186, 2002.
9. D. Cociorva, X. Gao, S. Krishnan, G. Baumgartner, C. Lam, P. Sadayappan, and J. Ramanujam. Global Communication Optimization for Tensor Contraction Expressions under Memory Constraints. In Proc. of IPDPS, 2003.
10. D. Cociorva, J. Wilkins, G. Baumgartner, P. Sadayappan, J. Ramanujam, M. Nooijen, D. E. Bernholdt, and R. Harrison. Towards Automatic Synthesis of High-Performance Codes for Electronic Structure Calculations: Data Locality Optimization. In Proc. of HiPC, volume 2228, pages 237-248, 2001.
11. S. Coleman and K. S. McKinley. Tile Size Selection Using Cache Organization and Data Layout. In Proc. of PLDI, 1995.
12. T. Crawford and H. S. III. An Introduction to Coupled Cluster Theory for Computational Chemists. In K. Lipkowitz and D. Boyd, editor, Reviews in Computational. Chemistry, volume 14, pages 33-136. John Wiley & Sons, Ltd., 2000.
13. C. Ding and K. Kennedy. Improving effective bandwidth through compiler enhancement of global cache reuse. J. Parallel Distrib. Comput., 64(1):108-134, 2004.
14. G. Gao, R. Olsen, V. Sarkar, and R. Thekkath. Collective Loop Fusion for Array Contraction. In Proc. of LCPC, 1992.
15. S. Ghosh, M. Martonosi, and S. Malik. Precise miss analysis for program transformations with caches of arbitrary associativity. In Proc. of ASPLOS, pages 228-239, 1998.
16. S. Hirata. Tensor Contraction Engine: Abstraction and automated parallel implementation of configuration-interaction, coupled-cluster and many-body perturbation theories. J. Phys. Chem. A, 107:9887-9897, 2003.
17. S. Hirata. Higher-order equation-of-motion coupled-cluster methods. J. Chem. Phys., 121:51, 2004.
18. Intel Math Kernel Library. http://www.intel.com/software/products/mkl/ features.htm.
19. G. Jin, J. Mellor-Crummey, and R. Fowler. Increasing temporal locality with skewing and recursive blocking. In Supercomputing '01, pages 43-43, 2001.
20. K. Kennedy. Fast greedy weighted fusion. In Proc. of ACM Intl. Conf. on Supercomputing, 2000.
21. K. Kennedy, B. Broom, K. D. Cooper, J. Dongarra, R. J. Fowler, D. Gannon, S. L. Johnsson, J. M. Mellor-Crummey, and L. Torczon. Telescoping Languages: A Strategy for Automatic Generation of Scientific Problem-Solving Systems from Annotated Libraries. JPDC, 61(12):1803-1826, 2001.
22. K. Kennedy and K. S. McKinley. Maximizing loop parallelism and improving data locality via loop fusion and distribution. In Proc. of LCPC, pages 301-320, 1993.
23. S. Krishnamoorthy, G. Baumgartner, D. Cociorva, C. Lam, and P. Sadayappan. On Efficient Out-of-core Matrix Transposition. Technical Report OSU-CIRSC-9/03-T52, The Ohio State University, Columbus, OH, September 2003.
24. S. Krishnan, S. Krishnamoorthy, G. Baumgartner, D. Cociorva, C.-C. Lam, P. Sadayappan, J. Ramanujam, D. E. Bernholdt, and V. Choppella. Data Locality Optimization for Synthesis of Efficient Out-of-Core Algorithms. In Proc. of HiPC, 2003.
25. C. Lam. Performance Optimization of a Class of Loops Implementing Multi-Dimensional Integrals. PhD thesis, The Ohio State University, Columbus, OH, August 1999.
26. C. Lam, P. Sadayappan, and R. Wenger. On Optimizing a Class of Multi-Dimensional Loops with Reductions for Parallel Execution. Parallel Processing Letters, 7(2):157-168, 1997.
27. C. Lam, P. Sadayappan, and R. Wenger. Optimization of a Class of Multi-Dimensional Integrals on Parallel Machines. In Proc. of Eighth SIAM Conf. on Parallel Processing for Scientific Computing, 1997.
28. M. S. Lam, E. E. Rothberg, and M. E. Wolf. The cache performance and optimizations of blocked algorithms. In Proc. of Fourth Intl. Conf. on Architectural. Support for Programming Languages and Operating Systems, 1991.
29. T. J. Lee and G. E. Scuseria. Achieving chemical accuracy with coupled cluster theory. In S. R. Langhoff (Ed.). Quantum Mechanical Electronic Structure Calculations with Chemical Accuracy, pages 47-109, 1997.
30. A. W. Lim, S.-W. Liao, and M. S. Lam. Blocking and array contraction across arbitrarily nested loops using affine partitioning. In Proc. of the Eighth ACM SIGPLAN PPoPP, pages 103-112. ACM Press, 2001.
31. J. M. L. Martin. Benchmark Studies on Small Molecules. In P. v. R. Schleyer, P. R. Schreiner, N. L. Allinger, T. Clark, J. Gasteiger, P. Kollman, and H. F. S. Ill, editors, Encyclopedia of Computational Chemistry, volume 1, pages 115-128. John Wiley & Sons, Ltd., 1998.
32. N. Mitchell, K. Högstedt, L. Carter, and J. Ferrante. Quantifying the multi-level nature of tiling interactions. Intl. Journal of Parallel Programming, 26(6):641-670, June 1998.
33. M. Nooijen and V. L. Lotrich. Towards an internally contracted multireference CC method: Automated implementation of open-shell CCSD method for doublet states. J. Mol. Struct.-THEOCHEM, 547:253-267, 2001.
34. G. Pike and P. N. Hilfinger. Better tiling and array contraction for compiling scientific programs. In SC '02, pages 1-12, 2002.
35. G. Rivera and C.-W. Tseng. Tiling optimizations for 3d scientific computations. In Supercomputing '00, page 32, 2000.
36. S. K. Sahoo, R. Panuganti, S. Krishnamoorthy, and P. Sadayappan. Cache Miss Characterization and Data Locality Optimization for Imperfectly Nested Loops on Shared Memory Multiprocessors. In Proc. of IPDPS., 2005.
37. S. Singhai and K. S. McKinley. Loop Fusion for Data Locality and Parallelism. In Proc. of MASPLAS, 1996.
38. Y. Song and Z. Li. New Tiling Techniques to Improve Cache Temporal Locality. In Proc. of ACM SIGPLAN PLDI, 1999.