Global communication optimization for tensor contraction expressions under memory constraints

Proceedings - International Parallel and Distributed Processing Symposium, IPDPS 2003

Volumn , Issue , 2003, Pages 8-

  Cociorva, Daniel ^a   Gao, Xiaoyang ^a   Krishnan, Sandhya ^a   Baumgartner, Gerald ^a   Lam, Chi Chung ^a   Sadayappan, P ^a   Ramanujam, J ^b  

^a OHIO STATE UNIVERSITY   (United States)

^b Louisiana State University   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ELECTRONIC STRUCTURE; QUANTUM CHEMISTRY; TENSORS;

COMMUNICATION MINIMIZATION; EFFICIENT COMPUTATION; GLOBAL COMMUNICATION; INTER PROCESSOR COMMUNICATION; MULTIDIMENSIONAL ARRAYS; OPTIMIZATION APPROACH; TENSOR CONTRACTION; TENSOR CONTRACTION EXPRESSIONS;

PARALLEL PROCESSING SYSTEMS;

EID: 84947277042     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1109/IPDPS.2003.1213121     Document Type: Conference Paper

References (25)

1. D. Callahan, S. Carr, and K. Kennedy. Improving register allocation for subscripted variables. In Proc. SIGPLAN '90 Conference on Programming Language Design and Implementation, White Plains, NY, June 1990.
2. D. Cociorva, J. Wilkins, G. Baumgartner, P. Sadayappan, J. Ramanujam, M. Nooijen, D. Bernholdt, and R. Harrison. Towards Automatic Synthesis of High-Performance Codes for Electronic Structure Calculations: Data Locality Optimization. Proc. of the Intl. Conf. on High Performance Computing, Lecture Notes in Computer Science, Vol. 2228, pp. 237-248, Springer-Verlag, 2001.
3. D. Cociorva, G. Baumgartner, C. Lam, P. Sadayappan, J. Ramanujam, M. Nooijen, D. Bernholdt, and R. Harrison. Space-Time Trade-Off Optimization for a Class of Electronic Structure Calculations. Proc. of ACM SIGPLAN 2002 Conference on Programming Language Design and Implementation (PLDI), June 2002.
4. T. D. Crawford and H. F. Schaefer III. An Introduction to Coupled Cluster Theory for Computational Chemists. In Reviews in Computational Chemistry, vol. 14, pp. 33-136, Wiley-VCH, 2000.
5. A. Darte. On the complexity of loop fusion. In Proc. International Conference on Parallel Architectures and Compilation Techniques (PACT'99), Newport Beach, CA, October 1999.
6. C. Ding. Improving effective bandwidth through compiler enhancement of global and dynamic cache reuse. Ph. D. Thesis, Rice University, January 2000.
7. L. Guibas and D. Wyatt. Compilation and delayed evaluation in APL. In Proc. 5th Annual ACM Symposium on Principles of Programming Languages, Tucson, Arizona, pp. 1-8, Jan. 1978.
8. G. Gao, R. Olsen, V. Sarkar, and R. Thekkath. Collective loop fusion for array contraction. In Languages and Compilers for Parallel Processing, New Haven, CT, August 1992.
9. High Performance Computational Chemistry Group. NWChem, A computational chemistry package for parallel computers, Version 3. 3, 1999. Pacific Northwest National Laboratory, Richland, WA 99352.
10. K. Kennedy and K. McKinley. Maximizing loop parallelism and improving data locality via loop fusion and distribution. In Languages and Compilers for Parallel Computing, Portland, OR, pp. 301-320, August 1993.
11. K. Kennedy. Fast greedy weighted fusion. In Proc. ACM International Conference on Supercomputing, Santa Fe, May 2000. Also available as Technical Report CRPCTR-99789, Center for Research on Parallel Computation (CRPC), Rice University, Houston, TX, 1999.
12. For a brief description, see V. Kumar, A. Grama, A. Gupta, and G. Karypis, Introduction to Parallel Computing, The Benjamin/Cummings Publishing Company, pp. 171, 1994.
13. C. Lam, P. Sadayappan, and R. Wenger. On optimizing a class of multi-dimensional loops with reductions for parallel execution. Parallel Processing Letters, Vol. 7 No. 2, pp. 157-168, 1997.
14. C. Lam, D. Cociorva, G. Baumgartner, and P. Sadayappan. Memory-optimal evaluation of expression trees involving large objects. In Proc. International Conference on High Performance Computing, Calcutta, India, December 1999.
15. C. Lam, D. Cociorva, G. Baumgartner, and P. Sadayappan. Optimization of memory usage requirement for a class of loops implementing multi-dimensional integrals. In Languages and Compilers for Parallel Computing, San Diego, August 1999.
16. C. Lam. Performance optimization of a class of loops implementing multi-dimensional integrals. Ph. D. Dissertation, Ohio State University, Columbus, August 1999. Also available as Technical Report No. OSU-CISRC-8/99-TR22, Dept. of Computer and Information Science, The Ohio State University.
17. T. Lee and G. Scuseria. Achieving chemical accuracy with coupled cluster theory. In S. R. Langhoff (Ed. ), Quantum Mechanical Electronic Structure Calculations with Chemical Accuracy, pages 47-109, 1997.
18. E. Lewis, C. Lin, and L. Snyder. The implementation and evaluation of fusion and contraction in array languages. In Proc. ACM SIGPLAN Conference on Programming Language Design and Implementation, June 1998.
19. N. Manjikian and T. Abdelrahman. Fusion of loops for parallelism and locality. In Proc. International Conference on Parallel Processing, pp. II:19-28, Oconomowoc, WI, August 1995.
20. J. Martin. In Encyclopedia of Computational Chemistry. P. Schleyer, P. Schreiner, N. Allinger, T. Clark, J. Gasteiger, P. Kollman, H. Schaefer III (Eds. ), Wiley & Sons, Berne (Switzerland). Vol. 1, pp. 115-128, 1998.
21. K. McKinley. A compiler optimization algorithm for shared-memory multiprocessors. IEEE Trans. on Parallel and Distributed Systems, 9(8):769-787, Aug 1998.
22. K. McKinley, S. Carr, and C.-W. Tseng. Improving data locality with loop transformations. ACM Trans. on Programming Languages and Systems, 18(4):424-453, July 1996.
23. V. Sarkar and G. Gao. Optimization of array accesses by collective loop transformations. In Proc. ACM International Conference on Supercomputing, pages 194-205, Cologne, Germany, June 1991.
24. S. Singhai and K. McKinley. A parameterized loop fusion algorithm for improving parallelism and cache locality. The Computer Journal, 40(6):340-355, 1997.
25. Y. Song, R. Xu, C. Wang and Z. Li. Data locality enhancement by memory reduction. In Proc. of ACM 15th International Conference on Supercomputing, pages 50-64, June 2001.