Optimality-preserving elimination of linearities in Jacobian accumulation

Electronic Transactions on Numerical Analysis

Volumn 21, Issue , 2005, Pages 134-150

  Naumann, Uwe ^a   Utke, Jean ^b  

^a RWTH AACHEN UNIVERSITY   (Germany)

^b ARGONNE NATIONAL LABORATORY   (United States)

Author keywords

Constant folding; Jacobian accumulation; Linearities

Indexed keywords

ALGEBRA; ALGORITHMS; APPROXIMATION THEORY; COMBINATORIAL MATHEMATICS; DIGITAL ARITHMETIC; FORTRAN (PROGRAMMING LANGUAGE); FUNCTIONS; HEURISTIC METHODS; MATHEMATICAL OPERATORS;

CONSTANT FOLDING; JACOBIAN ACCUMULATION; LINEARITIES; OPTIMAL SOLUTION;

HIGH LEVEL LANGUAGES;

EID: 31444448593     PISSN: 10689613     EISSN: 10689613     Source Type: Journal    
DOI: None     Document Type: Article

References (25)

1. A. V. AHO, R. SETHI, AND J. D. ULLMAN, Compilers: Principles, Techniques and Tools, Addison Wesley, 1986.
2. A. ALBRECHT, P. GOTTSCHLING, AND U. NAUMANN, Markowitz-type heuristics for computing Jacobian matrices efficiently, in Computational Science - ICCS 2003, vol. 2658 of Lecture Notes in Computer Science, Springer, 2003, pp. 575-584.
3. B. AVERIK, R. CARTER, AND J. MORÉ, The MINPACK-2 test problem collection (preliminary version), Technical Memorandum ANL/MCS-TM-150, Mathematics and Computer Science Division, Argonne National Laboratory, 1991.
4. M. BERZ, C. BISCHOF, G. CORLISS, AND A. GRIEWANK, eds., Computational Differentiation: Techniques, Applications, and Tools, Proceedings Series, Philadelphia, 1996, SIAM.
5. P. CLARK, N. PISIAS, T. STOCKER, AND A. WEAVER, The role of the thermohaline circulation in abrubt climate change, Nature, 415 (2002), pp. 863-869.
6. G. CORLISS, C. FAURE, A. GRIEWANK, L. HASCOET, AND U. NAUMANN, eds., Automatic Differentiation of Algorithms - From Simulation to Optimization, New York, 2002, Springer.
7. G. CORLISS AND A. GRIEWANK, eds., Automatic Differentiation: Theory, Implementation, and Application, Proceedings Series, Philadelphia, 1991, SIAM.
8. S. FORTH, M. TADJOUDDINE, J. PRYCE, AND J. REID, Jacobian code generated by source transformation and vertex elimination can be as efficient as hand-coding, ACM Trans. Math. Softw., 3 (2004), pp. 266-299.
9. A. GRIEWANK, Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation, no. 19 in Frontiers in Appl. Math., SIAM, Philadelphia, 2000.
10. A. GRIEWANK, A mathematical view of automatic differentiation, Acta Numerica, 12 (2003), pp. 321-398.
11. A. GRIEWANK AND S. REESE, On the calculation of Jacobian matrices by the Markowitz rule, in Automatic Differentiation of Algorithms: Theory, Implementation, and Application, A. Griewank and G. F. Corliss, eds., SIAM, Philadelphia, 1991, pp. 126-135.
12. A. GRIEWANK AND O. VOGEL, Analysis and exploitation of Jacobian scarcity, in Proceedings of HPSC Hanoi, Springer, 2003, to appear.
13. S. MUCHNICK, Advanced Compiler Design and Implementation, Morgan Kaufmann Publishers, San Francisco, 1997.
14. U. NAUMANN, Efficient Calculation of Jacobian Matrices by Optimized Application of the Chain Rule to Computational Graphs, PhD thesis, Technical University of Dresden, December 1999.
15. _, Elimination techniques for cheap Jacobians, in Automatic Differentiation of Algorithms: From Simulation to Optimization, G. Corliss, C. Faure, A. Griewank, L. Hascoët, and U. Naumann, eds., Computer and Information Science, Springer, New York, 2001, ch. 29, pp. 247-253.
16. _, Cheaper Jacobians by Simulated Annealing, SIAM J. Opt., 13 (2002), pp. 660-674.
17. _, Optimal pivoting in tangent-linear and adjoint systems of nonlinear equations, Preprint ANL-MCS/P944-0402, Argonne National Laboratory, 2002.
18. _, Optimal accumulation of Jacobian matrices by elimination methods on the dual computational graph, Math. Prog., 99 (2004), pp. 399-421.
19. U. NAUMANN AND P. GOTTSCHLING, Simulated annealing for optimal pivot selection in Jacobian accumulation, in Stochastic Algorithms, Foundations and Applications - SAGA'03, A. Albrecht, ed., Lecture Notes in Computer Science, Berlin, 2003, Springer, to appear.
20. L. B. RALL, Automatic Differentiation: Techniques and Applications, vol. 120 of Lecture Notes in Computer Science, Springer-Verlag, Berlin, 1981.
21. P. ROE, Approximating Riemann solvers, parameter vectors, and difference schemes, J. Comp. Physics, 43 (1981), pp. 357-372.
22. M. TADJOUDDINE, S. FORTH, AND J. PRYCE, AD tools and prospects for optimal AD in CFD flux calculations, in Automatic Differentiation of Algorithms - From Simulation to Optimization, G. Corliss, C. Faure, A. Griewank, L. Hascoet, and U. Naumann, eds., New York, 2002, Springer, pp. 255-261.
23. M. TADJOUDDINE, S. FORTH, J. PRYCE, AND J. REID, Performance issues for vertex elimination methods in computing Jacobians using automatic differentiation, in Computational Science - ICCS 2002, Proceedings of the International Conference on Computational Science, Amsterdam, The Netherlands, April 21-24, 2002. Part II, P. Sloot, C. Tan, J. Dongarra, and A. Hoekstra, eds., vol. 2330 of Lecture Notes in Computer Science, Berlin, 2002, Springer, pp. 1077-1086.
24. E. TZIPERMAN AND P. IOANNOU, Transient growth and optimal excitation of thermohaline variability, J. Phys. Oceanogr., 32 (2002), pp. 3427-3435.
25. J. UTKE, Flattening basic blocks, in Automatic Differentiation: Applications, Theory, and Tools, H. M. Bücker, G. Corliss, P. Hovland, U. Naumann, and B. Norris, eds., Lecture Notes in Computational Science and Engineering, Springer, 2005.