Prospects for simulated annealing algorithms in automatic differentiation

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Volumn 2264, Issue , 2001, Pages 131-141

  Naumann, Uwe ^a   Gottschling, Peter ^a  

^a UNIVERSITY OF HERTFORDSHIRE   (United Kingdom)

Author keywords

Accumulation of Jacobian matrices; Inhomogeneous Markov chains; Logarithmic cooling schedule; Simulated annealing; Vertex elimination

Indexed keywords

COMBINATORIAL OPTIMIZATION; JACOBIAN MATRICES; MARKOV PROCESSES; STOCHASTIC SYSTEMS;

ARITHMETIC OPERATIONS; AUTOMATIC DIFFERENTIATIONS; COMBINATORIAL OPTIMIZATION PROBLEMS; COMPUTATIONAL GRAPH; COOLING SCHEDULE; SIMULATED ANNEALING ALGORITHMS; VECTOR FUNCTIONS; VERTEX ELIMINATION;

SIMULATED ANNEALING;

EID: 84937427209     PISSN: 03029743     EISSN: 16113349     Source Type: Book Series    
DOI: 10.1007/3-540-45322-9_9     Document Type: Conference Paper

References (29)

1. B. Averik and R. Carter and J. More, The Minpack-2 Test Problem Collection (Preliminary Version), Mathematical and Computer Science Division, Argonne National Laboratory, Technical Report 150, 1991.
2. A. Aho, R. Sethi, and J. Ullman, Compilers. Principles, Techniques, and Tools, Addison Wesley, 1986.
3. M. Berz, C. Bischof, G. Corliss, and A. Griewank, eds., Computational Differentiation: Techniques, Applications, and Tools, SIAM, 1996.
4. C. Bischof and A. Carle and P. Khademi and A. Maurer, The ADIFOR 2.0System for Automatic Differentiation of Fortran 77 Programs, IEEE Comp. Sci. & Eng., 3, 3, 1996, 18–32.
5. C. Bischof and M. Haghighat, Hierarchical Approaches to Automatic Differentiation, in [3], 83–94.
6. G. Corliss and C. Faure and A. Griewank and L. Hascoet and U. Naumann, eds., Automatic Differentiation - From Simulation to Optimization, LNCS, Springer, 2001, to appear.
7. G. Corliss and A. Griewank, eds., Automatic Differentiation: Theory, Implementation, and Application, SIAM, 1991.
8. A. Curtis, M. Powell and J. Reid, On the Estimation of Sparse Jacobian Matrices, J. Inst. Math. Appl., 13, 1974, 117–94.
9. M. Garey and D. Johnson, Computers and Intractability - A Guide to the Theory of NP-completeness, W. H. Freeman and Company, 1979.
10. A. Griewank, Evaluating Derivatives, Principles and Techniques of Algorithmic Differentiation, Frontiers in Appl. Math., 19, SIAM, 2000.
11. A. Griewank and S. Reese, On the Calculation of Jacobian Matrices by the Markowitz Rule, in [7], 126-135.
12. B. Hajek, Cooling Schedules for Optimal Annealing, Mathem. Oper. Res., 13, 1998, 311-329.
13. K. Herley, Presentation at: Theory Institute on Combinatorial Challenges in Computational Differentiation, MCSD, Argonne National Laboratory, 1993.
14. R. Jessani and M. Putrino, Comparison of Single- and Dual-Pass Multiply-Add Fused Floating-Point Units, IEEE Transactions on Computers, 47, 9, 1998.
15. S. Lin, Bell System Technical Journal, 44, 1965, 2245-2269.
16. W. Miller and C. Wrathall, Software for RoundoffAnalysis of Matrix Algorithms, Academic Press, 1980.
17. N. Metropolis and A.W. Rosenbluth and M.N. Rosenbluth and A.H. Teller and E. Teller, Equation of State Calculations by Fast Computing Machines, J. Chem. Phys., 21, 1953, 1087-92.
18. U. Naumann and B. Christianson, Differentiation Enabled Compiler Technology, MOD/DERA/EPSRC grant, GR/R55252.
19. U. Naumann, Efficient Calculation of Jacobian Matrices by Optimized Application of the Chain Rule to Computational Graphs Ph.D. thesis, Technical University Dresden, 1999.
20. U. Naumann, Optimized Jacobian Accumulation Techniques, in N. Mastorakis, Ed., Problems in Modern Applied Mathematics, WSES Press, 2000.
21. U. Naumann, An Enhanced Markowitz Rule for Accumulating Jacobians Efficiently, Proceedings of Algorithmy 2000, Slovak University of Technology, 2000.
22. U. Naumann, Elimination Techniques for Cheap Jacobians, in [6].
23. U. Naumann, Cheaper Jacobians by Simulated Annealing, to appear in SIAM J. Opt.
24. U. Naumann, Elimination Methods for Computational Graphs. On the Optimal Accumulation of Jacobian Matrices - Conceptual Framework., submitted to Math. Prog.
25. G. Newsam and J. Ramsdell, Estimation of Sparse Jacobian Matrices, SIAM J. Alg. Dis. Meth., 4, 1983, 404–417.
26. U. Naumann, S. A. Forth, M. Tadjouddine, and J. D. Pryce, A Standard Interface for Elimination Sequences in Automatic Differentiation, AMOR Report 2001/03, Cranfield Univ. (RMCS Shrivenham), 2001.
27. D. J. Rose and R. E. Tarjan, Algorithmic Aspects of Vertex Elimination on Directed Graphs, SIAM J. Appl. Math., 34, 1, 1978, 176-197.
28. M. Tadjouddine, S. A. Forth, and J. D. Pryce, AD Tools and Prospects for Optimal AD in CFD Flux Jacobian Calculations, in [6].
29. P. Van Laarhoven and E. Aarts, Simulated Annealing: Theory and Applications, Reidel, 1988.