Algorithmic differentiation in Python with AlgoPy

Journal of Computational Science

Volumn 4, Issue 5, 2013, Pages 334-344

  Walter, Sebastian F ^a   Lehmann, Lutz ^a  

^a HUMBOLDT UNIVERSITY   (Germany)

Author keywords

Automatic differentiation; Cholesky decomposition; Hierarchical approach; Higher order derivatives; Numerical linear algebra; NumPy; Taylor arithmetic

Indexed keywords

AUTOMATIC DIFFERENTIATIONS; CHOLESKY DECOMPOSITION; HIERARCHICAL APPROACH; HIGHER-ORDER; NUMERICAL LINEAR ALGEBRA; NUMPY;

DIFFERENTIATION (CALCULUS); EIGENVALUES AND EIGENFUNCTIONS; HIGH LEVEL LANGUAGES; INVERSE PROBLEMS;

COMPUTER SOFTWARE;

EID: 84883405885     PISSN: 18777503     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jocs.2011.10.007     Document Type: Article

References (37)

1. F. Romstedt, Python module: upy. (2010). http://github.com/friedrichromstedt/upy.
2. Anderson E., Bai Z., Bischof C., Blackford S., Demmel J., Dongarra J., Du Croz J., Greenbaum A., Hammarling S., McKenney A., Sorensen D. LAPACK Users' Guide 1999, Society for Industrial and Applied Mathematics, Philadelphia, PA. 3rd ed.
3. Bartholomew-Biggs M., Brown S., Christianson B., Dixon L. Automatic differentiation of algorithms. J. Comput. Appl. Math. 2000, 124(1-2):171-190.
4. B.M. Bell, S.F. Walter, PyCppAD, Python bindings to CppAD. https://github.com/b45ch1/pycppad, 2009.
5. Bergstra J., Breuleux O., Bastien F., Lamblin P., Pascanu R., Desjardins G., Turian J., Bengio Y. Theano: a CPU and GPU math expression compiler. Proceedings of the Python for Scientific Computing Conference (SciPy) June 2010, Oral.
6. Bischof C.H., Haghighat M.R. Hierarchical approaches to automatic differentiation. Computational Differentiation: Techniques, Applications, and Tools 1996, 83-94. SIAM, Philadelphia, PA. M. Berz, C. Bischof, G. Corliss, A. Griewank (Eds.).
7. P.A. Brodtkorb, Numdifftools., 2009. http://code.google.com/p/numdifftools/.
8. Christianson B. Reverse accumulation of functions containing gradients. Tech. Report 278, Numerical Optimisation Centre, School of Information Sciences 1993, University of Hertfordshire, Hatfield, UK.
9. Christianson D.B., Davies A.J., Dixon L.C.W., Roy R., Van der Zee P. Giving reverse differentiation a helping hand. Optim. Methods Softw. 1997, 8:53-67.
10. Gay D.M. Automatic differentiation of nonlinear AMPL models. Automatic Differentiation of Algorithms: Theory, Implementation, and Application 1991, 61-73. SIAM, Philadelphia, PA. A. Griewank, G.F. Corliss (Eds.).
11. M.B. Giles, An extended collection of matrix derivative results for forward and reverse mode automatic differentiation, Technical report, Oxford University Computing Laboratory, 2007. Report no 08/01.
12. Giles M.B. Collected matrix derivative results for forward and reverse mode algorithmic differentiation. Advances in Automatic Differentiation 2008, 35-44. Springer. C.H. Bischof, H.M. Bücker, P.D. Hovland, U. Naumann, J. Utke (Eds.).
13. Golub G.H., Van Loan C.F. Matrix Computations 1996, Johns Hopkins University Press, Baltimore, MD, USA. 3rd ed.
14. Griewank Andreas A mathematical view of automatic differentiation. Acta Numer. 2003, 12:321-398.
15. Griewank A., Juedes D., Utke Jean Algorithm 755: ADOL-C: a package for the automatic differentiation of algorithms written in C/C++. ACM Trans. Math. Softw. 1996, 22(2):131-167.
16. Griewank A., Walther A. Evaluating Derivatives: Principles and Techniques of Algorithmic Differentiation. Number 105 in Other Titles in Applied Mathematics 2008, SIAM, Philadelphia, PA. 2nd ed.
17. Healy M.J.R. Matrices for Statistics 2000, Clarendon Press, Oxford. 2nd ed.
18. K. Hinsen, ScientificPython. http://dirac.cnrs-orleans.fr/plone/software/scientificpython/.
19. Hunter J.D. Matplotlib: A 2d graphics environment. Comput. Sci. Eng. May-Jun 2007, 9(3):90-95.
20. E. Jones, T. Oliphant, P. Peterson, et al. SciPy: Open source scientific tools for Python., 2001. http://www.scipy.org.
21. D.L. Kroshko. Funcdesigner., 2010. http://openopt.org/FuncDesigner.
22. E.O. Lebigot. Uncertainties., 2010. http://pypi.python.org/pypi/uncertainties.
23. Magnus J.R., Neudecker H. Matrix Differential Calculus with Applications in Statistics and Econometrics 1999, John Wiley & Sons. 2nd ed.
24. Neidinger R.D. Directions for computing truncated multivariate Taylor series. Math. Comput. 2005, 74(249):321-340.
25. Neidinger R.D. Introduction to automatic differentiation and MATLAB object-oriented programming. SIAM Rev. 2010, 52(3):545-563.
26. Travis E., Oliphant Guide to NumPy 2006, Trelgol Publishing, USA.
27. E.T. Phipps, Taylor Series Integration of Differential-Algebraic Equations: Automatic Differentation as a Tool For Simulationg Rigid Body Mechanical Systems. PhD thesis, Cornell University, February 2003.
28. Ramachandran P., Varoquaux G. Mayavi: 3D Visualization of Scientific Data. Comput. Sci. Eng. 2011, 13(2):40-51.
29. Matrix Analysis for Statistics 1997, Wiley, New York. J.R. Schott (Ed.).
30. Seber G.A.F. A Matrix Handbook for Statisticians 2007, Wiley-Interscience, New York, NY, USA.
31. B. Speelpenning, Compiling fast partial derivatives of functions given by algorithms. PhD thesis, Champaign, IL, USA, 1980. AAI8017989.
32. SymPy Development Team. Sympy: Python library for symbolic mathematics., 2009. http://www.sympy.org.
33. Proceedings of the 8th Python in Science Conference 2009, 8. G. Varoquaux, S. van der Walt, K. Jarrod Millman (Eds.).
34. Proceedings of the 7th Python in Science Conference 8 2008, G. Varoquaux, T. Vaught, J. Millman (Eds.).
35. Vetter William J. Matrix calculus operations and Taylor expansions. SIAM Rev. 1973, 15(2):352-369.
36. S.F. Walter, ALGOPY: algorithmic differentiation in Python,, 2009. http://pypi.python.org/pypi/algopy.
37. S.F. Walter, Pyadolc, Python bindings to ADOL-C,, 2009. https://github.com/b45ch1/pyadolc.