Differentiating functions of the Jacobian with respect to the weights

Advances in Neural Information Processing Systems

Volumn , Issue , 2000, Pages 435-441

  Flake, Gary William ^a   Pearlmutter, Barak A ^b  

^a NEC LABORATORIES AMERICA   (United States)

^b University of New Mexico   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

JACOBIAN MATRICES; RADIAL BASIS FUNCTION NETWORKS;

FEEDFORWARD MODEL; FREE PARAMETERS; GENERAL METHOD; INPUT-OUTPUT MAPPING; JACOBIANS; NON-LINEAR REGRESSION; PARTIAL DERIVATIVES;

ALGORITHMS;

EID: 10044294326     PISSN: 10495258     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (10)

1. H. Drucker and Y. Le Cun. Improving generalization performance using double back-propagation. IEEE Transactions on Neural Networks, 3(6), November 1992.
2. P. Simard, B. Victorri, Y. Le Cun, and J. Denker. Tangent prop-A formalism for specifying selected invariances in an adaptive network. In John E. Moody, Steve J. Hanson, and Richard P. Lippmann, editors, Advances in Neural Information Processing Systems, volume 4, pages 895-903. Morgan Kaufmann Publishers, Inc., 1992.
3. H. White and A. R. Gallant. On learning the derivatives of an unknown mapping with multilayer feedforward networks. In Halbert White, editor, Artificial Neural Networks, chapter 12, pages 206-223. Blackwell, Cambridge, Mass., 1992.
4. H. White, K. Hornik, and M. Stinchcombe. Universal approximation of an unknown mapping and its derivative. In Halbert White, editor, Artificial Neural Networks, chapter 6, pages 55-77. Blackwell, Cambridge, Mass., 1992.
5. J. Principe, A. Rathie, and J. Kuo. Prediction of chaotic time series with neural networks and the issues of dynamic modeling. Bifurcations and Chaos, 2(4), 1992.
6. G. Deco and B. Schürmann. Dynamic modeling of chaotic time series. In Russell Greiner, Thomas Petsche, and Stephen Jose Hanson, editors, Computational Learning Theory and Natural Learning Systems, volume IV of Making Learning Systems Practical, chapter 9, pages 137-153. The MIT Press, Cambridge, Mass., 1997.
7. G. E. Hinton. Learning distributed representations of concepts. In Proc. Eigth Annual Conf. Cognitive Science Society, pages 1-12, Hillsdale, NJ, 1986. Erlbaum.
8. Barak A. Pearlmutter. Fast exact multiplication by the Hessian. Neural Computation, 6(1):147-160,1994.
9. G. W. Flake. Industrial strength modeling tools. Submitted to NIPS 99, 1999.
10. G. W. Flake and B. A. Pearlmutter. Optimizing properties of the Jacobian of nonlinear feedforward systems. In preperation, 1999.