Recurrent Neural Network Training with Feedforward Complexity

IEEE Transactions on Neural Networks

Volumn 5, Issue 2, 1994, Pages 185-197

  Olurotimi, Oluseyi ^a  

^a GEORGE MASON UNIVERSITY   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; COMPUTATIONAL COMPLEXITY; COMPUTER SIMULATION; DATA STRUCTURES; INVERSE PROBLEMS; LEARNING SYSTEMS; MATHEMATICAL OPERATORS; MATHEMATICAL TRANSFORMATIONS; NONLINEAR CONTROL SYSTEMS; OPTIMAL CONTROL SYSTEMS; PARAMETER ESTIMATION; VARIATIONAL TECHNIQUES;

BESSEL'S DIFFERENTIAL EQUATIONS; FEEDFORWARD COMPLEXITY; FEEDFORWARD STRUCTURE; INVERSE TRANSFORMATION; LINEAR OPERATORS; NONLINEAR DYNAMICAL SYSTEMS; RECURRENT BACK PROPAGATION; RECURRENT NEURAL NETWORK TRAINING; STATE VARIABLES; TRAINING DATA SET;

NEURAL NETWORKS;

EID: 0028400379     PISSN: 10459227     EISSN: 19410093     Source Type: Journal    
DOI: 10.1109/72.279184     Document Type: Article

References (31)

1. D. R. Hush and B. G. Horne, “Progress in supervised neural networks,” IEEE Signal Processing Magazine, vol. 10, no. 1, pp. 8–39, 1993.
2. K. Hornik, M. Stinchcombe, and H. White, “Multilayer feedforward networks are universal approximators,” Neural Networks, vol. 2, pp. 359–366, 1989.
3. R. Hecht-Nielsen, “Kolmogorov's mapping neural network existence theorem,” in Proceedings of the IEEE First International Conference on Neural Networks, vol. III, 1987, pp. 11–14.
4. K. Hornik, M. Stinchcombe and H. White, “Universal approximation of an unknown mapping and its derivatives using multilayer feedforward networks,” Neural Networks, vol. 3, pp. 551–560, 1990.
5. P. Cardaliaguet and G. Euvrard, “Approximation of a function and its derivative with a neural network,” Neural Networks, vol. 5, pp. 207–220, 1992.
6. A. R. Gallant and H. White, “On learning the derivatives of an unknown mapping with multilayer feedforward networks,” Neural Networks, vol. 5, pp. 129–138, 1992.
7. W. Thomas Miller, III, R. S. Sutton, and Paul J. Werbos, Neural Networks for Control, Cambridge, MA: MIT Press, 1990
8. P. J. Werbos, “Neurocontrol and supervised learning: An overview and evaluation,” in Handbook of intelligent control, D. White and D. Sofge, Eds. Van Nostrand, 1992.
9. M. I. Jordan and R. A. Jacobs, “Learning to control an unstable system with forward modeling,” in Neural Information Processing Systems 2, David S. Touretzky, Ed. Morgan Kaufmann, 1990, pp. 324–331.
10. H. Miyamoto, M. Kawato, T. Setoyama and R. Suzuki, “Feedback-error-learning neural network for trajectory control of a robotic manipulator,” Neural Networks, vol. 1, pp. 251–265, 1988.
11. F. J. Pineda, “Generalization of backpropagation to recurrent and higher order neural networks,” in Neural Information Processing Systems, Dana Z. Anderson, Ed. American Institute of Physics, 1988, pp. 602–611.
12. R. Hecht-Nielsen, Neurocomputing. Addison-Wesley, 1990
13. B. A. Pearlmutter, “Learning state space trajectories in recurrent neural networks,” Neural Computation, vol. 1, no. 2, pp. 263–269, 1989.
14. K. S. Narendra and K. Parthasarathy, “Identification and control of dynamical systems using neural networks,” IEEE Transactions on Neural Networks, vol. 1, no. 1, pp. 4—27, 1990.
15. K. S. Narendra and K. Parthasarathy, “Gradient methods for the optimization of dynamical systems containing neural networks,” IEEE Transactions on Neural Networks, vol. 2, pp. 252–262, 1991.
16. R. J. Williams and D. Zipser, “A learning algorithm for continually running fully recurrent neural networks,” Neural Computation, vol. 1, no. 2, pp. 270–280, 1989.
17. D. Rumelhart and J. McClelland, Parallel Distributed Processing. Vol. 1, Cambridge, MA: MIT Press, 1987
18. P. J. Werbos, “Generalization of backpropagation with application to a recurrent gas market model,” Neural Networks, vol. 1, pp. 339–356, 1988.
19. J. Barhen, N. Toomarian and S. Gulati, “Application of adjoint operators to neural learning,” Applied Mathematics Letters, vol. 3, no. 3, pp. 13–18.
20. J. Barhen, N. Toomarian and S. Gulati, “Adjoint operator algorithms for faster learning in dynamical neural networks,” Advances in Neural Information Processing Systems 2 David S. Touretzky, Ed. San Matteo, CA: Morgan Kaufmann, 1990, pp. 498–-508.
21. N. B. Toomarian and J. Barhen, “Learning a trajectory using adjoint functions and teacher forcing,” Neural Networks, vol. 5, no. 3, pp. 473–484.
22. D. G. Luenberger, Introduction to Dynamic Systems. New York: John Wiley, 1979
23. T. Kailath, Linear Systems. Englewood Cliffs, NJ: Prentice Hall, 1980
24. S. P. Banks, Mathematical Theories of Nonlinear Systems, Englewood Cliffs, NJ: Prentice Hall, 1988
25. C. L. Giles, G. Z. Sun, H. H. Chen, Y. C. Lee and D. Chen, “Higher order recurrent networks and grammatical inference,” Neural Information Processing Systems 2, David S. Touretzky, Ed. San Matteo, CA: Morgan Kaufmann, 1990, pp. 380–387.
26. C. L. Giles, C. B. Miller, D. Chen, H. H. Chen, G. Z. Sun and Y. C. Lee, “Learning and extracting finite state automata with second-order recurrent neural networks,” Neural Computation, vol. 4, 1992, pp. 393—405.
27. K. J. Lang, A. H. Waibel, and G. E. Hinton, “A time-delay neural network architecture for isolated word recognition,” Neural Networks, vol. 3, pp. 23–43, 1990.
28. C.-T. Chen, System and Signal Analysis. Holt, Rinehart and Winston, 1989.
29. S. Grossberg, “Nonlinear neural networks: principles, mechanisms, and architectures,” Neural Networks, vol. 1, no. 1, pp. 17–61, 1988.
30. E. B. Baum and D. Haussler, “What size net gives valid generalization?” Neural Computation, vol. 1, pp. 151–160, 1989.
31. K.-Y. Siu, V. P. Roychowdhury, and T. Kailath, “Depth-size tradeoffs for neural computation,” IEEE Transactions on Computers, vol. 40, no. 12, pp. 1402–1412, 1991.