Recurrent neural-network training by a learning automaton approach for trajectory learning and control system design

IEEE Transactions on Neural Networks

Volumn 9, Issue 3, 1998, Pages 354-368

  Sundareshan, Malur K ^a   Condarcure, Thomas A ^a  

^a University of Arizona   (United States)

Author keywords

Control system design; Learning systems; Neural network learning; Neuro controllers; Recurrent neural networks; Stochastic learning automata; Trajectory learning

Indexed keywords

BACKPROPAGATION; COMPUTATIONAL COMPLEXITY; CONTROL SYSTEM ANALYSIS; FEEDBACK CONTROL; LEARNING ALGORITHMS; LEARNING SYSTEMS; ROBUSTNESS (CONTROL SYSTEMS); STOCHASTIC CONTROL SYSTEMS;

NEURO CONTROLLERS; RECURRENT NEURAL NETWORKS; STOCHASTIC LEARNING AUTOMATA; TRAJECTORY LEARNING;

NEURAL NETWORKS;

EID: 0032072476     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.668879     Document Type: Article

References (45)

1. J. J. Hopfield, "Neurons with graded response have collective computational properties like those of two-state neurons," in Proc. Nat. Academy Sci., 1984, vol. 81, pp. 3008-3090.
2. S. I. Sudharsanan and M. K. Sundareshan, "Equilibrium characterization of dynamical neural networks and a systematic synthesis procedure for associative memories," IEEE Trans. Neural Networks, vol. 2, pp. 509-522, Sept. 1991.
3. J. J. Hopfield and D. W. Tank, "Neural computation of decision optimization problems," Biol. Cybern., vol. 52, pp. 1-12, 1985.
4. S. I. Sudharsanan and M. K. Sundareshan, "Exponential stability and a systematic synthesis of a neural network for quadratic minimization," Neural Networks, vol. 4, pp. 599-613, 1991.
5. F. J. Pineda, "Generalization of backpropagation in recurrent neural networks," Phys. Rev. Lett., vol. 59, no. 19, pp. 2229-2232, 1987.
6. L. B. Almeida, "A learning rule for asynchronous perceptrons with feedback in a combinatorial environment," in Proc. IEEE 1st Annu. Int. Conf. Neural Networks, San Diego, CA, 1987, pp. 609-618.
7. D. E. Rumelhart, G. E. Hinton, and R. J. Williams, "Learning internal representations by error propagation," in Parallel Distributed Processing: Explorations in the Microstructure of Cognition, D. E. Rumelhart and J. L. McClelland, Eds. Cambridge, MA: MIT Press, 1986, pp. 45-76.
8. S. I. Sudharsanan and M. K. Sundareshan, "Training of a three-layer recurrent neural network for nonlinear input-output mapping," in Proc. 1991 Int. Joint Conf. Neural Networks (IJCNN-91), Seattle, WA, July 1991.
9. M. Tsetlin, "On the behavior of finite automata in random media," Automat. Remote Contr., vol. 22, pp. 1210-1219, 1962.
10. S. Lakshmivarahan, Learning Algorithms: Theory and Applications. New York: Springer-Verlag, 1981.
11. K. S. Narendra and M. A. L. Thathachar, Learning Automata: An Introduction. Englewood Cliffs, NJ: Prentice-Hall, 1989.
12. R. A. Rescorla and A. R. Wagner, "A theory of Pavlovian conditioning: Variations in the effectiveness of reinforcement and nonreinforcement," Classical Conditioning II: Current Research and Theory, A. H. Black and W. R. Prokasy, Eds. New York: Appleton-Century-Crofts, 1972.
13. J. M. Mendel and R. N. McLearn, "Reinforcement learning control and pattern recognition systems," Adaptive, Learning, and Pattern Recognition Systems, J. M. Mendal and K. S. Fu, Eds. New York: Academic, 1970.
14. A. G. Barto, "Connectionist learning for control: An overview," Neural Networks for Control, W. T. Miller, R. S. Sutton, and P. J. Werbos, Eds. Cambridge, MA: MIT Press, 1990.
15. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuronlike elements that can solve difficult learning control problems," IEEE Trans. Syst., Man, Cybern., vol. SMC-13, pp. 834-846, 1983.
16. C. W. Anderson, "Learning to control an inverted pendulum using neural networks," IEEE Contr. Syst. Mag., pp. 31-47, 1989.
17. R. S. Sutton, A. G. Barto, and R. J. Williams, "Reinforcement learning is direct adaptive optimal control," IEEE Contr. Syst. Mag., pp. 19-22, 1992.
18. R. Williams and D. Zipser, "A learning algorithm for continually running fully recurrent neural networks," Neural Computa., vol. 1, pp. 270-270, 1989.
19. B. Pearlmutter, "Learning state-space trajectories in recurrent neural networks," Neural Computa., vol. 1, pp. 263-269, 1989.
20. N. Toomarian and J. Barhen, "Learning a trajectory using adjoint functions and teacher forcing," Neural Networks, vol. 5, pp. 473-484, 1992.
21. B. Widrow and F. W. Smith, "Pattern recognizing control systems," in Proc. Computer and Inform. Sci. Symp., Washington, DC, 1963.
22. K. S. Narendra and K. Parthasarathy, "Identification and control of dynamical systems using neural networks," IEEE Trans. Neural Networks, vol. 1, pp. 4-27, 1990.
23. K. S. Narendra and S. Mukhopadhyay, "Intelligent control using neural networks," IEEE Contr. Syst. Mag., pp. 11-18, 1992.
24. A. Karakasoglu, S. I. Sudharsanan, and M. K. Sundareshan, "Identification and decentralized adaptive control using dynamical neural networks with application to robotic manipulators," IEEE Trans. Neural Networks, vol. 4, pp. 919-931, Nov. 1993.
25. S. I. Sudharsanan, I. Muhsin, and M. K. Sundareshan, "Self-tuning adaptive control of multiinput multioutput systems using multilayer recurrent neural networks with application to synchronous power generators," in Proc. IEEE Conf. Neural Networks, San Francisco, CA, Mar. 1993.
26. V. I. Varshavskii and I. P. Vorontsova, "On the behavior of stochastic automata with variable structure," Automat. Remote Contr., vol. 24, pp. 327-333, 1963.
27. R. Bartle and D. Sherbet, Introduction to Real Analysis. New York: Wiley, 1992.
28. H. Behrens, D. Gawronska, J. Hollatz, and B. Schurmann, "Recurrent and feedforward backpropagation for time-independent pattern recognition," in Proc. 1991 Int. Joint Conf. Neural Networks (IJCNN), Seattle, WA, July 1991.
29. T. Lewis and W. H. Payne, "Generalized feedback shift register pseudorandom number algorithms," J. ACM, vol. 20, no. 3, pp. 456-468, July 1973.
30. A. Isidori, Nonlinear Control Systems. New York: Springer-Verlag, 1989.
31. S. S. Sastry and A. Isidori, "Adaptive control of linearizable systems," IEEE Trans. Automat. Contr., vol. 34, pp. 1123-1131, 1989.
32. Y. Ichikawa and T. Sawa, "Neural-network application for direct feedback controllers," IEEE Trans. Neural Networks, vol. 3, pp. 224-232, Mar. 1992.
33. P. Baldi and N. Toomarian, "Learning trajectories with a hierarchy of oscillatory modules," in Proc. IEEE Conf. Neural Networks, San Francisco, CA, June 1993, pp. 1171-1176.
34. M. D. Waltz and K. S. Fu, "A heuristic approach to learning control systems," IEEE Trans. Automat. Contr., vol. AC-10, pp. 390-398, 1965.
35. B. Widrow, N. K. Gupta, and S. Maitra, "Punish/reward: Learning with a critic in adaptive threshold systems," IEEE Trans. Syst., Man, Cybern., vol. SMC-3, pp. 455-463, 1973.
36. S. Mahadevan and J. Connell, "Automatic programming of behavior-based robots using reinforcement learning," IBM Tech. Rep., 1990.
37. V. Gullapalli, J. A. Franklin, and H. Benbrahim, "Acquiring robot skills via reinforcement learning," IEEE Contr. Syst. Mag., vol. 14, no. 1, pp. 13-24, 1994.
38. D. Psaltis, A. Sideris, and A. A. Yamamura, "A multilayered neural network controller," IEEE Contr. Syst. Mag., vol. 8, no. 4, pp. 17-21, 1988.
39. S. I. Sudharsanan and M. K. Sundareshan, "Supervised training of dynamical neural networks for associative memory design and identification of nonlinear maps," Int. J. Neural Syst., vol. 5, pp. 165-180, Sept. 1994.
40. B. Pearlmutter, "Gradient calculation for dynamic neural networks: A survey," IEEE Trans. Neural Networks, vol. 6, pp. 1212-1228, 1995.
41. J. T. H. Lo, "Synthetic approach to optimal filtering," IEEE Trans. Neural Networks, vol. 5, pp. 803-811, 1994.
42. D. Obradivic, "On-line training of recurrent neural networks with continuous topology adaptation," IEEE Trans. Neural Networks, vol. 6, pp. 222-228, 1996.
43. T. Condarcure, "A learning automaton approach to trajectory learning and control systems design using recurrent neural networks," M.S. thesis, Univ. Arizona, Tucson, May 1993.
44. B. Kosko, "Unsupervised learning in noise," IEEE Trans. Neural Networks, vol. 1, pp. 44-57, 1990.
45. P. Werbos, "Backpropagation through time: What it does and how to do it," Proc. IEEE, vol. 78, pp. 1550-1560, 1990.