Reinforcement learning to train a cooperative network with both discrete and continuous output neurons

IEEE Transactions on Neural Networks

Volumn 9, Issue 6, 1998, Pages 1502-1508

  Yamada, Satoshi ^a   Nakashima, Michio ^a   Shiono, Satoru ^a  

^a MITSUBISHI ELECTRIC CORPORATION   (Japan)

Author keywords

Aplysia; Cooperative networks; Discrete and continuous output neurons; Fast learning; Fine control; Inverted pendulum; Reinforcement learning

Indexed keywords

COMPUTER SIMULATION; CONTROL; LEARNING SYSTEMS; NEURAL NETWORKS;

CONTINUOUS OUTPUT NEURONS; COOPERATIVE NETWORK; FAST LEARNING; INVERTED PENDULUM; REINFORCEMENT LEARNING;

LEARNING ALGORITHMS;

EID: 0032208721     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.728399     Document Type: Article

References (21)

1. A. G. Barto, R. S. Sutton, and C. W. Anderson, "Neuron like adaptive elements that can solve difficult learning control problems," IEEE Trans. Sys. Man Cybern., vol. SMC-13, pp. 834-846, 1983.
2. C. W. Anderson, "Learning to control an inverted pendulum using neural networks," IEEE Contr. Syst. Mag., vol. 9, pp. 31-37, 1989.
3. V. Gullapalli, J. A. Franklin, and H. Benbrahim, "Acquiring robot skills via reinforcement learning," IEEE Contr. Syst. Mag., vol. 14, pp. 13-24, 1994.
4. G. Tesauro, "TD-gammon, a self-teaching backgammon program, achieves master-level play," Neural Comput., vol. 6, pp. 215-219, 1994.
5. W. C. Jouse, "Continuous valued reinforcement learning," in Intell. Eng. Syst. Artificial Neural Networks, C. H. Dagli, B. R. Fernández, J. Ghosh, and R. T. Soundar Kumara, Eds. Providence, RI: ASME Press, vol. 4, 1994, pp. 141-146.
6. S. Yamada, M. Nakashima, and S. Shiono, "Neural-network model to simulate neuronal responses of Aplysia gill-withdrawal reflex," in Proc. 1993 Int. Joint Conf. Neural Networks, 1993, pp. 37-40.
7. S. Yamada, A. Watanabe, M. Nakashima, and S. Shiono, "Reinforcement learning to train cooperative networks with both digital and analog motor neurons," in Intell. Eng. Syst. Artificial Neural Networks, C. H. Dagli, B. R. Frenández, J. Ghosh, and R. T. Soundar Kumara, Eds. Providence, RI: ASME Press, vol. 4, 1994, pp. 133-140.
8. S. Shiono, S. Yamada, and M. Nakashima, "Aplysia optical recording: Neural response in abdominal ganglion neurons to patterned stimuli and its analysis," in Basic Neuroscience in Invertebrate, H. Koike, Y. Kidokoro, K. Takahashi, and T. Kanaseki, Eds. Tokyo, Japan: Japan Sei. Soc. Press, 1996, pp. 315-330.
9. M. Nakashima, S. Yamada, S. Shiono, M. Maeda, and F. Satoh, "448-detector optical recording system: Development and application to Aplysia gill-withdrawal reflex," IEEE Trans. Biomed. Eng., vol. 39, pp. 26-36, 1992.
10. M. Nakashima, S. Yamada, and S. Shiono, "Optical recording and analysis of Aplysia abdominal ganglia," Soc. Neurosci. Abst., vol. 18, p. 712, 1992.
11. S. Shiono, M. Nakashima, S. Yamada, and K. Matsumoto, "Optical recording and information theoretic analysis of Aplysia reflex," Jap. J. Physiol., vol. 43, pp. s31-s36, 1993.
12. S. Yamada, M. Nakashima, K. Matsumoto, and S. Shiono, "Information theoretic analysis of action potential trains I. Analysis of correlation between two neurons," Biol. Cybern., vol. 68, pp. 215-220, 1993.
13. S. Yamada, K. Matsumoto, M. Nakashima, and S. Shiono, "Information theoretic analysis of action potential trains II. Analysis of correlation among n neurons to deduce connection structure," J. Neurosci. Methods, vol. 66, pp. 35-45, 1996.
14. E. R. Kandel, Cellular Basis of Behavior: An Introduction to Behavioral Neurobiology. San Francisco, CA: Freeman, 1976.
15. J. H. Byrne and J. Koester, "Respiratory pumping: Neuronal control of a centrally commanded behavior in Aplysia," Brain Res., vol. 143, pp. 87-105, 1978.
16. R. D. Hawkins, V. F. Castellucci, and E. R. Kandel, "Interneurons involved in mediation and modulation of gill-withdrawal reflex in Aplysia. I. identification and characterization," J. Neurophysiol., vol. 45, pp. 304-314, 1981.
17. J. H. Byrne, "Identification of a cluster of command and pattern-generating neurons underlying respiratory pumping in Aplysia Californica," J. Neurophysiol., vol. 49, pp. 491-508, 1983.
18. R. D. Hawkins and S. Schacher, "Identified facilitator neurons L29 and L28 are excited by cutaneous stimuli used in dishabituation, sensitization, and classical conditioning of Aplysia," J. Neurosci., vol. 9, pp. 4236-4245, 1989.
19. D. E. J. Blazis, T. M. Fisher, and T. J. Carew, "A neural network model of inhibitory information processing in Aplysia," Neural Comput., vol. 5, pp. 213-227, 1993.
20. T. M. Fisher and T. J. Carew, "Activity-dependent potentiation of recurrent inhibition: A mechanism for dynamic gain control in the siphon withdrawal reflex of Aplysia," J. Neurosci, vol. 13, pp. 1302-1314, 1993.
21. R. S. Sutton, "Learning to predict by the methods of temporal differences," Machine Learning, vol. 3, pp. 9-44, 1988.