Equivalence of backpropagation and contrastive Hebbian learning in a layered network

Neural Computation

Volumn 15, Issue 2, 2003, Pages 441-454

  Xie, Xiaohui ^a   Seung, H Sebastian ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b HOWARD HUGHES MEDICAL INSTITUTE   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; LEARNING; PHYSIOLOGY;

ALGORITHMS; LEARNING; NEURAL NETWORKS (COMPUTER);

EID: 0037313081     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976603762552988     Document Type: Article

References (15)

1. Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985). A learning algorithm for Boltzmann Machines. Cognitive Science, 9, 147-169.
2. Baldi, P., & Pineda, F. (1991). Contrastive learning and neural oscillator. Neural Computation, 3, 526-545.
3. Cohen, M. A., & Grossberg, S. (1983). Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Trans. on Systems, Man, and Cybernetics, 13, 815-826.
4. Crick, F. (1989). The recent excitement about neural networks. Nature, 337, 129-132.
5. Hinton, G. E. (1989). Deterministic Boltzmann learning performs steepest descent in weight-space. Neural Computation, 1, 143-150.
6. Hinton, G. E., & McClelland, J. (1988). Learning representations by recirculation. In D. Z. Anderson (Ed.), Neural Information Processing Systems. New York: American Institute of Physics.
7. Hopfield, J. J. (1984). Neurons with graded response have collective computational properties like those of two-state neurons. Proc. Natl. Acad. Sci. USA, 81, 3088-3092.
8. Hopfield, J. J. (1987). Learning algorithms and probability distributions in feed-forward and feed-back networks. Proc. Natl. Acad. Sci. USA, 84, 8429-8433.
9. Mazzoni, P., Andersen, R. A., & Jordan, M. I. (1991). A more biologically plausible learning rule for neural networks. Proc. Natl. Acad. Sci. USA, 88, 4433-4437.
10. Movellan, J. (1990). Contrastive Hebbian learning in the continuous Hopfield model. In D. Touretzky, J. Elman, T. Sejnowski, & G. Hinton (Eds.), Proceedings of the 1990 Connectionist Models Summer School (pp. 10-17). San Mateo, CA: Morgan Kaufmann.
11. O'Reilly, R. (1996). Biologically plausible error-driven learning using local activation differences: The generalized recirculation algorithm. Neural Computation, 8, 895-938.
12. Peterson, C., & Anderson, J. (1987). A mean field theory learning algorithm for neural networks. Complex Systems, 1, 995-1019.
13. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986a). Learning internal representations by error propagation. In D. E. Rumelhart, & J. L. McClelland (Eds.), Parallel distributed processing: Explorations in the microstructure of cognition. Vol. 1: Foundations (pp. 318-362). Cambridge, MA: MIT Press.
14. Rumelhart, D. E., Hinton, G. E., & Williams, R. J. (1986b). Learning representations by back-propagating errors. Nature, 323, 533-536.
15. Zipser, D., & Andersen, R. A. (1988). A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature (London), 331, 679-684.