Attractor dynamics in feedforward neural networks

Neural Computation

Volumn 12, Issue 6, 2000, Pages 1313-1335

  Saul, Lawrence K ^a   Jordan, Michael I ^b  

^a AT AND T LABS RESEARCH   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ARTICLE; ARTIFICIAL NEURAL NETWORK; BAYES THEOREM; FEEDBACK SYSTEM; NONLINEAR SYSTEM; PROBABILITY;

BAYES THEOREM; FEEDBACK; MARKOV CHAINS; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS;

EID: 0034203346     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976600300015385     Document Type: Article

References (27)

1. Ackley, D. H., Hinton, G. E., & Sejnowski, T. J. (1985). A learning algorithm for Boltzmann machines. Cognitive Science, 9, 147-169.
2. Amit, D. J. (1989). Modeling brain function. Cambridge: Cambridge University Press.
3. Binder, J., Koller, D., Russell, S. J., & Kanazawa, K. (1997). Adaptive probabilistic networks with hidden variables. Machine Learning, 29, 213-244.
4. Buntine, W. (1994). Operations for learning with graphical models. Journal of Artificial Intelligence Research, 2, 159-225.
5. Cohen, M. A., & Grossberg, S. (1983). Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Transactions on Systems, Man, and Cybernetics, 13, 815-826.
6. Cooper, G. (1990). Computational complexity of probabilistic inference using Bayesian belief networks. Artificial Intelligence, 42, 393-405.
7. Dayan, P., Hinton, G. E., Neal, R. M., & Zemel, R. (1995). The Helmholtz machine. Neural Computation, 7, 889-904.
8. Galland, C. C. (1993). The limitations of deterministic Boltzmann machine learning. Network: Computations in Neural Systems, 4, 355-379.
9. Geman, S., & Geman, D. (1984). Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 6, 721-741.
10. Hinton, G. E., Dayan, P., Frey, B. J., & Neal, R. M. (1995). The wake-sleep algorithm for unsupervised neural networks. Science, 268, 1158-1161.
11. Hinton, G. E., & Ghahramani, Z. (1997). Generative models for discovering sparse distributed representations. Philosophical Transactions Royal Society B, 352, 1177-1190.
12. Hopfield, J. J. (1982). Neural networks and physical systems with emergent collective computational abilities. Proceedings of the National Academy of Sciences, USA, 79, 2554-2558.
13. Hopfield, J. J. (1984). Neurons with graded responses have collective computational properties like those of two-state neurons. Proceedings of the National Academy of Sciences, USA, 81, 3088-3092.
14. Hopfield, J. J., & Tank, D. W. (1986). Computing with neural circuits: A model. Science, 233, 625-633.
15. Hoskins, D., Hwang, J., & Vagners, J. (1992). Iterative inversion of neural networks and its application to adaptive control. IEEE Transactions on Neural Networks, 3, 292-301.
16. Jordan, M. I., & Rumelhart, D. E. (1992). Forward models: Supervised learning with a distal teacher. Cognitive Science, 16, 307-354.
17. Koch, C., Marroquin, J., & Yuille, A. (1986). Analog "neuronal" networks in early vision. Proceedings of the National Academy of Sciences, USA, 83, 4263-4267.
18. Lauritzen, S. L. (1996). Graphical models. Oxford: Oxford University Press.
19. Lewicki, M. S., & Sejnowski, T. J. (1996). Bayesian unsupervised learning of higher order structure. In M. Mozer, M. Jordan, & T. Petsche (Eds.), Advances in neural information processing systems, 9. Cambridge, MA: MIT Press.
20. Metropolis, N., Rosenbluth, A. W., Rosenbluth, M. N., Teller, A. H., & Teller, E. (1953). Equation of state calculations for fast computing machines. Journal of Chemical Physics, 21, 1087-1092.
21. Neal, R. M. (1992). Connectionist learning of belief networks. Artificial Intelligence, 56, 71-113.
22. Parisi, G. (1988). Statistical field theory. Redwood City, CA: Addison-Wesley.
23. Pearl, J. (1988). Probabilistic reasoning in intelligent systems. San Mateo, CA: Morgan Kaufmann.
24. Peterson, C., & Anderson, J. R. (1987). A mean field theory learning algorithm for neural networks. Complex Systems, 1, 995-1019.
25. Saul, L. K., Jaakkola, T. S., & Jordan, M. I. (1996). Mean field theory for sigmoid belief networks. Journal of Artificial Intelligence Research, 4, 61-76.
26. Seung, H. S. (1995). Annealed theories of learning. In J.-H. Oh, C. Kwon, & S. Cho (Eds.), Neural networks: The statistical mechanics perspective: Proceedings of the CTP-PRSRI Joint Workshop on Theoretical Physics. Singapore: World Scientific.
27. Seung, H. S., Richardson, T. J., Lagarias, J. C., & Hopfield, J. J. (1998). Minimax and Hamiltonian dynamics of excitatory-inhibitory networks. In M. Jordan, M. Kearns, & S. Solla (Eds.), Advances in neural information processing systems, 10. Cambridge, MA: MIT Press.