Mean field approach to learning in Boltzmann Machines

Pattern Recognition Letters

Volumn 18, Issue 11-13, 1997, Pages 1317-1322

  Kappen, H J ^a   Rodriguez F B ^b  

^a RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^b UNIVERSIDAD AUTÓNOMA DE MADRID   (Spain)

Author keywords

Mean field theory; Probability models

Indexed keywords

COMPUTATIONAL COMPLEXITY; CORRELATION THEORY; PROBABILITY; STATISTICS; THEOREM PROVING;

BAYESIAN NETWORKS; BOLTZMANN MACHINES; GLAUBER DYNAMICS; MEAN FIELD THEORY;

LEARNING ALGORITHMS;

EID: 0031270816     PISSN: 01678655     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0167-8655(97)00096-2     Document Type: Article

References (15)

1. Ackley, D., Hinton, G., Sejnowski, T., 1985. A learning algorithm for Boltzmann Machines. Cognitive Science 9, 147-169.
2. Cooper, G., 1990. The computational complexity of probabilistic inferences. Artificial Intelligence 42, 393-405.
3. Dayan, P., Hinton, G., Neal, R., Zemel, R., 1995. The Helmholtz Machine. Neural Computation 7, 889-904.
4. Ginzburg, I., Sompolinsky, H., 1994. Theory of correlations in stochastic neural networks. Physical Review E 50, 3171-3191.
5. Hertz, J., Krogh, A., Palmer, R., 1991. Introduction to the Theory of Neural Computation, Santa Fe Institute, vol. 1. Addison-Wesley, Redwood City.
6. Hinton, G., 1989. Deterministic Boltzmann learning performs steepest descent in weight-space. Neural Computation 1, 143-150.
7. Hinton, G., Dayan, P., Frey, B., Neal, R., 1995. The "Wake-Sleep" algorithm for unsupervised neural networks. Science 268, 1158-1161.
8. Itzykson, C., Drouffe, J.-M., 1989. Statistical Field Theory. Cambridge Monographs on Mathematical Physics. Cambridge University Press, Cambridge, UK.
9. Kappen, H., 1997. Stimulus dependent correlations in stochastic networks. Physical Review E 55, 5849-5858.
10. Kappen, H., Rodríguez, F., 1997. Efficient learning in Boltzmann Machines using linear response theory. Neural Comput.
11. Kullback, S., 1959. Information Theory and Statistics. Wiley, New York.
12. Lauritzen, S., Spiegelhalter, D., 1988. Local computations with probabilities on graphical structures and their application to expert systems. J. Roy. Statist. Soc. B 50, 154-227.
13. Parisi, G., 1988. Statistical Field Theory. Frontiers in Physics. Addison-Wesley, Reading, MA.
14. Pearl, J., 1988. Probabilistic reasoning in intelligent systems: Networks of Plausible Inference. Morgan Kaufmann, San Francisco, CA.
15. Peterson, C., Anderson, J., 1987. A mean field theory learning algorithm for neural networks. Complex Systems 1, 995-1019.