On-line Gibbs learning. I. General theory

Physical Review E - Statistical Physics, Plasmas, Fluids, and Related Interdisciplinary Topics

Volumn 58, Issue 2, 1998, Pages 2335-2347

  Sompolinsky, H ^a   Kim, J W ^a  

^a HEBREW UNIVERSITY OF JERUSALEM   (Israel)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 4244037309     PISSN: 1063651X     EISSN: None     Source Type: Journal    
DOI: 10.1103/PhysRevE.58.2335     Document Type: Article

References (48)

1. H. Sompolinsky, N. Tishby, and H. S. Seung, Phys. Rev. Lett. 65, 1683 (1990).PRLTAO
2. H. S. Seung, H. Sompolinsky, and N. Tishby, Phys. Rev. A 45, 6056 (1992).PLRAAN
3. T. L. H. Watkin, A. Rau, and M. Biehl, Rev. Mod. Phys. 65, 499 (1993).RMPHAT
4. D. Haussler, M. Kearns, H. S. Seung, and N. Tishby, Proceedings of the Seventh Annual ACM Conference on Computational Learning Theory (ACM Press, 1994), pp. 76–87.
5. V. N. Vapnik, The Nature of Statistical Learning Theory (Springer-Verlag, Berlin, 1995).
6. M. Opper and W. Kinzel, in Physics of Neural Networks III, edited by J. L. van Hemmen, E. Dommany, and K. Schulten (Springer-Verlag, Berlin, 1996).
7. H. Sompolinsky, in Proceedings of the Third NEC Symposium on Computational Learning and Cognition (SIAM, Princeton, NJ, 1992), p. 217.
8. S. I. Amari, N. Fujita, and S. Shinomoto, Neural Comput. 4, 605 (1992).NEUCEB
9. H. Sompolinsky and N. Barkai, in Proceedings of the International Joint Conference on Neural Networks (IEEE, Nagoya, 1993), p. 219.
10. H. Sompolinsky, N. Barkai, and H. S. Seung, in Neural Networks: The Statistical Mechanics Perspective, edited by J. Oh, C. Kwon, and S. Cho (World Scientific, Singapore, 1995).
11. M. Opper and D. Haussler, Phys. Rev. Lett. 66, 2677 (1991).PRLTAO
12. M. Opper and D. Haussler, in Proceedings of the Fourth Annual Workshop of Computation Learning Theory (COLT91) (Morgan Kaufmann Publishers, San Mateo, CA, 1991), p. 75.
13. S. I. Amari, IEEE Trans. Electron. Comput. 16, 299 (1967).IEECA8
14. H. White, J. Am. Stat. Assoc. 84, 1003 (1989).JSTNAL
15. T. Heskes and B. Kappen, Phys. Rev. A 44, 2718 (1991).PLRAAN
16. G. Radons, H. Schuster, and D. Werner, International Neural Network Conference ’90 Paris (Kluwer Academic, Dordecht, 1990), p. 993.
17. L. K. Hansen, R. Pathria, and P. Salamon, J. Phys. A 26, 63 (1993).JPHAC5
18. G. Radons, J. Phys. A 26, 3455 (1993).JPHAC5
19. T. Heskes, J. Phys. A 27, 5145 (1994).JPHAC5
20. M. Biehl and H. Schwarze, J. Phys. A 28, 643 (1995).JPHAC5
21. J. K. Anlauf and M. Biehl, Europhys. Lett. 10, 687 (1989).EULEEJ
22. M. Biehl and P. Riegler, Europhys. Lett. 28, 525 (1994).EULEEJ
23. P. Riegler and M. Biehl, J. Phys. A 28, 507 (1995).JPHAC5
24. D. Saad and S. Solla, Phys. Rev. Lett. 74, 4337 (1995).PRLTAO
25. D. Saad and S. Solla, Phys. Rev. E 52, 4225 (1995).PLEEE8
26. T. Heskes, E. T. P. Slijpen, and B. Kappen, Phys. Rev. A 46, 5221 (1992).PLRAAN
27. N. Barkai, H. S. Seung, and H. Sompolinsky, Phys. Rev. Lett. 75, 1415 (1995).PRLTAO
28. N. Barkai, H. S. Seung, and H. Sompolinsky, in Advances in Neural Information Systems, edited by R. P. Lippman, J. E. Moody, and D. S. Touretzky (Kaufmann, San Mateo, CA, 1995), Vol. 7, p. 303.
29. N. Barkai, Ph.D. thesis, Hebrew University of Jerusalem, 1995.
30. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems (Springer-Verlag, Berlin, 1978).
31. N. G. van Kampen, Stochastic Processes in Physics and Chemistry (North-Holland, Amsterdam, 1981).
32. J. W. Kim and H. Sompolinsky, Phys. Rev. Lett. 76, 3021 (1996).PRLTAO
33. J. W. Kim and H. Sompolinsky, Phys. Rev. Lett. 78, 4306 (1997).PRLTAO
34. M. L. Minsky and S. A. Papert, Perceptrons (MIT Press, Cambridge, MA, 1969).
35. N. J. Nilsson, Learning Machines (McGraw-Hill, New York, 1965)
36. G. J. Mitchison and R. M. Durbin, Biol. Cybern. 60, 345 (1989).BICYAF
37. J. Kivinen and M. K. Warmuth, J. Inform. Comput. 132, 1 (1997).ZZZZZZ
38. S. Kirkpatrick, C. D. Gelatt, Jr., and M. P. Vecchi, Science 220, 671 (1983).SCIEAS
39. S. Geman and D. Geman, IEEE Trans. Pattern Anal. Mach. Intell. 6, 721 (1984).ITPIDJ
40. H. J. Kushner, SIAM (Soc. Ind. Appl. Math.) J. Appl. Math. 47, 169 (1987).SMJMAP
41. V. N. Vapnik and A. Y. Chervonenkis, Theor. Probab. Appl. 16, 264 (1971).TPRBAU
42. V. N. Vapnik, Estimation of Dependences Based on Empirical Data (Springer-Verlag, Berlin, 1982).
43. A. Blumer, A. Ehrenfeucht, D. Haussler, and M. K. Warmuth, J. Assoc. Comput. Mach. 36, 929 (1989).JACOAH
44. A. Ehrenfeucht, D. Haussler, M. A. Kearns, and L. Valiant, Inform. Comput. 82, 247 (1989).ZZZZZZ
45. C. van den Broeck and P. Reimann, Phys. Rev. Lett. 76, 2188 (1996).PRLTAO
46. M. Opper, Phys. Rev. Lett. 77, 4671 (1996).PRLTAO
47. M. Biehl, P. Riegler, and M. Stechert, Phys. Rev. E 52, R4625 (1995).PLEEE8
48. M. Copelli, O. Kinouchi, and N. Caticha, Phys. Rev. E 53, 6341 (1996). PLEEE8