Analysis of ensemble learning using simple perceptrons based on online learning theory

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 71, Issue 3, 2005, Pages

  Miyoshi, Seiji ^a   Hara, Kazuyuki ^b   Okada, Masato ^c,d,e  

^a KOBE CITY COLLEGE OF TECHNOLOGY   (Japan)

^b TOKYO METROPOLITAN COLLEGE OF INDUSTRIAL TECHNOLOGY   (Japan)

^c UNIVERSITY OF TOKYO   (Japan)

^d RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^e JAPAN SCIENCE AND TECHNOLOGY AGENCY   (Japan)

Author keywords

[No Author keywords available]

Indexed keywords

BATCH LEARNING; ENSEMBLE LEARNING; GAUSSIAN DISTRIBUTIONS; HEBBIAN LEARNING; PERCEPTRON LEARNING;

DIFFERENTIAL EQUATIONS; INTEGRATION; NONLINEAR SYSTEMS; ONLINE SYSTEMS; STATISTICAL MECHANICS; STUDENTS; THERMODYNAMICS; VECTORS;

LEARNING SYSTEMS;

EID: 37649033000     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.71.036116     Document Type: Article

References (17)

1. Y. Freund and R. E. Schapire, J. Jpn. Soc. Artif. Intell. 14, 771 (1999) (in Japanese, translation by N. Abe).
2. L. Breiman, Mach. Learn. 26, 123 (1996).
3. Y. Freund and R. E. Shapire, J. Comput. Syst. Sci. 55, 119 (1997).
4. K. Hara and M. Okada, cond-mat/0402069
5. A. Krogh and P. Sollich, Phys. Rev. E 55, 811 (1997).
6. R. Urbanczik, Phys. Rev. E 62, 1448 (2000).
7. J. A. Hertz, A. Krogh, and R. G. Palmer, Introduction to the Theory of Neural Computation (Addison-Wesley, Redwood City, CA, 1991).
8. M. Opper and W. Kinzel, in Physics of Neural Networks III, edited by E. Domany, J. L. van Hemmen, and K. Schulten (Springer, Berlin, 1995).
9. H. Nishimori, Statistical Physics of Spin Glasses and Information Processing: An Introduction (Oxford University Press, Oxford, 2001).
10. J. K. Anlauf and M. Biehl, Europhys. Lett. 10, 687 (1989).
11. M. Biehl and P. Riegler, Europhys. Lett. 28, 525 (1994).
12. J. Inoue and H. Nishimori, Phys. Rev. E 55, 4544 (1997).
13. D. Saad, On-line Learning in Neural Networks (Cambridge University Press, Cambridge, England, 1998).
14. S. Miyoshi, K. Hara, and M. Okada, IEICE Technical Report No. 103, 2003 (in Japanese), p.13.
15. S. Miyoshi, K. Hara, and M. Okada, in Proceedings of the 2003 Annual Conference of the Japanese Neural Network Society, 104 (in Japanese).
16. P. Riegler, M. Biehl, S. A. Solla, and C. Marangi, in Proceedings of the 7th Italian Workshop on Neural Nets. Vol. 87.
17. A. Engel and C. V. Broeck, Statistical Mechanics of Learning (Cambridge University Press, Cambridge, England, 2001).