Efficient training of multilayer perceptrons using principal component analysis

Physical Review E - Statistical, Nonlinear, and Soft Matter Physics

Volumn 72, Issue 2, 2005, Pages

  Bunzmann, Christoph ^a   Biehl, Michael ^b   Urbanczik, Robert ^a  

^a UNIVERSITY OF WÜRZBURG   (Germany)

^b UNIVERSITY OF GRONINGEN   (Netherlands)

Author keywords

[No Author keywords available]

Indexed keywords

ONLINE TRAINING; STATISTICAL PHYSICS;

MATHEMATICAL MODELS; ONLINE SYSTEMS; OPTIMIZATION; PRINCIPAL COMPONENT ANALYSIS; STATISTICAL METHODS;

NEURAL NETWORKS;

EID: 27244432276     PISSN: 15393755     EISSN: 15502376     Source Type: Journal    
DOI: 10.1103/PhysRevE.72.026117     Document Type: Article

References (16)

1. A. Engel and C. van den Broeck, Statistical Physics of Neural Networks (Cambridge University Press, Cambridge, 2001).
2. T. L. H. Watkin, A. Rau, and M. Biehl, Rev. Mod. Phys. RMPHAT 0034-6861 10.1103/RevModPhys.65.499 65, 499 (1993).
3. S. Amari, IEEE Trans. Electron. Comput. IEECA8 0367-7508 16, 299 (1967).
4. M. Biehl and H. Schwarze, J. Phys. A JPHAC5 0305-4470 10.1088/0305-4470/28/3/018 28, 643 (1995).
5. D. Saad and S. A. Solla, Phys. Rev. Lett. PRLTAO 0031-9007 10.1103/PhysRevLett.74.4337 74, 4337 (1995).
6. M. Biehl, P. Riegler, and C. Wöhler. J. Phys. A JPHAC5 0305-4470 10.1088/0305-4470/29/16/005 29, 4769 (1996).
7. Online Learning in Neural Networks, edited by, D. Saad, (Cambridge University Press, Cambridge, 1998).
8. D. Saad and M. Rattray, Phys. Rev. Lett. PRLTAO 0031-9007 10.1103/PhysRevLett.79.2578 79, 2578 (1997).
9. R. Vicente and N. Caticha, J. Phys. A JPHAC5 0305-4470 10.1088/0305-4470/30/17/002 30, L599 (1997).
10. M. Rattray, D. Saad, and S. I. Amari, Phys. Rev. Lett. PRLTAO 0031-9007 10.1103/PhysRevLett.81.5461 81, 5461 (1998).
11. H. Schwarze and J. Hertz, Europhys. Lett. EULEEJ 0295-5075 21, 785 (1993).
12. M. Ahr and M. Biehl and R. Urbanczik, Eur. Phys. J. B EPJBFY 1434-6028 10, 583 (1999).
13. R. Urbanczik, Europhys. Lett. EULEEJ 0295-5075 10.1209/epl/i1996-00149-4 35, 553 (1996).
14. C. Bunzmann, M. Biehl, and R. Urbanczik, Phys. Rev. Lett. PRLTAO 0031-9007 10.1103/PhysRevLett.86.2166 86, 2166 (2001).
15. G. Cybenko. Math. Control, Signals, Syst. 0932-4194 10.1088/1469-7688/2/ 4/306, 2, 303 (1989).
16. M. Biehl and A. Mietzner, Europhys. Lett. EULEEJ 0295-5075 24, 421 (1993).