First-order approximation of Gram-Schmidt orthonormalization beats deflation in coupled PCA learning rules

Neurocomputing

Volumn 69, Issue 13-15, 2006, Pages 1582-1590

  Möller, Ralf ^a  

^a BIELEFELD UNIVERSITY   (Germany)

Author keywords

Coupled learning rules; Deflation; Gram Schmidt method; Orthonormalization; Principal component analysis

Indexed keywords

ALGORITHMS; APPROXIMATION THEORY; EIGENVALUES AND EIGENFUNCTIONS; ESTIMATION; RANDOM PROCESSES;

COUPLED LEARNING RULES; DEFLATION; GRAM-SCHMIDT METHOD; ORTHONORMALIZATION;

PRINCIPAL COMPONENT ANALYSIS;

ALGORITHM; ARTICLE; COMPUTER ANALYSIS; CONTROLLED STUDY; LEARNING; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; QUALITY CONTROL; STANDARDIZATION; STOCHASTIC MODEL;

EID: 33745214236     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2005.06.016     Document Type: Article

References (16)

1. Bannour S., and Azimi-Sadjadi M.R. Principal component extraction using recursive least squares learning. IEEE Trans. Neural Networks 6 2 (1995) 457-469
2. Chen L.-H., and Chang S. An adaptive learning algorithm for principal component analysis. IEEE Trans. Neural Networks 6 5 (1995) 1255-1263
3. Diamantaras K.I., and Kung S.Y. Principal component neural networks, Theory and Applications (1996), Wiley, New York
4. Hornik K., and Kuan C.-M. Convergence analysis of local feature extraction algorithms. Neural Networks 5 2 (1992) 229-240
5. Miao Y. Comments on "Principal component extraction using recursive least squares learning". IEEE Trans. Neural Networks 7 4 (1996) 1052
6. Möller R. Interlocking of learning and orthonormalization in RRLSA. Neurocomputing 49 1-4 (2002) 429-433
7. Möller R., and Hoffmann H. An extension of neural gas to local PCA. Neurocomputing 62 (2004) 305-326
8. Möller R., and Könies A. Coupled principal component analysis. IEEE Trans. Neural Networks 15 1 (2004) 214-222
9. Oja E. A simplified neuron model as principal component analyzer. J. Math. Biol. 15 (1982) 267-273
10. Oja E. Principal components, minor components, and linear neural networks. Neural Networks 5 6 (1992) 927-935
11. E. Oja, J. Karhunen, On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix, Report TKK-F-A458, Helsinki University of Technology, Department of Technical Physics, 1981.
12. Oja E., and Karhunen J. On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix. J. Math. Anal. Appl. 106 1 (1985) 69-84
13. Ouyang S., Bao Z., and Liao G.-S. Robust recursive least squares algorithm for principal component analysis. IEEE Trans. Neural Networks 11 1 (2000) 215-221
14. Sanger T.D. Optimal unsupervised learning in a single-layer linear feed-forward neural network. Neural Networks 2 6 (1989) 459-473
15. Wang L., and Karhunen J. A unified neural bigradient algorithm for robust PCA and MCA. Int. J. Neural Systems 7 1 (1996) 53-67
16. Yang B. Projection approximation subspace tracking. IEEE Trans. Signal Process. 43 1 (1995) 95-107