Learning principal directions: Integrated-squared-error minimization

Neurocomputing

Volumn 70, Issue 7-9, 2007, Pages 1372-1381

  Ahn, Jong Hoon ^a   Oh, Jong Hoon ^a   Choi, Seungjin ^a  

^a Pohang University of Science and Technology (POSTECH)   (South Korea)

Author keywords

EM algorithm; Generalized Hebbian algorithm; Generative models; PCA; Probabilistic coupled models; Separable LS

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; ERROR ANALYSIS; FEEDFORWARD NEURAL NETWORKS; OPTIMIZATION; PRINCIPAL COMPONENT ANALYSIS; PROBABILITY;

ERROR MINIMIZATION; GENERALIZED HEBBIAN ALGORITHM; INTEGRATED-SQUARED ERROR;

LEARNING SYSTEMS;

ALGORITHM; AMBIGUITY; ANALYTICAL ERROR; ARTICLE; ARTIFICIAL NEURAL NETWORK; INFORMATION PROCESSING; PRINCIPAL COMPONENT ANALYSIS; PRIORITY JOURNAL; PROBABILITY;

EID: 33847380221     PISSN: 09252312     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.neucom.2006.06.004     Document Type: Article

References (12)

1. J.H. Ahn, S. Choi, J.H. Oh, A new way of PCA: Integrated-squared-error and EM algorithms, in: Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing. Montreal, Canada, 2004.
2. Ahn J.H., and Oh J.H. A constrained EM algorithm for principal component analysis. Neural Comput. 15 1 (2003) 57-65
3. Choi S. Sequential EM learning for subspace analysis. Pattern Recognition Lett. 25 14 (2004) 1559-1567
4. Diamantaras K.I., and Kung S.Y. Principal Component Neural Networks: Theory and Applications (1996), Wiley, New York
5. Haykin S. Neural Networks: A Comprehensive Foundation. second ed. (1999), Prentice-Hall, Englewood Cliffs, NJ
6. Jolliffe I.T. Principal Component Analysis. second ed. (2002), Springer, Berlin
7. Karhunen J., and Joutsensalo J. Generalization of principal component analysis, optimization problems, and neural networks. Neural Networks 8 4 (1995) 549-562
8. Oja E. Neural networks, principal component analysis, and subspaces. Int. J. Neural Syst. 1 (1989) 61-68
9. Roweis S.T. EM algorithms for PCA and SPCA. Advances in Neural Information Processing Systems vol. 10 (1998), MIT Press, Cambridge 626-632
10. Sanger T.D. Optimal unsupervised learning in a single-layer linear feedforward neural network. Neural Networks 2 6 (1989) 459-473
11. Tipping M.E., and Bishop C.M. Mixtures of probabilistic principal component analyzers. Neural Computation 11 2 (1999) 443-482
12. Tipping M.E., and Bishop C.M. Probabilistic principal component analysis. J. Roy. Stat. Soc. B 61 3 (1999) 611-622