Perturbation-based eigenvector updates for on-line principal components analysis and canonical correlation analysis

Journal of VLSI Signal Processing Systems for Signal, Image, and Video Technology

Volumn 45, Issue 1-2, 2006, Pages 85-95

  Hegde, Anant ^a   Principe, Jose C ^a   Erdogmus, Deniz ^b   Ozertem, Umut ^b   Rao, Yadunandana N ^c   Peddaneni, Hemanth ^d  

^a UNIVERSITY OF FLORIDA   (United States)

^b OREGON HEALTH AND SCIENCE UNIVERSITY   (United States)

^c MOTOROLA INC   (United States)

^d Neurotronics Inc   (United States)

Author keywords

Eigenvalue; Eigenvector; Principal component analysis (PCA)

Indexed keywords

CORRELATION METHODS; EIGENVALUES AND EIGENFUNCTIONS; OPTIMIZATION; PERTURBATION TECHNIQUES; SIGNAL PROCESSING; STATISTICAL METHODS;

CANONICAL CORRELATION ANALYSIS; DATA COVARIANCE MATRIX; HEBBIAN UPDATES; STATISTICAL CRITERION;

PRINCIPAL COMPONENT ANALYSIS;

EID: 33846390333     PISSN: 13875485     EISSN: None     Source Type: Journal    
DOI: 10.1007/s11265-006-9773-6     Document Type: Conference Paper

References (17)

1. R.O. Duda and P.E. Hart, "Pattern Classification and Scene Analysis," Wiley, New York, 1973.
2. S.Y. Kung, K.I. Diamantaras, and J.S. Taur, "Adaptive Principal Component Extraction (APEX) and Applications," IEEE Trans. Signal Process., vol. 42, no. 5, 1994, pp. 1202-1217.
3. J. Mao and A.K. Jain, "Artificial Neural Networks for Feature Extraction and Multivariate Data Projection," IEEE Trans. Neural Netw., vol. 6, no. 2, 1995, pp. 296-317.
4. Y. Cao, S. Sridharan, and M. Moody, "Multichannel Speech Separation by Eigendecomposition and its Application to Co-Talker Interference Removal," IEEE Trans. Speech Audio Process., vol. 5, no. 3, 1997, pp. 209-219.
5. G. Golub and C.V. Loan, "Matrix Computation," Johns Hopkins University Press, Baltimore, Maryland, 1993.
6. E. Oja, "Subspace Methods for Pattern Recognition," Wiley, New York, 1983.
7. T.D. Sanger, "Optimal Unsupervised Learning in a Single Layer Linear Feedforward Neural Network," Neural Netw., vol. 2, no. 6, 1989, pp. 459-473.
8. J. Rubner and K. Schulten, "Development of Feature Detectors by Self Organization," Biol. Cybern., vol. 62, 1990, pp. 193-199.
9. J. Rubner and P. Tavan, "A Self Organizing Network for Principal Component Analysis," Europhys. Lett., vol. 10, 1989, pp. 693-698.
10. L. Xu, "Least Mean Square Error Reconstruction Principle for Self-Organizing Neural-Nets," Neural Netw., vol. 6, 1993, pp. 627-648.
11. B. Yang, "Projection Approximation Subspace Tracking," IEEE Trans. Signal Process., vol. 43, no. 1, 1995, pp. 95-107.
12. Y. Hua, Y. Xiang, T. Chen, K. Abed-Meriam, and Y. Miao, "Natural Power Method for Fast Subspace Tracking," in Proceedings of NNSP'99, 1999, pp. 176-185.
13. Y.N. Rao and J.C. Principe, "Robust On-line Principal Component Analysis Based on a Fixed-Point Approach," in Proceedings of ICASSP'02, vol. 1, 2002, pp. 981-984.
14. D. Erdogmus, Y.N. Rao, K.E. Hild II, and J.C. Principe, "Simultaneous Principal Component Extraction with Application to Adaptive Blind Multiuser Detection," EURASTP J. Appl. Signal Process., vol. 2002, no. 12, 2002, pp. 1473-1484.
15. B. Champagne, "Adaptive Eigendecomposition of Data Covariance Matrices Based on First-Order Perturbations," IEEE Trans. Signal Process., vol. 42, no. 10, 1994, pp. 2758-2770.
16. J. Via, I. Santamaria, and J. Perez, "A Robust RLS Algorithm for Adaptive Canonical Correlation Analysis," in Proceedings of ICASSP'05, Philadelphia, Pennsylvania, 2005.
17. S. Haykin, "Adaptive Filter Theory," 4th ed., Prentice Hall, Upper Saddle River, New Jersey, 2001, pp. 231-319.