Algorithms for accelerated convergence of adaptive PCA

IEEE Transactions on Neural Networks

Volumn 11, Issue 2, 2000, Pages 338-355

  Chatterjee, Chanchal ^b   Kang, Zhengjiu ^a,c   Roychowdhury, Vwani P ^c  

^a IEEE

^b BAE SYSTEMS   (United States)

^c UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

CONVERGENCE OF NUMERICAL METHODS; PROBLEM SOLVING; STATISTICAL METHODS;

ADAPTIVE PRINCIPAL COMPONENT ANALYSIS (PCA);

ADAPTIVE ALGORITHMS;

EID: 0033750718     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/72.839005     Document Type: Article

References (25)

1. M. Artin, Algebra. Englewood Cliffs, NJ: Prentice-Hall, 1991.
2. P. Baldi and K. Hornik, "Learning in linear neural networks: A survey," IEEE Trans. Neural Networks, vol. 6, pp. 837-857, 1995.
3. S. Bannour and M. R. Azimi-Sadjadi, "Principal component extraction using recursive least squares learning," IEEE Trans. Neural Networks, vol. 6, pp. 457-469, 1995.
4. A. Benveniste, A. Metivier, and P. Priouret, Adaptive Algorithms and Stochastic Approximations. New York: Springer-Verlag, 1990.
5. C. Chatterjee, V. P. Roychowdhury, and E. K. P. Chong, "On relative convergence properties of principal component analysis algorithms," IEEE Trans. Neural Networks, vol. 9, pp. 319-329, March 1998.
6. C. Chatterjee, V. P. Roychowdhury, M. D. Zoltowski, and J. Ramos, "Self-organizing and adaptive algorithms for generalized eigendecomposition," IEEE Trans. Neural Networks, vol. 8, pp. 1518-1530, November 1997.
7. Y. Chauvin, "Principal component analysis by gradient descent on a constrained linear Hebbian cell," in Proc. Joint Int. Conf. Neural Networks, vol. I, San Diego, CA, 1989, pp. 373-380.
8. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. New York: Wiley, 1993.
9. Z. Fu and E. M. Dowling, "Conjugate gradient eigenstructure tracking for adaptive spectral estimation," IEEE Trans. Signal Processing, vol. 43, pp. 1151-1160, 1995.
10. _, "Conjugate gradient projection subspace tracking," in Proc. 1994 Conf. Signals, Syst. Comput., vol. 1, Pacific Grove, CA, 1994, pp. 612-618.
11. G. H. Golub and C. F. VanLoan, Matrix Computations. Baltimore, MD: Johns Hopkins Univ. Press, 1983.
12. S. Haykin, Neural Networks - A Comprehensive Foundation. New York: Macmillan, 1994.
13. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Automat. Contr., vol. AC-22, no. 4, pp. 551-575, August 1977.
14. D. Luenberger, Linear and Nonlinear Programming. Reading, MA: Addison-Wesley, 1984.
15. G. Mathew, V. U. Reddy, and S. Dasgupta, "Adaptive estimation of eigensubspace," IEEE Trans. Signal Processing, vol. 43, pp. 401-411, 1995.
16. Y. Miao and Y. Hua, "Fast subspace tracking and neural-network learning by a novel information criterion," IEEE Trans. Signal Processing, vol. 46, pp. 1967-1979, 1998.
17. E. Oja and J. Karhunen, "On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix," J. Math. Anal. Applicat., vol. 106, pp. 69-84, 1985.
18. M. Plumbley, "Lyapunov function for convergence of principal component algorithms," Neural Networks, vol. 8, pp. 11-23, 1995.
19. T. Okada and S. Tomita, "An optimal orthonormal system for discriminant analysis," Pattern Recognition, vol. 18, no. 2, pp. 139-144, 1985.
20. T. D. Sanger, "Optimal unsupervised learning in a single-layer linear feedforward neural network," Neural Networks, vol. 2, pp. 459-473, 1989.
21. T. K. Sarkar and X. Yang, "Application of the conjugate gradient and steepest descent for computing the eigenvalues of an operator," Signal Processing, vol. 17, pp. 31-38, 1989.
22. L. Xu, "Least mean square error reconstruction principle for self-organizing neural-nets," Neural Networks, vol. 6, pp. 627-648, 1993.
23. B. Yang, "Projection approximation subspace tracking," IEEE Trans. Signal Processing, vol. 43, no. 1, pp. 95-107, 1995.
24. X. Yang, T. K. Sarkar, and E. Arvas, "A survey of conjugate gradient algorithms for solution of extreme eigen-problems of a symmetric matrix," IEEE Trans. Acoust., Speech, Signal Processing, vol. 37, pp. 1550-1556, 1989.
25. W. Zhu and Y. Yang, "Regularized total least squares reconstruction for optical tomographic imaging using conjugate gradient method," in Proc. Int. Conf. Image Processing, vol. 1, Santa Barbara, CA, 1997, pp. 192-195.