Dynamics of generalized PCA and MCA learning algorithms

IEEE Transactions on Neural Networks

Volumn 18, Issue 6, 2007, Pages 1777-1784

  Peng, Dezhong ^a   Yi, Zhang ^a  

^a UNIVERSITY OF ELECTRONIC SCIENCE AND TECHNOLOGY OF CHINA   (China)

Author keywords

Deterministic discrete time (DDT) system; Eigenvalue; Eigenvector; Minor component analysis (MCA); Principal component analysis (PCA)

Indexed keywords

COMPUTER SIMULATION; CONTINUOUS TIME SYSTEMS; DATA REDUCTION; EIGENVALUES AND EIGENFUNCTIONS; NEURAL NETWORKS; PRINCIPAL COMPONENT ANALYSIS; SIGNAL PROCESSING;

DETERMINISTIC CONTINUOUS-TIME METHOD; DETERMINISTIC DISCRETE-TIME METHOD; MINOR COMPONENT ANALYSIS;

LEARNING ALGORITHMS;

EID: 36349012545     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2007.895821     Document Type: Article

References (26)

1. K. I. Diamantaras and S. Y. Kung, Principal Component Neural Networks: Theory and Applications. New York: Wiley, 1996.
2. A. Cichocki and S. I. Amari, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. New York: Wiley, 2002.
3. L. Xu, E. Oja, and C. Suen, "Modified Hebbian learning for curve and surface fitting," Neural Netw., vol. 5, pp. 441-457, 1992.
4. J. W. Griffiths, "Adaptive array processing, a tutorial," Proc. Inst. Elect. Eng. F - Commun. Radar Signal Process., vol. 130, no. 1, pp. 3-10, 1983.
5. R. Schmidt, "Multiple emitter location and signal parameter estimation," IEEE Trans. Antennas Propagat., vol. AP-34, no. 3, pp. 276-280, Mar. 1986.
6. S. Barbarossa, E. Daddio, and G. Galati, "Comparison of optimum and linear prediction technique for clutter cancellation," Proc. Inst. Elect. Eng. F - Commun. Radar Signal Process., vol. 134, no. 3, pp. 277-282, 1987.
7. F. Luo and R. Unbehauen, "A minor subspace analysis algorithm," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 1149-1155, Sep. 1997.
8. D. Feng, W. Zheng, and Y. Jia, "Neural network learning algorithms for tracking minor subspace in high-dimensional data stream," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 513-521, May 2005.
9. G. Cirrincione, M. Cirrincione, J. Herault, and S. V. Huffel, "The MCA EXIN neuron for the minor component analysis," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 160-187, Jan. 2002.
10. M. V. Jankovic and H. Ogawa, "Modulated Hebb-Oja learning rule - A method for principal subspace analysis," IEEE Trans. Neural Netw. vol. 17, no. 2, pp. 345-356, Mar. 2006.
11. R. Möller and A. Könies, "Coupled principal component analysis," IEEE Trans. Neural Netw., vol. 15, no. 1, pp. 214-222, Jan. 2004.
12. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Autom. Control, vol. AC-22, no. 4, pp. 551-575, Aug. 1977.
13. P. J. Zufiria, "On the discrete-time dynamics of the basic Hebbian neural-network nodes," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1342-1352, Nov. 2002.
14. Q. Zhang, "On the discrete-time dynamics of a PCA learning algorithm," Neurocomputing, vol. 55, pp. 761-769, 2003.
15. Z. Yi, M. Ye, J. C. Lv, and K. K. Tan, "Convergence analysis of a deterministic discrete time system of Oja's PCA learning algorithm," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1318-1328, Nov. 2005.
16. D. Peng and Z. Yi, "Convergence analysis of an effective MCA learning algorithm," in Proc. Int. Conf. Neural Netw. Brain, 2005, pp. 2003-2008.
17. D. Peng and Z. Yi, "Convergence analysis of a deterministic discrete time system of Feng's MCA learning algorithm," IEEE Trans. Signal Process., vol. 54, no. 9, pp. 3626-3632, Sep. 2006.
18. M. Ye, X. Fan, and X. Li, "A class of self-stabilizing MCA learning algorithms," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1634-1638, Nov. 2006.
19. J. C. Lv, Z. Yi, and K. K. Tan, "Global convergence of Oja's PCA learning algorithm with a non-zero-approaching adaptive learning rate," Theoretical Comput. Sci., vol. 367, pp. 286-307, 2006.
20. J. C. Lv, Z. Yi, and K. K. Tan, "Convergence analysis of xu's LMSER learning algorithm via deterministic discrete time system method," Neurocomputing, vol. 70, pp. 362-372, 2006.
21. F. L. Luo and R. Unbehauen, "A generalized learning algorithm of minor component," in Proc. Int. Conf. Acoust., Speech, Signal Process., 1997, vol. 4, pp. 3229-3232.
22. Q. Zhang and Z. Bao, "Dynamical system for computing the eigenvalue of a positive definite matrix," IEEE Trans. Neural Netw., vol. 6, no. 3, pp. 790-791, May 1995.
23. Q. Zhang and Y. Leung, "A class of learning algorithms for principal component analysis and minor component analysis," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 529-533, Mar. 2000.
24. C. Chatterjee, Z. Kang, and V. P. Roychowdhury, "Algorithm for accelerated convergence of adaptive PCA," IEEE Trans. Neural Netw. vol. 11, no. 2, pp. 338-355, Mar. 2000.
25. S. Haykin, Neural Networks: A Comprehensive Foundation, 2nd ed. Hamilton, ON, Canada: McMaster Univ. Press, 2001.
26. F. M. Ham and I. Kostanic, Principles of Neurocomputing for Science & Engineering. New York: McGraw-Hill, 2003.