On the discrete-time dynamics of a class of self-stabilizing MCA extraction algorithms

IEEE Transactions on Neural Networks

Volumn 21, Issue 1, 2010, Pages 175-181

  Kong, Xiangyu ^a   Hu, Changhua ^a   Han, Chongzhao ^b  

^a XI'AN RESEARCH INSTITUTE OF HIGH TECHNOLOGY   (China)

^b XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

Deterministic discrete time (DDT) system; Feature extraction; Minor component analysis (MCA); Neural networks

Indexed keywords

AUTOCORRELATION MATRIX; CONVERGENCE AND STABILITY; DATA ANALYSIS; DISCRETE TIME DYNAMICS; DISCRETE-TIME; EIGENVECTORS; EXTRACTION ALGORITHMS; MINOR COMPONENT ANALYSIS; MINOR COMPONENT ANALYSIS (MCA); MINOR COMPONENTS; SELF-STABILIZING ALGORITHM; SMALLEST EIGENVALUE; SUFFICIENT CONDITIONS; SYSTEM FEATURES; THEORETICAL RESULT;

CONVERGENCE OF NUMERICAL METHODS; DATA PROCESSING; EIGENVALUES AND EIGENFUNCTIONS; FEATURE EXTRACTION; MAGNETIC LOGIC DEVICES; NEURAL NETWORKS; SIGNAL PROCESSING;

LEARNING ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; HUMAN; INFORMATION RETRIEVAL; NONLINEAR SYSTEM; PRINCIPAL COMPONENT ANALYSIS; SIGNAL PROCESSING; TIME;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; HUMANS; INFORMATION STORAGE AND RETRIEVAL; NONLINEAR DYNAMICS; PRINCIPAL COMPONENT ANALYSIS; SIGNAL PROCESSING, COMPUTER-ASSISTED; TIME FACTORS;

EID: 73949148863     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2009.2036725     Document Type: Article

References (25)

1. V. U. Reddy, B. Egardt, and T. Kailath, "Least squares type algorithm for adaptive implementation of Pisarenko's harmonic retrieval method," IEEE Trans. Acoust. Speech Signal Process., vol. ASSP-30, no. 3, pp. 399-405, Jun. 1982.
2. L. Xu, E. Oja, and C. Suen, "Modified Hebbian learning for curve and surface fitting," Neural Netw., vol. 5, pp. 441-457, 1992.
3. E. Oja, "Principal component, minor component and linear neural networks," Neural Netw., vol. 5, no. 6, pp. 927-935, 1992.
4. D. Z. Feng, Z. Bao, and L. C. Jiao, "Total least mean squares algorithm," IEEE Trans. Signal Process., vol. 46, no. 8, pp. 2122-2130, Aug. 1998.
5. D. Z. Feng, W. X. Zheng, and Y. Jia, "Neural network learning algorithms for tracking minor subspace in high-dimensional data stream," IEEE Trans. Neural Netw., vol. 16, no. 3, pp. 513-521, May 2005.
6. F. L. Luo and R. Unbehauen, "A minor subspace analysis algorithm," IEEE Trans. Neural Netw., vol. 8, no. 5, pp. 1149-1155, Sep. 1997.
7. F. L. Luo and R. Unbehauen, "A generalized learning algorithm of minor component," in Proc. Int. Conf. Acoust. Speech Signal Process., 1997, vol. 4, pp. 3229-3232.
8. Q. Zhang, "On the discrete-time dynamics of a PCA learning algorithm," Neurocomputing, vol. 55, pp. 761-769, Oct. 2003.
9. G. Cirrincione, M. Cirrincione, J. Herault, and S. Van Huffel, "The MCA EXIN neuron for the minor component analysis," IEEE Trans. Neural Netw., vol. 13, no. 1, pp. 160-187, Jan. 2002.
10. S. Ouyang, Z. Bao, G. S. Liao, and P. C. Ching, "Adaptive minor component extraction with modular structure," IEEE Trans. Signal Process., vol. 49, no. 9, pp. 2127-2137, Sep. 2001.
11. Q. Zhang and Y.-W. Leung, "A class of learning algorithms for principal component analysis and minor component analysis," IEEE Trans. Neural Netw., vol. 11, no. 2, pp. 529-533, Mar. 2000. (Pubitemid 30861949)
12. R. M̈oller, "A self-stabilizing learning rule for minor component analysis," Int. J. Neural Syst., vol. 14, pp. 1-8, 2004.
13. T. Chen and S. Amari, "Unified stabilization approach to principal and minor components extraction," Neural Netw., vol. 14, pp. 1377-1387, 2001.
14. S. C. Douglas, S. Y. Kung, and S. Amari, "A self-stabilized minor subspace rule," IEEE Signal Process. Lett., vol. 5, no. 12, pp. 328-330, Dec. 1998.
15. P. J. Zufiria, "On the discrete-time dynamics of the basic Hebbian neural network node," IEEE Trans. Neural Netw., vol. 13, no. 6, pp. 1342-1352, Nov. 2002.
16. D. Peng, Z. Yi, and Y. Xiang, "On the discrete time dynamics of a self-stabilizing MCA learning algorithm," Math. Comput. Model., vol. 47, pp. 903-916, 2008.
17. D. Peng, Z. Yi, J. C. Lv, and Y. Xiang, "A stable MCA learning algorithm," Comput. Math. Appl., vol. 56, pp. 847-860, 2008.
18. M. Ye, X. Fan, and X. Li, "A class of self-stabilizing MCa learning algorithms," IEEE Trans. Neural Netw., vol. 17, no. 6, pp. 1634-1638, Nov. 2006.
19. H. J. Kushner and D. S. Clark, Stochastic Approximation Methods for Constrained and Unconstrained Systems. New York: Springer-Verlag, 1976.
20. L. Ljung, "Analysis of recursive stochastic algorithms," IEEE Trans. Autom. Control, vol. AC-22, no. 4, pp. 551-575, Aug. 1977.
21. J. P. LaSalle, The Stability of Dynamical Systems. Philadelphia, PA: SIAM, 1976.
22. J. R. Magnus and H. Neudecker, Matrix Differential CalculusWith Applications in Statistics and Econometrics, 2nd ed. New York: Wiley, 1991.
23. Z. Yi, M. Ye, J. C. Lv, and K. K. Tan, "Convergence analysis of a deterministic discrete time system of Oja's PCA learning algorithm," IEEE Trans. Neural Netw., vol. 16, no. 6, pp. 1318-1328, Nov. 2005.
24. M. A. Hasan, "Self-normalizing dual systems for minor and principal component extraction," in Proc. Int. Conf. Acoust. Speech Signal Process., 2007, vol. 4, pp. 885-888.
25. X. Y. Kong, C. Z. Han, and R. X. Wei, "Modified gradient algorithm for total least squares filtering," Neurocomputing, vol. 70, pp. 568-576, 2006.