A unified algorithm for principal and minor components extraction

Neural Networks

Volumn 11, Issue 3, 1998, Pages 385-390

  Chen, Tianping ^a   Amari, Shun Ichi ^b   Lin, Qin ^a  

^a FUDAN UNIVERSITY   (China)

^b RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

Author keywords

Dynamical system; Minor component extraction; Natural gradient; Principal component extraction; Singular value decomposition

Indexed keywords

DATA PROCESSING; DIFFERENTIAL EQUATIONS; EIGENVALUES AND EIGENFUNCTIONS; LYAPUNOV METHODS; MATRIX ALGEBRA; NEURAL NETWORKS;

GRADIENT DESCENT ALGORITHM; MINOR COMPONENT EXTRACTION; PRINCIPAL COMPONENT EXTRACTION; SINGULAR VALUE DECOMPOSITION;

ALGORITHMS;

ALGORITHM; ARTICLE; ARTIFICIAL NEURAL NETWORK; INFORMATION RETRIEVAL; INFORMATION SYSTEM; PRIORITY JOURNAL;

EID: 0345627997     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(98)00004-5     Document Type: Article

References (20)

1. Amari S. Neural theory of association and concept-formation. Biology Cybernetics. 26:1977;175-185.
2. Amari, S. (1985) Differential-Geometrical Methods of Statistics. Springer Lecture Notes in Statistics, 28. Springer, New York.
3. Amari, S. (1997a) Information geometry. In Nencka, H., Bourguignon, J.-P. (Eds.), Geometry and Nature. Contemporary Mathematics, 203. American Mathematical Society, Rhode Island, pp. 81-95.
4. Amari S. Natural gradient works efficiently. Neural Computation. 10:1997;251-276.
5. Amari S., Chen T.-P., Cichocki A. Stability analysis of learning algorithms for blind source separation. Neural Networks. 10:1997;1345-1351.
6. Amari S., Chen T.-P., & Cichocki A. (1998) Nonholonomic orthogonal constraints in adaptive blind source separation. Neural Computation, submitted.
7. Brockett R.W. Least square matching problems. Linear Algebra and its Applications. 122-124:1989;761-777.
8. Brockett R.W. Dynamical systems that sort lists, diagonalize matrices, and solve linear programming problems. Linear Algebra and its Applications. 146:1991;79-91.
9. Chen T.-P., Hua Y., Yan W.Y. Global convergence of Oja's subspace algorithm for principal component extraction. IEEE Transactions on Neural Networks. 9:1998;58-67.
10. Chen T.-P. Modified Oja's algorithms for principal subspace and minor subspace extraction. Neural Processing Letters. 5:1997;105-110.
11. Fujiwara A., Amari S. Gradient systems in view of information geometry. Physica D. 80:1995;317-327.
12. Helmke, U., Moore, J.B. 1993. Optimization and Dynamical Systems. Springer, New York.
13. Nakamura Y. Completely integrable gradient systems on the manifold of Gaussian and multinomial distributions. Japan Journal of Applied and Industrial Mathematics. 10:1993;179-189.
14. Oja E. A simplified neuron model as a principal component analyzer. J. Math. Biology. 15:1982;267-273.
15. Oja E., Karhunen J. On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix. Journal of Mathematical Analysis and Applications. 106:1985;69-84.
16. Oja E. Principal components, minor components, and linear neural networks. Neural Networks. 5:1992;927-935.
17. Sanger T.D. Optimal unsupervised learning in a single-layer linear feedforward network. Neural Networks. 2:1989;459-573.
18. Xu L., Oja E., Suen C. Modified Hebbian learning for curve and surface fitting. Neural Networks. 5:1992;441-457.
19. Xu L. Least mean square error recognition principle for self organizing neural nets. Neural Networks. 6:1993;627-648.
20. Wang L., Karhunen J. A unified neural bigradient algorithm for robust PCA and MCA. International Journal of Neural Systems. 7:1996;53-67.