Singular value decomposition learning on double Stiefel manifold

International Journal of Neural Systems

Volumn 13, Issue 3, 2003, Pages 155-170

  Fiori, Simone ^a  

^a UNIVERSITY OF PERUGIA   (Italy)

Author keywords

Differential geometry; Lyapunov stability; Orthogonal matrix group; Singular value decomposition; Stiefel manifold

Indexed keywords

EID: 29644438181     PISSN: 01290657     EISSN: None     Source Type: Journal    
DOI: 10.1142/S0129065703001406     Document Type: Article

References (33)

1. S.-I. Amari 1998, "Natural gradient works efficiently in learning," Neural Computation 10, 251-276.
2. H. Bourlard and Y. Kamp 1988, "Auto-association by multilayer perceptrons and singular value decomposition," Biological Cybernetics 59, 291-294.
3. R. W. Brockett 1991, "Dynamical systems that sort lists, diagonalize matrices and solve linear programming problems," Linear Algebra and Its Applications 146, 79-91.
4. T.-P. Chen, S.-I. Amari and Q. Lin 1998, "A unified algorithm for principal and minor component extraction," Neural Networks 11, 385-390.
5. A. Cichocki and R. Unbehauen 1992, "Neural networks for computing eigenvalues and eigenvectors," Biological Cybernetics 68, 155-164.
6. S. Costa and S. Fiori 2001, "Image compression using principal component neural networks," Image and Vision Computing Journal (special issue on "Artificial Neural Network for Image Analysis and Computer Vision"), 19(9-10), 649-668.
7. E. F. Deprette (ed.) 1988, SVD and Signal Processing (Amsterdam, Elsevier Science).
8. K. I. Diamantaras and S.-Y. Kung 1994, "Cross-correlation neural network models," IEEE Trans. on Signal Processing 42(11), 3218-3223.
9. S. Fiori 2001, "A theory for learning by weight flow on Stiefel-Grassman manifold," Neural Computation 13(7), 1625-1647.
10. S. Fiori 2002, "A theory for learning based on rigid bodies dynamics," IEEE Trans. on Neural Networks 13(3), 521-531.
11. S. Fiori 2002, "Complex-weighted one-unit 'Rigid-Bodies' learning rule for independent component analysis," Neural Processing Letters 15(3), 275-282.
12. S. Fiori 2002, "Unsupervised neural learning on Lie group," International Journal of Neural Systems 12(3 & 4), 219-246.
13. S. Fiori, "A minor subspace algorithm based on neural Stiefel dynamics," International Journal of Neural Systems 12(5), 339-350.
14. W. Fulton and J. Harris 1991, Representation Theory (New York: Springer-Verlag)
15. G. H. Goulb and C. F. van Loan 1996, Matrix Computations (The John Hopkins University Press, third edition).
16. W. Hahn 1963, Theory and Application of Lya-punov's Direct Method (Englewood Cliffs, New Jersey: Prentice-Hall)
17. S. Haykin 1991, Adaptive Filter Theory (Prentice-Hall).
18. U. Helmke and J. B. Moore 1992, "Singular value decomposition via gradient and self-equivalent flows," Linear Algebra and its Applications 169, 223-248.
19. U. Helmke and J. B. Moore 1993, Optimization and Dynamical Systems (Springer-Verlag, Berlin)
20. N. Jacobson 1979, Lie Algebras (New York: Dover).
21. A. K. Jain 1989, Fundamentals of Digital Image Processing (Englewood Cliffs, NJ: Prentice-Hall)
22. W.-S. Lu, H.-P. Wang and A. Antoniou 1990, "Design of two-dimensional FIR digital filters by using the singular value decomposition," IEEE Trans. on Circuits and Systems CAS-37, 35-46.
23. J. R. Magnus and H. Neudecker 1988, Matrix Differential Calculus With Applications in Statistics and Econometrics (Wiley Series in Probability and Mathematical Statistics, John Wiley & Sons).
24. B. C. Moore 1981, "Principal component analysis in linear systems: Controllability, observability and model reduction," IEEE Trans. on Automatic Control AC-26(1), 17-31.
25. O. Nestares and R. Navarro 2001, "Probabilistic estimation of optical flow in multiple band-pass directional channels," Image and Vision Computing Journal 19(6), 339-351.
26. E. Oja, "Neural networks, principal components and subspaces," International Journal of Neural System 1, 61-68.
27. T. D. Sanger 1994, "Two iterative algorithms for computing the singular value decomposition from input/output samples," in J. D. Cowan, G. Tesauro and J. Alspector (eds), Morgan-Kauffman Publishers Inc., Advances in Neural Processing Systems 6, 1441-151.
28. M. Salmeron, J. Ortega, C. G. Puntonet and A. Prieto 2001, "Improved RAN sequential prediction using orthogonal techniques," Neurocomputing 41(1-4), 153-172.
29. T. Sasagawa 1982, "On the finite escape phenomena for matrix Riccati equations," IEEE Trans. on Automatic Control AC-27(4), 977-979.
30. S. T. Smith 1991, "Dynamic system that perform the SVD," Systems and Control Letters 15, 319-327.
31. R. Vaccaro (ed.) 1991, SVD and Signal Processing II: Algorithms, Analysis and Applications (Amsterdam, Elsevier Science)
32. A. Weingessel and K. Hornik 1997, "SVD algorithms: APEX-like versus subspace methods," Neural Processing Letters 5, 177-184.
33. A. Weingessel 1999, An Analysis of Learning Algorithms in PCA and SVD Neural Networks (Ph.D. Dissertation, Technical University of Wien, Austria).