Low-rank approximations with applications to principal singular component learning systems

Proceedings of the IEEE Conference on Decision and Control

Volumn , Issue , 2008, Pages 3293-3298

  Hasan, Mohammed A ^a  

^a UNIVERSITY OF MINNESOTA DULUTH   (United States)

Author keywords

Asymptotic stability; Constrained optimization; Dynamical system; Global convergence; Principal singular flow; Stiefel manifold; SVD

Indexed keywords

APPROXIMATION THEORY; ASYMPTOTIC STABILITY; CONSTRAINED OPTIMIZATION; DYNAMICAL SYSTEMS; MATRIX ALGEBRA; SINGULAR VALUE DECOMPOSITION;

ACCURATE COMPUTATIONS; GLOBAL CONVER-GENCE; LOW RANK APPROXIMATIONS; NUMERICAL EXPERIMENTS; OBJECTIVE FUNCTIONS; PRINCIPAL SINGULAR FLOW; STIEFEL MANIFOLD; UNCONSTRAINED OPTIMIZATION;

LEARNING SYSTEMS;

EID: 62949173714     PISSN: 07431546     EISSN: 25762370     Source Type: Conference Proceeding    
DOI: 10.1109/CDC.2008.4739112     Document Type: Conference Paper

References (20)

1. A. Cichocki, "Neural network for singular value decomposition," Electron. Lett., vol. 28, pp. 784-786, 1992.
2. A. Cichocki and R. Unbehauen, Neural Networks for Optimization and Signal Processing. New York: Wiley, 1994.
3. H. Chen and R.-W. Liu, "An online unsupervised learning machine for adaptive feature extraction," IEEE Trans. Circuits Syst., vol. 41, pp. 87-98, Feb. 1994.
4. U. Helmke and J. B. Moore, "Singular value decomposition via gradient and self-equivalent flows," Linear Algebra Appl., vol. 169, pp. 223-248, 1992.
5. J. B. Moore, R. E. Mahony, and U. Helmke, "Numerical gradient algorithms for eigenvalues and singular value calculations," SIAM J. Matrix Anal. Appl., vol. 15, pp. 881902, 1994.
6. S. T. Smith, "Dynamic system that perform the singular value decomposition," Syst. Control Lett., vol. 15, pp. 319-327, 1991.
7. M. T. Chu and K. R. Dressel, "The projected gradient method for least squares matrix approximations with spectral constraints," SIAM J. Numer. Anal., vol. 27, pp. 1050-1060, 1990.
8. Hori, G., "A general framework for SVD flows and joint SVD flows," Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing, 2003 (ICASSP '03), Volume: 2, 6-10, April 2003, pp:II-693-696.
9. P. Strobach, "Bi-iteration SVD subspace tracking algorithms," IEEE Trans. Signal Processing, vol. 45, No. 5, pp. 1222-1240, 1997.
10. Shan Ouyang; Yingbo Hua, "Bi-iterative least square versus bi-iterative singular value decomposition for subspace tracking," Proceedings, Acoustics, Speech, and Signal Processing, 2004 (ICASSP '04), Volume: 2, 17-21 May 2004, pp-353-356.
11. A. Cichocki, "Neural network for singular value decomposition," Electron. Lett., vol. 28, pp. 784786, 1992.
12. E. Kokiopoulou, C. Bekas, E. Gallopoulos, "Computing smallest singular triplets with implicitly restarted Lanczos bidiagonalization," Applied Numerical Mathematics archive, Volume 49, Issue 1, April 2004, Pages: 39-61
13. A. L. Yuile, D. M. Kammen, and D. S. Cohen, Quadrature and develop-ment of orientation selective cortical cells by Hebb rules, Biol. Cybern., vol. 61, pp. 183194, 1989.
14. N. Samardzija and R. L. Waterland, "A neural network for computing eigenvectors and eigenvalues," Biol. Cybern., vol. 65, no. 4, pp. 211214.
15. K. I. Diamantaras and S. Y. Kung, "Cross-correlation neural network models," IEEE Trans. Signal Processing, vol. 42, pp. 32183223, Nov. 1994.
16. Da-Zheng Feng; Xian-Da Zhang; Zheng Bao, "A neural network learning for adaptively extracting cross-correlation features between two high-dimensional data streams," IEEE Transactions on Neural Networks, Volume: 15, Issue: 6, pp. 1541-1554, Nov. 2004.
17. Shan Ouyang; Zheng Bao; Gui-Sheng Liao; Ching, P.C., "Adaptive minor component extraction with modular structure," IEEE Transactions on Signal Processing, Volume: 49, Issue: 9, pp:2127-2137, Sept. 2001.
18. Hasan, M.A., "Constrained quadratic optimization problems with applications," Proceedings of the American Control Conference, June 8-10, 2005 Page(s):243-248.
19. J. J. E. Slotine and W. Li. Applied nonlinear Comtrol. Prentice Hall, 1991.
20. A. Edelman, T. A. Arias and S. T. Smith, "The geometry of algorithms with orthogonality constraints" SIAM J. Matrix Anal. Appl., 20(2):303-353, 1998.