Neural learning by geometric integration of reduced 'rigid-body' equations

Journal of Computational and Applied Mathematics

Volumn 172, Issue 2, 2004, Pages 247-269

  Celledoni, Elena ^a   Fiori, Simone ^b  

^a SINTEF   (Norway)

^b UNIVERSITY OF PERUGIA   (Italy)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; BINDERS; COMPUTATIONAL COMPLEXITY; DATA PROCESSING; INDEPENDENT COMPONENT ANALYSIS; INTEGRATION; NUMERICAL ANALYSIS;

LEARNING DYNAMICS; ORTHONORMAL LEARNING; REAL-WORLD DATA; STEIFOLD MANIFOLD;

NEURAL NETWORKS;

ALGORITHM; MATHEMATICAL METHOD;

EID: 5044233142     PISSN: 03770427     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.cam.2004.02.007     Document Type: Article

References (45)

1. S. Affes, Y. Grenier, A signal subspace tracking algorithm for speech acquisition and noise reduction with a microphone array, Proceedings of the IEEE/IEE Workshop on Signal Processing Methods in Multipath Environments, 1995, 64-73.
2. Amari S.-I. Natural gradient works efficiently in learning Neural Comput. 10 1998 251-276
3. Bayro-Corrochano E. Geometric neural computation IEEE Trans. Neural Networks 12 5 2001 968-986
4. Bell A.J. Sejnowski T.J. An information maximisation approach to blind separation and blind deconvolution Neural Comput. 7 6 1995 1129-1159
5. Bredon G.E. Topology and Geometry 1995 Springer New York
6. Bridges T.J. Reich S. Computing Lyapunov exponents on a Stiefel manifold Phys. D 156 2001 219-238
7. Brockett R.W. Dynamical systems that sort lists, diagonalize matrices and solve linear programming problems Linear Algebra Appl. 146 1991 79-91
8. Cardoso J.F. Laheld B. Equivariant adaptive source separation IEEE Trans. Signal Process. 44 12 1996 3017-3030
9. Celledoni E. Iserles A. Approximating the exponential form of a Lie algebra to a Lie group Math. Comp. 69 2000 1457-1480
10. Celledoni E. Owren B. A class of intrinsic schemes for orthogonal integration SIAM J. Numer. Anal. 21 2001 463-488
11. Celledoni E. Owren B. On the implementation of Lie group methods on the Stiefel manifold Numer. Algorithms 32 2003 163-183
12. Comon P. Independent component analysis, A new concept? Signal Process. 36 1994 287-314
13. P. Comon, E. Moreau, Improved contrast dedicated to blind separation in communications, Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1997, 3453-3456.
14. Costa S. Fiori S. Image compression using principal component neural networks Image Vision Comput. J. (special issue on "Artificial Neural Network for Image Analysis and Computer Vision") 19 9-10 2001 649-668
15. Dieci L. Van Vleck E. Computation of orthonormal factors for fundamental solution matrices Numer. Math. 83 1999 599-620
16. Edelman A. Arias T.A. Smith S.T. The geometry of algorithms with orthogonality constraints SIAM J. Matrix Anal. Appl. 20 2 1998 303-353
17. Ephraim Y. Van Trees L. A signal subspace approach for speech enhancement IEEE Trans. Speech Audio Process. 3 4 1995 251-266
18. Fiori S. Entropy optimization by the PFANN network: application to independent component analysis Network: Comput. Neural Systems 10 2 1999 171-186
19. Fiori S. Blind separation of circularly-distributed sources by neural extended APEX algorithm Neurocomputing 34 1-4 2000 239-252
20. Fiori S. Blind signal processing by the adaptive activation function neurons Neural Networks 13 6 2000 597-611
21. Fiori S. A theory for learning by weight flow on Stiefel-Grassman manifold Neural Comput. 13 7 2001 1625-1647
22. Fiori S. A theory for learning based on rigid bodies dynamics IEEE Trans. Neural Networks 13 3 2002 521-531
23. Fiori S. Unsupervised neural learning on Lie group Internat. J. Neural Systems 12 3-4 2002 219-246
24. Fiori S. A minor subspace algorithm based on neural Stiefel dynamics Internat. J. Neural Systems 12 5 2002 339-350
25. Fujiwara A. Amari S.-I. Gradient systems in view of information geometry Physica D 80 1995 317-327
26. Gao K. Ahmed M.O. Swamy M.N. A constrained anti-Hebbian learning algorithm for total least-squares estimation with applications to adaptive FIR and IIR filtering IEEE Trans. Circuits Systems - Part II 41 11 1994 718-729
27. Golub G.H. Van Loan C.F. Matrix Computations 1996 The John Hopkins University Press Baltimore, MD
28. Hairer E. Lubich C. Wanner G. Geometric Numerical Integration, Springer Series in Computational Mathematics 2002 Springer Berlin
29. R.A. Horn, C.R. Johnson, Topics in Matrix Analysis, Cambridge Univeristy Press, Cambridge, 1995 (Reprinted Edition).
30. Iserles A. Munthe-Kaas H.Z. Nørsett S.P. Zanna A. Lie-group methods Acta Numer. 9 2000 215-365
31. Kivinen J. Warmuth M. Exponentiated gradient versus gradient descent for linear predictors Inform. Comput. 132 1997 1-64
32. R.-W. Liu, Blind signal processing: an introduction, Proceedings of the International Symposium on Circuits and Systems (IEEE-ISCAS), Vol. 2, 1996, 81-84.
33. Moore B.C. Principal component analysis in linear systems: controllability, observability and model reduction IEEE Trans. Automatic Control AC-26 1 1981 17-31
34. Niemann H. Wu J.-K. Neural network adaptive image coding IEEE Trans. Neural Networks 4 4 1993 615-627
35. Y. Nishimori, Learning algorithm for ICA by geodesic flows on orthogonal group, Proceedings of the International Joint Conference on Neural Networks (IJCNN'99), Vol. 2, 1999, 1625-1647.
36. Oja E. Neural networks, principal components and subspaces Internat. J. Neural Systems 1 1989 61-68
37. Oja E. Hyvärinen A. Hoyer P. Image feature extraction and denoising by sparse coding Pattern Anal. Appl. J. 2 2 1999 104-110
38. Parlett B. A recurrence among the elements of functions of triangular matrices Linear Algebra Appl. 14 1976 117-121
39. P. Saisan, G. Doretto, Y.N. Wu, S. Soatto, Dynamic texture recognition, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, December 2001, 58-63.
40. Sona D. Sperduti A. Starita A. Discriminant pattern recognition using transformation invariant neurons Neural Comput. 12 6 2000 1355-1370
41. I.-T. Um, J.-J. Wom, M.-H. Kim, Independent component based Gaussian mixture model for speaker verification, Proceedings of the Second International ICSC Symposium on Neural Computation (NC), 2000, 729-733.
42. Xu L. Oja E. Suen C.Y. Modified Hebbian learning for curve and surface fitting Neural Networks 5 1992 393-407
43. Yang B. Projection approximation subspace tracking IEEE Trans. Signal Process. 43 1 1995 1247-1252
44. Yang H.H. Amari S.-I. Adaptive online learning algorithms for blind separation: maximum entropy and minimal mutual information Neural Comput. 9 1997 1457-1482
45. Zhang K. Sejnowski T.J. A theory of geometric constraints on neural activity for natural three-dimensional movement J. Neurosci. 19 8 1999 3122-3145