A theory for learning by weight flow on Stiefel-Grassman manifold

Neural Computation

Volumn 13, Issue 7, 2001, Pages 1625-1647

  Fiori, Simone ^a  

^a NONE

Author keywords

[No Author keywords available]

Indexed keywords

EID: 0001586142     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976601750265036     Document Type: Article

References (52)

1. Affes, S., & Grenier, Y. (1995). A signal subspace tracking algorithm for speech acquisition and noise reduction with a microphone array. In Proceedings of the IEEE/IEE Workshop on Signal Processing Methods in Multipath Environments (pp. 64-73).
2. Aluffi-Pentini, C., Parisi V., & Zirilli F. (1985). Global optimization and stochastic differential equations. Journal of Optimization Theory and Applications, 47, 1-16.
3. Amari, S.-i. (1998). Natural gradient works efficiently in learning. Neural Computation, 10, 251-276.
4. Amari, S.-i. (1999). Natural gradient learning for over- and under-complete bases in ICA. Neural Computation, 11, 1875-1883.
5. Barlow, H. B. (1994). What is the computational goal of neurocortex? In C. Koch & J. L. Davis (Eds.), Large-scale neuronal theories of the brain. Cambridge, MA: MIT Press.
6. Bell, A. J., & Sejnowski, T. J. (1995). An information maximisation approach to blind separation and blind deconvolution. Neural Computation, 7(6), 1129-1159.
7. Bertekas, D. P. (1982). Constrained optimization and Lagrange multiplier methods. Orlando, FL: Academic Press.
8. Brockett, R. W. (1991). Dynamical systems that sort lists, diagonalize matrices and solve linear programming problems. Linear Algebra and Its Applications, 146, 79-91.
9. Burel, G. (1992). Blind separation of sources: A nonlinear neural algorithm. Neural Networks, 5, 937-947.
10. Cardoso, J. F., & Laheld, B. (1996). Equivariant adaptive source separation. IEEE Transactions on Signal Processing, 44(12), 3017-3030.
11. Chen, T. P., Amari, S.-i., & Lin, Q. (1998). A unified algorithm for principal and minor components extraction. Neural Networks, 11(3), 385-390.
12. Cichocki, A., Karhunen, J., Kasprzak, W., & Vigario, R. (1999). Neural networks for blind separation with unknown number of sources. Neurocomputing, 24, 55-93.
13. Cichocki, A., & Unbehauen, R. (1993). Neural networks for optimization and signal processing. New York: Wiley.
14. Comon, P. (1994). Independent component analysis, a new concept? Signal Processing, 36, 287-314.
15. Comon, P., & Moreau, E. (1997). Improved contrast dedicated to blind separation in communications. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (pp. 3453-3456).
16. Deco, G., & Brauer, W. (1995). Nonlinear higher-order statistical decorrelation by volume-conserving neural architectures. Neural Networks, 8(4), 525-535.
17. Douglas, S. C., & Kung, S.-Y. (1999). An ordered-rotation KUICNET algorithm for separating arbitrarily-distributed sources. In Proceedings of the International Conference on Independent Component Analysis (pp. 81-86).
18. Douglas, S. C., Kung, S.-Y., & Amari, S.-i. (1998). A self-stabilized minor subspace rule. IEEE Signal Processing Letters, 5(12), 328-330.
19. Edelman, A., Arias, T. A., & Smith, S. T. (1998). The geometry of algorithms with orthogonality constraints. SIAM Journal on Matrix Analysis Applications, 20(2), 303-353.
20. Ephraim, Y., & Van Trees, L. (1995). A signal subspace approach for speech enhancement. IEEE Transactions on Speech and Audio Processing, 3(4), 251-266.
21. Fiori, S. (1996). Unsupervised neural artificial learning models for blind signal processing. Unpublished M.Eng. dissertation, University of Ancona, Italy.
22. Fiori, S. (1999). "Mechanical" neural learning applied to blind source separation. Electronics Letters, 35(22), 1963-1964.
23. Fiori, S., & Piazza, F. (1998). Orthonormal strongly-constrained neural learning. In Proceedings of the International Joint Conference on Neural Networks (pp. 2332-2337).
24. Fiori, S., & Piazza, F. (2000). Neural MCA for robust beamforming. In Proceedings of the International Symposium on Circuits and Systems (Vol. 3, pp. 614-617). Geneva, Switzerland.
25. Fiori, S., Uncini, A., & Piazza, F. (1997). Mechanical learning applied to principal component analysis and source separation. In Proceedings of the International Conference on Artificial Neural Networks (pp. 571-577). Berlin: Springer-Verlag.
26. Fiori, S., Uncini, A., & Piazza, F. (1998). Neural learning and weight flow on Stiefel manifold. In Proceedings of the Tenth Italian Workshop on Neural Networks (pp. 325-333). Berlin: Springer-Verlag.
27. Fyfe, C. (1995). A general exploratory projection pursuit network. Neural Processing Letters, 2(3), 17-19.
28. Gallot, S., Hulin, D., & Lafontaine, J. (1991). Differential geometry. Berlin: Springer-Verlag.
29. Grassman, H. G. (1862). Die Ausdehnungslehre. Berlin: Enslin.
30. Helgason, S. (1978). Differential geometry, Lie groups, and symmetric spaces. Orlando, FL: Academic Press.
31. Helmke, U., & Moore, J. B. (1993). Optimization and dynamical systems. Berlin: Springer-Verlag.
32. Hyvärinen, A., & Oja, E. (1998). Independent component analysis by general non-linear Hebbian-like rules. Signal Processing, 64(3), 301-313.
33. Karhunen, J. (1996). Neural approaches to independent component analysis and source separation. In Fourth European Symposium on Artificial Neural Networks (pp. 249-266).
34. Karhunen, J., & Joutsensalo, J. (1993). Learning of robust principal component subspace. In Proceedings of the International Joint Conference on Neural Networks (pp. 2409-2412).
35. Kreutz-Delgado, K., & Rao, B. D. (1999). Sparse basis selection, ICA, and majorization: Towards a unified perspective. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing, 2 (pp. 1344-1347).
36. Maclnnes, C. S., & Vaccaro, R. J. (1996). Tracking direction-of-arrival with invariant subspace updating. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (pp. 2896-2899).
37. Moreau, E., & Macchi, O. (1996). Higher order contrasts for self-adaptive source separation. International Journal of Adaptive Control and Signal Processing, 10(1), 19-46.
38. Moreau, E., & Pesquet, J. C. (1997). Independence/decorrelation measures with application to optimized orthonormal representations. In Proceedings of the International Conference on Acoustics, Speech and Signal Processing (pp. 3425-3428).
39. Nishimori, Y. (1999). Learning algorithm for ICA by geodesic flows on orthogonal group. In Proceedings of the International Joint Conference on Neural Networks. Washington, D.C.
40. Oja, E. (1989). Neural networks, principal components, and subspaces. International Journal of Neural Systems, 1, 61-68.
41. Oja, E., Hyvärinen, A., & Hoyer, P. (1999). Image feature extraction and denoising by sparse coding. Pattern Analysis and Applications Journal, 2(2), 104-110.
42. Orfanidis, S. J. (1990). Gram-Schmidt neural nets. Neural Computation, 2, 116-126.
43. Palmieri, F., Zhu, J., & Chang, C. (1993). Anti-Hebbian learning in topologically constrained linear networks: A tutorial. IEEE Transactions on Neural Networks, 4(5), 748-761.
44. Paraschiv-Ionescu, A., Jutten, C., & Bouvier, G. (1997). Neural network based processing for smart sensor arrays. In Proceedings of the International Conference on Artificial Neural Networks (pp. 565-570).
45. Parra, L., Deco, G., & Miesbach, S. (1996). Statistical independence and novelty detection with information preserving non-linear maps. Neural Computation, 8, 260-269.
46. Sona, D., Sperduti, A., & Starita, A. (2000). Discriminant pattern recognition using transformation invariant neurons. Neural Computation, 12(6).
47. Stiefel, E. (1935-1936). Richtungsfelder und fernparallelismus in n-dimensionalem manning faltigkeiten. Commentarii Math. Helvetici, 8, 305-353.
48. Watanabe, S. (1965). Karhunen-Loève expansion and factor analysis: Theoretical remarks and applications. In Transactions of the 4th Prague Conference on Information Theory, Statistical Decision Functions Random Processes (pp. 635-660). Publishing House of the Czechoslovak Academy of Sciences.
49. Xu, L. (1994). Theories for unsupervised learning: PCA and its nonlinear extension. In Proceedings of the International Joint Conference on Neural Networks (pp. 1252-1257).
50. Xu, L., Oja, E., & Suen, C. Y. (1992). Modified Hebbian learning for curve and surface fitting. Neural Networks, 5, 441-457.
51. Yang, B. (1995). Projection approximation subspace tracking. IEEE Transactions on Signal Processing, 43, 1247-1252.
52. Yang, H. H., & Amari, S.-i. (1997). Adaptive online learning algorithms for blind separation: Maximum entropy and minimal mutual information. Neural Computation, 9, 1457-1482.