Algorithms for nonnegative independent component analysis

IEEE Transactions on Neural Networks

Volumn 14, Issue 3, 2003, Pages 534-543

  Plumbley, Mark D ^a  

^a QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Geodesic; Independent component analysis (ICA); Nonnegativity; Stiefel manifold

Indexed keywords

ACOUSTIC SIGNAL PROCESSING; ALGORITHMS; COMPUTER SIMULATION; CONSTRAINT THEORY; CONVERGENCE OF NUMERICAL METHODS; IMAGE SEGMENTATION; INDEPENDENT COMPONENT ANALYSIS; MATRIX ALGEBRA; PRINCIPAL COMPONENT ANALYSIS; PROBABILITY DENSITY FUNCTION; VECTORS;

GEODESIC SEARCH METHOD; IMAGE SEPARATION; MUSIC AUDIO ANALYSIS; NONNEGATIVE INDEPENDENT COMPONENT ANALYSIS; STIEFEL MANIFOLD;

NEURAL NETWORKS;

EID: 0038460232     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2003.810616     Document Type: Article

References (36)

1. P. Comon, "Independent component analysis-a new concept?," Signal Processing, vol. 36, no. 3, pp. 287-314, 1994.
2. A. Hyvärinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
3. D. D. Lee and H. S. Seung, "Learning the parts of objects by nonnegative matrix factorization," Nature, vol. 401, pp. 788-791, Oct. 1999.
4. P. Paatero and U. Tapper, "Positive matrix factorization: A nonnegative factor model with optimal utilization of error estimates of data values," Environmetrics, vol. 5, pp. 111-126, 1994.
5. M. Novak and R. Mammone, "Use of nonnegative matrix factorization for language model adaptation in a lecture transcription task," in Proc. 2001 IEEE Int. Conf. Acoust., Speech., Signal Processing, vol. 1, Salt Lake City, UT, May 7-11, 2001, pp. 541-544.
6. M. D. Plumbley, S. A. Abdallah, J. P. Bello, M. E. Davies, G. Monti, and M. B. Sandler, "Automatic music transcription and audio source separation," Cybern. Syst., vol. 33, pp. 603-627, Sept. 2002.
7. J. S. Lee, D. D. Lee, S. Choi, and D. S. Lee, "Application of nonnegative matrix factorization to dynamic positron emission tomography," in Proc. Int. Conf. Independent Component Anal. Signal Separation, T.-W. Lee, T.-P. Jung, S. Makeig, and T. J. Sejnowski, Eds., San Diego, CA, Dec. 9-13, 2001, pp. 629-632.
8. L. Xu, "Least mean square error reconstruction principle for self-organizing neural-nets," Neural Networks, vol. 6, no. 5, pp. 627-648, 1993.
9. G. F. Harpur and R. W. Prager, "Development of low entropy coding in a recurrent network," Network: Computation in Neural Systems, vol. 7, pp. 277-284, 1996.
10. D. Charles and C. Fyfe, "Modeling multiple-cause structure using rectification constraints," Network: Computation in Neural Systems, vol. 9, pp. 167-182, 1998.
11. G. F. Harpur, "Low Entropy Coding with Unsupervised Neural Networks," Ph.D. dissertation, Dept. Eng., Univ. Cambridge, Cambridge, U.K., 1997.
12. P. Paatero, P. K. Hopke, X.-H. Song, and Z. Ramadan, "Understanding and controlling rotations in factor analytic models," Chemometrics Intell. Lab. Syst., vol. 60, no. 1-2, pp. 253-264, 2002.
13. P. O. Hoyer and A. Hyvärinen, "A multi-layer sparse coding network learns contour coding from natural images," Vis. Res., vol. 42, no. 12, pp. 1593-1605, 2002.
14. M. D. Plumbley, "Adaptive lateral inhibition for nonnegative ICA," in Proc. Int. Conf. Independent Component Anal. Signal Separation, T.-W. Lee, T.-P. Jung, S. Makeig, and T. J. Sejnowski, Eds., San Diego, CA, Dec. 9-13, 2001, pp. 516-521.
15. M. D. Plumbley, "Conditions for nonnegative independent component analysis," IEEE Signal Processing Lett., vol. 9, pp. 177-180, June 2002.
16. J. Karhunen, E. Oja, L. Wang, R. Vigário, and J. Joutsensalo, "A class of neural networks for independent component analysis," IEEE Trans. Neural Networks, vol. 8, pp. 486-504, May 1997.
17. E. Oja and J. Karhunen, "On stochastic approximation of the eigenvectors and eigenvalues of the expectation of a random matrix," J. Math. Anal. Applicat., vol. 106, pp. 69-84, 1985.
18. E. Oja, "Principal components, minor components and linear neural networks," Neural Networks, vol. 5, pp. 927-935, 1992.
19. R. J. Williams, "Feature Discovery Through Error-Correction Learning," Inst. Cognitive Sci., Univ. California, San Diego, ICS Rep. 8501. 1985.
20. E. Oja, "The nonlinear PCA learning rule in independent component analysis," Neurocomputing, vol. 17, no. 1, pp. 25-45, 1997.
21. M. D. Plumbley and E. Oja, A 'nonnegative PCA' algorithm for independent component analysis, 2002, submitted for publication.
22. S. Fiori, "'Mechanical' neural learning for blind source separation," Electron. Lett., vol. 35, no. 22, pp. 1963-1964, October 1999.
23. W. H. Press, S. A. Teukolsky W. T. Vettering, and B. P. Flannery, Numerical Recipes in C: The Art of Scientific Computing, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 1992.
24. S. C. Douglas and S.-Y Kung, "An ordered-rotation kuicnet algorithm for separating arbitrarily-distributed sources," in Proc. Int. Workshop Independent Component Analysis Blind Signal Separation, Aussois, France, Jan. 11-15, 1999, pp. 81-86.
25. S. C. Douglas, "Self-stabilized gradient algorithms for blind source separation with orthogonality constraints," IEEE Trans. Neural Networks, vol. 11, pp. 1490-1497, Nov. 2000.
26. Y. Nishimori, "Learning algorithm for ICA by geodesic flows on orthogonal group," in Proc. Int. Joint Conf. Neural Networks, vol. 2, Washington, DC, July 10-16, 1999, pp. 933-938.
27. A. Edelman, T. A. Arias, and S. T. Smith, "The geometry of algorithms with orthogonality constraints," SIAM J. Matrix Anal. Applicat., vol. 20, no. 2, pp. 303-353, 1998.
28. S. Fiori, "A theory for learning by weight flow on Stiefel-Grassman manifold," Neural Comput., vol. 13, pp. 1625-1647, 2001.
29. Y. Nishimori, "Multiplicative learning algorithm via geodesic flows," in Proc. 2001 Int. Symp. Nonlinear Theory Applications, Miyagi, Japan, 2001, pp. 529-532.
30. A. Cichocki et al., "Neural network approach to blind separation and enhancement of images," in Signal Processing VIII: Theories and Applications, G. Ramponi et al., Eds. Trieste, Italy: EURASIP/LINT Publ., 1996, vol. I, pp. 579-582.
31. T. Akuzawa, "Multiplicative Newton-like algorithm and independent component analysis," in Proc. IEEE-INNS-ENNS Int. Joint Conf. Neural Networks, vol. 4, S.-I. Amari, C. L. Giles, M. Gori, and V. Piuri, Eds., Como, Italy, July 24-27, 2000, pp. 79-82.
32. T. Akuzawa, "New fast factorization method for multivariate optimization and its realization as ICA algorithm," in Proc. Int. Conf. Independent Component Analysis Signal Separation, T.-W. Lee, T.-P. Jung, S. Makeig, and T. J. Sejnowski, Eds., San Diego, CA, Dec. 9-13, 2001, pp. 114-119.
33. J.-F. Cardoso and B. H. Laheld, "Equivariant adaptive source separation," IEEE Trans. Signal Processing, vol. 44, pp. 3017-3030, Dec. 1996.
34. S. Amari, "Natural gradient works efficiently in learning," Neural Comput., vol. 10, no. 2, pp. 251-276, Feb. 1998.
35. A. Edelman and S. T. Smith, "On conjugate gradient-like methods for eigen-like problems," BIT Numer. Math., vol. 36, pp. 494-508, 1996.
36. R. Martin-Clemente, C. G. Puntonet, and J. I. Acha, "Blind signal separation based on the derivatives of the output cumulants and a conjugate gradient algorithm," in Proc. Int. Conf. Independent Component Analysis Signal Separation, T.-W. Lee, T.-P. Jung, S. Makeig, and T. J. Sejnowski, Eds., San Diego, CA, Dec. 9-13, 2001, pp. 390-393.