Independent component analysis based on nonparametric density estimation

IEEE Transactions on Neural Networks

Volumn 15, Issue 1, 2004, Pages 55-65

  Boscolo, Riccardo ^a   Pan, Hong ^b   Roychowdhury, Vwani P ^a  

^a University of California   (United States)

^b WEILL CORNELL MEDICAL COLLEGE   (United States)

Author keywords

Independent component analysis (ICA); Kernel density estimation; Nonlinear optimization; Nonparametric methods

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; MONTE CARLO METHODS; OPTIMIZATION; PROBABILITY DENSITY FUNCTION; SIGNAL RECONSTRUCTION;

NONLINEAR OPTIMIZATION; NONPARAMETRIC DENSITY ESTIMATION;

INDEPENDENT COMPONENT ANALYSIS;

ALGORITHM; ARTICLE; METHODOLOGY; NONPARAMETRIC TEST; PRINCIPAL COMPONENT ANALYSIS;

ALGORITHMS; PRINCIPAL COMPONENT ANALYSIS; STATISTICS, NONPARAMETRIC;

EID: 1242286406     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2003.820667     Document Type: Article

References (38)

1. P. Comon, "Independent component analysis, a new concept?," Signal Processing, vol. 36, no. 3, pp. 287-314, 1994.
2. A. J. Bell and T. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural Computation, vol. 7, no. 6, pp. 1129-1159, 1995.
3. D. T. Pham, "Blind separation of instantaneous mixture of sources via an independent component analysis," IEEE Trans. Signal Processing, vol. 44, pp. 2768-2779, Nov. 1996.
4. J. P. Nadal and N. Parga, "Non-linear neurons in the low-noise limit: A factorial code maximizes information transfer," Network, vol. 4, pp. 295-312, 1994.
5. J.-F. Cardoso, "Blind signal separation: Statistical principles," Proc. IEEE. Special Issue on Blind Identification and Estimation, vol. 9, pp. 2009-2025, Oct. 1998.
6. ____, "High-order contrasts for independent component analysis," Neural Computat., vol. 11, no. 1, pp. 157-192, Jan. 1999.
7. T.-W. Lee, M. Girolami, and T. J. Sejnowski, "Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources," Neural Computat., vol. 11, no. 2, pp. 417-441, 1999.
8. M. Girolami and C. Fyfe, "An extended exploratory projection pursuit network with linear and nonlinear anti-Hebbian lateral connections applied to the cocktail party problem," Neural Networks, vol. 10, no. 9, pp. 1607-1618, 1997.
9. A. Hyvärinen, "Survey on independent component analysis," Neural Computing Surveys, vol. 2, pp. 94-128, 1999.
10. D. Obradovic and G. Deco, "Information maximization and independent component analysis: Is there a difference?," Neural Computat., vol. 10, pp. 2085-2101, 1998.
11. S. Cruces, A. Cichocki, and L. Castedo, "An iterative inversion approach to blind source separation," IEEE Trans. Neural Networks, vol. 11, pp. 1423-1437, Nov. 2000.
12. R. Boscolo, H. Pan, and V. P. Roychowdhury, "Non-parametric ICA," in Proc. Third Int. Conf. Independent Component Analysis and Blind Signal Separation, T.-W. Lee, T.-W. Jung, S. Makeig, and T. Sejnowski, Eds., San Diego, CA, Dec. 2001, pp. 13-18.
13. T.-W. Lee, A. J. Bell, and R. Orglmeister, "Blind source separation of real-world signals," IEEE Proc. ICNN, pp. 2129-2135, 1997.
14. A. J. Bell and T. J. Sejnowski, "The 'independent components' of natural scenes are edge filters," Vision Res., vol. 37, pp. 3327-3338, 1997.
15. M. J. McKeown, T.-P. Jung, S. Makeig, G. Brown, S. S. Kindermann, T.-W. Lee, and T. J. Sejnowski, "Spatially independent activity patterns in functional magnetic resonance imaging data during the stroop color-naming task," in Proc. National Acad. Sciences USA, vol. 95, 1998, pp. 803-810.
16. M. J. McKeown, S. Makeig, G. Brown, T.-P. Jung, S. S. Kindermann, A. J. Bell, V. Iragui, and T. J. Sejnowski, "Analysis of fMRI by blind separation into independent spatial components," Human Brain Mapping, vol. 6, no. 3, pp. 160-188, 1998.
17. S. Makeig, T.-P. Jung, A.J. Bell, D. Ghahremani, and T. J. Sejnowski, "Blind separation of event-related brain responses into independent components," in Proc. National Acad. Sciences USA, vol. 94, 1997, pp. 10 979-10 984.
18. T.-P. Jung, C. Humphries, T.-W. Lee, M. J. McKeown, V. Iragui, S. Makeig, and T. J. Sejnowski, "Removing electroencephalographic artifacts by blind source separation," Psychophysiol., vol. 37, pp. 163-178, 2000.
19. S.-i. Amari, T.-P. Chen, and A. Cichocki, "Stability analysis of learning algorithms for blind source separation," Neural Networks, vol. 10, no. 8, pp. 1345-1351, 1997.
20. J.-F. Cardoso and A. Souloumiac, "Blind beamforming for non Gaussian signals," IEE Proc.-F, vol. 140, pp. 362-370, Dec. 1993.
21. J. Karvanen, J. Eriksson, and V. Koivunen, "Pearson system based method for blind separation," in Proce. Second Int. Workshop on Independent Component Analysis and Blind Signal Separation, P. Pajunen and J. Karhunen, Eds., Helsinki, 2000, pp. 585-590.
22. H. Attias, "Independent factor analysis," Neural Computation, vol. 11, no. 4, pp. 803-851, 1999.
23. N. Vlassis and Y. Motomura, "Efficient source adaptivity in independent component analysis," IEEE Trans. Neural Networks, vol. 12, pp. 559-566, May 2001.
24. F.R. Bach and M.I. Jordan, "Kernel independent component analysis," J. Machine Learning Res., vol. 3, pp. 1-48, 2002.
25. H. B. Barlow, "Unsupervised learning," Neural Computation, vol. 1, pp. 295-311, 1989.
26. D. Donoho, "On minimum entropy deconvolution," in Proc. Second Applied Time Series Symp., D. F. Findley, Ed., New York, 1981, pp. 565-608.
27. J.-F. Cardoso, "Infomax and maximum likelihood for source separation," IEEE Signal Processing Lett., vol. 4, pp. 112-114, Apr. 1997.
28. T.M. Cover and J.A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
29. B. W. Silverman, Density Estimation for Statistics and Data Analysis. New York: Chapman and Hall, 1985.
30. M.C. Jones, "The projection pursuit algorithm for exploratory data analysis," Ph.D., School of Mathematics, Univ. Bath, 1983.
31. S. Boyd and L. Vandenberghe. (2000) Convex Optimization. [Online]. Available: http://www.ee.ucla.edu/ee236b/reader.pdf
32. A. Edelman, T. A. Arias and S. T. Smith, "The geometry of algorithms with orthogonality constraints," SIAM J. Matrix Anal. Appl., vol. 20, no. 2, pp. 303-353, 1999.
33. J. Nocedal and S. J. Wright, Numerical Optimization. New York: Springer-Verlag, 1999.
34. M. Rattray and G. Basalyga, "Scaling laws and local minima in hebbian ica," in Advances in Neural Information Processing Systems, vol. 14, T. Diettrich, S. Becker, and Z. Ghahramani, Eds., Vancouver, Canada, Dec. 2001.
35. ____, "Stochastic trapping in a solvable model of on-line independent component analysis," Neural Computation, vol. 14, pp. 421-435, 2002.
36. S.-i. Amari, A. Cichocki, and H. H. Yang, "A new learning algorithm for blind source separation," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 1996, vol. 8, pp. 757-763.
37. J. Eriksson, J. Karvanen, and V. Koivunen, "Source distribution adaptive maximum likelihood estimation of ICA model," in Proc. Second Int. Workshop on Independent Component Analysis and Blind Signal Separation, P. Pajunen and J. Karhunen, Eds., Helsinki, 2000, pp. 227-232.
38. A. I. Fleishman, "A method for simulating nonnormal distributions," Psychometrika, vol. 43, no. 4, pp. 521-532, Dec. 1978.