Independent component analysis using an extended infomax algorithm for mixed subgaussian and supergaussian sources

Neural Computation

Volumn 11, Issue 2, 1999, Pages 417-441

  Lee, Te Won ^a,b   Girolami, Mark ^d   Sejnowski, Terrence J ^a,c  

^a HOWARD HUGHES MEDICAL INSTITUTE   (United States)

^b TECHNISCHE UNIVERSITÄT BERLIN   (Germany)

^c UNIVERSITY OF CALIFORNIA   (United States)

^d NONE

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHM; ARTICLE; ARTIFACT; BLINKING; BRAIN; ELECTROENCEPHALOGRAPHY; HUMAN; NORMAL DISTRIBUTION; PHYSIOLOGY; STATISTICAL MODEL;

ALGORITHMS; ARTIFACTS; BLINKING; BRAIN; ELECTROENCEPHALOGRAPHY; HUMANS; MODELS, STATISTICAL; NORMAL DISTRIBUTION;

EID: 0033556834     PISSN: 08997667     EISSN: None     Source Type: Journal    
DOI: 10.1162/089976699300016719     Document Type: Article

References (52)

1. Amari, S. (1998). Natural gradient works efficiently in learning. Neural Computation, 10, 251-276.
2. Amari, S., & Cardoso, J.-F. (1997). Blind source separation - Semiparametric statistical approach. IEEE Trans. on Signal Processing, 45(11), 2692-2700.
3. Amari, S., Chen, T.-P., & Cichocki, A. (1997). Stability analysis of adaptive blind source separation. Neural Networks, 10(8), 1345-1352.
4. Amari, S., Cichocki, A., & Yang, H. (1996). A new learning algorithm for blind signal separation. In D. Touretzky, M. Mozer, & M. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 757-763). Cambridge, MA: MIT Press.
5. Attias, H. (1999). Blind separation of noisy mixtures: An EM algorithm for factor analysis. Neural Computation, 11, to appear in 11-4.
6. Bell, A. J., & Sejnowski, T. J. (1995). An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7, 1129-1159.
7. Berg, P., & Scherg, M. (1991). Dipole models of eye movements and blinks. Electroencephalog. Clin. Neurophysiolog., 79, 36-44.
8. Cardoso, J.-F. (1998). Blind signal separation: Statistical principles. Proceedings of IEEE, 86(10), 2009-2025.
9. Cardoso, J.-F. (in press). Unsupervised adaptive filtering. In S. Haykin (Ed.), Entropic contrasts for source separation. Englewood Cliffs, NJ: Prentice Hall.
10. Cardoso, J.-F. (1997). Infomax and maximum likelihood for blind source separation. IEEE Signal Processing Letters, 4(4), 112-114.
11. Cardoso, J.-F., & Laheld, B. (1996). Equivariant adaptive source separation. IEEE Trans. on S.P., 45(2), 434-444.
12. Cardoso, J., & Soloumiac, A. (1993). Blind beamforming for non-gaussian signals. IEE Proceedings-F, 140(46), 362-370.
13. Cichocki, A., Unbehauen, R., & Rummert, E. (1994). Robust learning algorithm for blind separation of signals. Electronics Letters, 30(17), 1386-1387.
14. Comon, P. (1994). Independent component analysis - A new concept? Signal Processing, 36(3), 287-314.
15. Cover, T., & Thomas, J. (Eds.). (1991). Elements of information theory. New York: Wiley.
16. Deco, G., & Obradovic, D. (1996). An information-theoretic approach to neural computing. Berlin: Springer-Verlag.
17. Gaeta, M., & Lacoume, J.-L. (1990). Source separation without prior knowledge: The maximum likelihood solution. Proc. EUSIPO (pp. 621-624).
18. Girolami, M. (1997). Self-organizing artificial neural networks for signal separation. Unpublished Ph.D. dissertation, Paisley University, Scotland.
19. Girolami, M. (1998). An alternative perspective on adaptive independent component analysis algorithms. Neural Computation, 10, 2103-2114.
20. Girolami, M., & Fyfe, C. (1997a). Extraction of independent signal sources using a deflationary exploratory projection pursuit network with lateral inhibition. I.E.E Proceedings on Vision, Image and Signal Processing Journal, 14(5), 299-306.
21. Girolami, M., & Fyfe, C. (1997b). Generalised independent component analysis through unsupervised learning with emergent bussgang properties. In Proc. ICNN (pp. 1788-1891). Houston, TX.
22. Hochreiter, S., & Schmidhuber, J. (1999). Feature extraction through LO-COCODE. Neural Computation, 11, to appear in 11-3.
23. Hyvaerinen, A., & Oja, E. (1997). A fast fixed-point algorithm for independent component analysis. Neural Computation, 9, 1483-1492.
24. Jung, T.-P., Humphries, C., Lee, T.-W., Makeig, S., McKeown, M., Iragui, V., & Sejnowski, T. J. (1998). Extended ICA removes artifacts from electroencephalographic recordings. In M. Kearns, M. Jordan, & S. Solla (Eds.), Advances in neural information processing systems, 10 (pp. 894-900). Cambridge, MA: MIT Press.
25. Jutten, C., & Hérault, J. (1991). Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture. Signal Processing, 24, 1-10.
26. Karhunen, J. (1996). Neural approaches to independent component analysis and source separation. In Proc. 4th European Symposium on Artificial Neural Networks (pp. 249-266). Bruges, Belgium.
27. Karhunen, J., Oja, E., Wang, L., Vigario, R., & Joutsensalo, J. (1997). A class of neural networks for independent component analysis. IEEE Trans. on Neural Networks, 8, 487-504.
28. Lee, T.-W. (1998). Independent component analysis: Theory and applications. Dordrecht: Kluwer Academic Publishers, ISBN: 0-7923-8261-7.
29. Lee, T.-W., Girolami, M., Bell, A. J., & Sejnowski, T. J. (1999). A unifying framework for independent component analysis. Computers and Mathematics with Applications, in press.
30. Lee, T.-W., Koehler, B., & Orglmeister, R. (1997). Blind separation of nonlinear mixing models. In IEEE NNSP (pp. 406-415). Florida.
31. Lee, T.-W., Lewicki, M. S., Girolami, M., & Sejnowski, T. J. (in press). Blind source separation of more sources than mixtures using overcomplete representations. IEEE Signal Processing Letters.
32. Lee, T.-W., Lewicki, M. S., and Sejnowski, T. J. (1999). Unsupervised classification with non-gaussian mixture models using ICA. In Advances in neural information processing systems, 11, Cambridge, MA: MIT Press.
33. Lewicki, M., & Sejnowski, T. J. (1998). Learning nonlinear overcomplete representations for efficient coding. In M. Kearns, M. Jordan, & S. Solla (Eds.), Advances in neural information processing systems, 10 (pp. 815-821). Cambridge, MA: MIT Press.
34. Lin, J., & Cowan, J. (1997). Faithful representation of separable input distributions. Neural Computation, 9, 6:1305-1320.
35. Makeig, S., Bell, A. J., Jung, T., & Sejnowski, T. J. (1996). Independent component analysis of electroencephalographic data. In D. Touretzky, M. Moser, & M. Hasselmo (Eds.), Advances in neural information processing systems, 8 (pp. 145-151). Cambridge, MA: MIT Press.
36. Makeig, S., & Inlow, M. (1993). Changes in the EEG spectrum predict fluctuations in error rate in an auditory vigilance task. Society for Psychophysiology, 28,539.
37. Makeig, S., Jung, T., Bell, A. J., Ghahremani, D., & Sejnowski, T. J. (1997). Blind separation of event-related brain response into spatial independent components. Proceedings of the National Academy of Sciences, 94, 10979-10984.
38. McKeown, M., Makeig, S., Brown, G., Jung, T.-P., Kindermann, S., Lee, T.-W., & Sejnowski, T. J. (1998). Spatially independent activity patterns in functional magnetic resonance imaging data during the Stroop color-naming task. Proceedings of the National Academy of Sciences, 95, 803-810.
39. Moulines, E., Cardoso, J.-F., & Cassiat, E. (1997). Maximum likelihood for blind separation and deconvolution of noisy signals using mixture models. In Proc. ICASSP'97 (Vol. 5, pp. 3617-3620). Munich.
40. Nadal, J.-P., & Parga, N. (1994). Non linear neurons in the low noise limit: A factorial code maximizes information transfer. Network, 5, 565-581.
41. Nadal, J.-P., & Parga, N. (1997). Redundancy reduction and independent component analysis: Conditions on cumulants and adaptive approaches. Neural Computation, 9, 1421-1456.
42. Oja, E. (1997). The nonlinear PCA learning rule in independent component analysis. Neurocomputing, 17, 25-45.
43. Pajunen, P., & Karhunen, J. (1997). A maximum likelihood approach to nonlinear blind source separation. In ICANN (pp. 541-546). Lausanne.
44. Pearlmutter, B., & Parra, L. (1996). A context-sensitive generalization of ICA. In International Conference on Neural Information Processing (pp. 151-157).
45. Pearson, K. (1894). Contributions to the mathematical study of evolution. Phil. Trans. Roy. Soc. A, 185(71).
46. Pham, D.-T., & Garrat, P. (1997). Blind separation of mixture of independent sources through a quasi-maximum likelihood approach. IEEE Trans. on Signal Proc., 45(7), 1712-1725.
47. Roth, Z., & Baram, Y. (1996). Multidimensional density shaping by sigmoids. IEEE Trans. on Neural Networks, 7(5), 1291-1298.
48. Stuart, A., & Ord, J. (1987). Kendall's advanced theory of statistic, 1, Distribution theory. New York: Wiley.
49. Taleb, A., & Jutten, C. (1997). Nonlinear source separation: The post-nonlinear mixtures. In ESANN (pp. 279-284).
50. Vigario, R., Hyvaerinen, A., & Oja, E. (1996). ICA fixed-point algorithm in extraction of artifacts from EEG. In IEEE Nordic Signal Processing Symposium (pp. 383-386). Espoo, Finland.
51. Xu, L., Cheung, C., Yang, H., & Amari, S. (1997). Maximum equalization by entropy maximization and mixture of cumulative distribution functions. In Proc. of ICNN'97 (pp. 1821-1826). Houston.
52. Yang, H., Amari, S., & Cichocki, A. (1997). Information back-propagation for blind separation of sources from non-linear mixtures. In Proc. of ICNN (pp. 2141-2146). Houston.