Estimating functions for blind separation when sources have variance dependencies

Journal of Machine Learning Research

Volumn 6, Issue , 2005, Pages

  Kawanabe, Motoaki ^a   Müller, Klaus Robert ^b  

^a FRAUNHOFER FIRST   (Germany)

^b UNIVERSITY OF POTSDAM   (Germany)

Author keywords

Blind source separation; Estimating functions; Independent component analysis; Semiparametric statistical models; Variance dependencies

Indexed keywords

ALGORITHMS; COMPUTER SIMULATION; FUNCTIONS; INDEPENDENT COMPONENT ANALYSIS; MATHEMATICAL MODELS; MAXIMUM LIKELIHOOD ESTIMATION; STATISTICAL METHODS; VARIATIONAL TECHNIQUES;

ESTIMATING FUNCTIONS; HIDDEN SOURCE SIGNALS; SEMIPARAMETRIC STATISTICAL MODELS; VARIANCE DEPENDENCIES;

BLIND SOURCE SEPARATION;

EID: 21844458452     PISSN: 15337928     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Article

References (52)

1. S. Amari. Differential Geometrical Methods in Statistics. Springer Verlag, Berlin, 1985.
2. S. Amari. Natural gradient works efficiently in learning. Neural Computation, 10(2):251-276, 1998.
3. S. Amari and J.-F. Cardoso. Blind source separation - semiparametric statistical approach. IEEE Trans. on Signal Processing, 45(11):2692-2700, 1997.
4. S. Amari, T.-P. Chen, and A. Cichocki. Stability analysis of adaptive blind source separation. Neural Networks, 10(8): 1345-1351, 1997.
5. S. Amari, T.-P. Chen, and A. Cichocki. Nonholonomic orthogonal learning algorithms for blind source separation. Neural Computation, 12:1463-1484, 2000.
6. S. Amari, A. Cichocki, and H. H. Yang. A new learning algorithm for blind source separation. In Advances in Neural Information Processing Systems 8, pages 757-763. MIT Press, 1996.
7. S. Amari and M. Kawanabe. Estimating functions in semiparametric statistical models. In I. V. Basawa et al., editor, Selected Proceedings of the Symposium on Estimating Functions, volume 32 of IMS Lecture Notes-Monograph Series, pages 65-81, 1997a.
8. S. Amari and M. Kawanabe. Information geometry of estimating functions in semiparametric statistical models. Bernoulli, 3:29-54, 1997b.
9. F. R. Bach and M. I. Jordan. Tree-dependent component analysis. In Uncertainly in Artificial Intelligence: Proceedings of the Eighteenth Conference (UAI-2002), 2002.
10. A. J. Bell and T. J. Sejnowski. An information-maximization approach to blind separation and blind deconvolution. Neural Computation, 7:1129-1159, 1995.
11. A. Belouchrani, K. Abed Meraim, J.-F. Cardoso, and E. Moulines. A blind source separation techinique based on second order statistics. IEEE Trans. on Signal Processing, 45(2):434-444, 1997.
12. P. J. Bickel, C. A. J. Klaassen, Y. Ritov, and J. A. Wellner. Efficient and Adaptive Estimation for Semiparamtric Models. John Hopkins Univ. Press, Baltimore, MD, 1993.
13. J.-F. Cardoso. Estimating equations for source separation. In Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP'97), volume 5, pages 3449-3452, Munich, Germany, 1997.
14. J.-F. Cardoso. Blind signal separation: statistical principles. Proc. of the IEEE, 86(10):2009-2025, 1998a.
15. J.-F. Cardoso. Multidimensional independent component analysis. In Proc. IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP'98), Seattle, WA, 1998b.
16. J.-F. Cardoso. Independent component analysis of the cosmic microwave background. In.Proc.Int. Symposium on Independent Component Analysis and Blind Signal Separation (ICA2003), pages 1111-1116, Nara, Japan, 2003.
17. J.-F. Cardoso and A. Souloumiac. Blind beamforming for non Gaussian signals. IEE Proceedings-F, 140:362-370, 1993.
18. P. Comon. Independent component analysis - a new concept? Signal Processing, 36:287-314, 1994.
19. V. P. Godambe. Conditional likelihood and unconditional optimum estimating equations. Biometrika, 63:277-284, 1976.
20. V. P. Godambe, editor. Estimating Functions. Oxford Univ. Press, New York, 1991.
21. S. Harmeling, F. Meinecke, and K.-R. Müller. Injecting noise for analysing the stability of ica components. Signal Processing, 84:255-266, 2004.
22. P. J. Huber. Robust Statistics. Wiley, New York, 1981.
23. A. Hyvärinen. Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. on Neural Networks, 10(3):626-634, 1999.
24. A. Hyvärinen, P. O. Hoyer, and M. Inki. Topographic independent component analysis. Neural Computation, 13(7): 1527-1558, 2001a.
25. A. Hyvärinen and J. Hurri. Blind separation of sources that have spatiotemporal variance dependencies. Signal Processing, 84, 2004. 247-254.
26. A. Hyvärinen, J. Karhunen, and E. Oja. Independent Component Analysis. Wiley, 2001b.
27. A. Hyvärinen and E. Oja. A fast fixed-point algorithm for independent component analysis. Neural Computation, 9(7):1483-1492, 1997.
28. Ch. Jutten and J. Herault. Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture. Signal Processing, 24:1-10, 1991.
29. M. Kawanabe and K.-R. Müller. Estimating functions for blind separation when source have variance-dependencies. In C. G. Puntonet and A. Prieto, editors, Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2004), pages 136-143, Granada, Spain, 2004.
30. M. Kawanabe and N. Murata. Independent component analysis in the presence of Gaussian noise based on estimating functions. In Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2000), pages 279-284, Helsinki, Finland, 2000.
31. S. Makeig, T-P. Jung, D. Ghahremani, A. J. Bell, and T. J. Sejnowski. Blind separation of event-related brain responses into independent components. Proc. Natl. Acad. Sci. USA, 94:10979-10984, 1997.
32. F. Meinecke, S. Harmeling, and K.-R. Müller. Robust ICA for super-Gaussian sources. In C. G. Puntonet and A. Prieto, editors, Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2004), pages 217-224, Granada, Spain, 2004.
33. F. Meinecke, A. Ziehe, M. Kawanabe, and K.-R. Müller. A resampling approach to estimate the stability of one- or multidimensional independent components. IEEE Transactions on Biomedical Engineering, 49(12):1514-1525, 2002.
34. F. Meinecke, A. Ziehe, J. Kurths, and K.-R. Müller. Measuring phase synchronization of superimposed signals. Physical Review Letters, 2005.
35. K.-R. Müller, N. Murata, A. Ziehe, and S.-I. Amari. On-line learning in Switching and Drifting environments with application to blind source separation, pages 93-110. On-line learning in neural networks. Cambridge University Press, 1998.
36. K.-R. Müller, R. Vigário, F. Meinecke, and A. Ziehe. Blind source separation techniques for decomposing evoked brain signals. International Journal of Bifurcation and Chaos, 14(2):773-791, 2004.
37. N. Murata, M. Kawanabe, A. Ziehe, K.-R. Müller, and S.-I. Amari. On-line learning in changing environments with applications in supervised and unsupervised learning. Neural Networks, 15 (4-6):743-760, 2002.
38. B. A. Olshausen and D. J. Field. Emergence of simple-cell receptive field by learning a sparse code for natural images. Nature, 381:607-609, 1996.
39. L. Parra and C. Spence. Convolutive blind source separation of non-stationary sources. IEEE Trans. on Speech and Audio Processing, 8:320-327, 2000.
40. D.-T. Pham. Blind separation of instantaneous mixture sources via an independent component analysis. IEEE Trans. on Signal Processing, 44(11):2768-2779, 1996.
41. D.-T. Pham and J.-F. Cardoso. Blind separation of instantaneous mixtures of non-stationary sources. In Proc. Int. Workshop on Independent Component Analysis and Blind Signal Separation (ICA2000), pages 187-193, Helsinki, Finland, 2000.
42. D.-T. Pham and P. Garrat. Blind separation of mixture of independent sources through a quasi-maximum likelihood approach. IEEE Trans. on Signal Processing, 45(7):1712-1725, 1997.
43. D.-T. Pham, P. Garrat, and C. Jutten. Separation of a mixture of independent sources through a maximum likelihood approach. In Proc. EUSIPCO, pages 771-774, 1992.
44. M. Sørensen. On asymptotics of estimating functions. Brazilian Journal of Probability and Statistics, 13:111-136, 1999.
45. F. J. Theis. Uniqueness of complex and multidimensional independent component analysis. Signal Processing, 84(5):951-956, 2004.
46. H.-Lan Nguyen Thi and Ch. Jutten. Blind source separation for convolutive mixtures. Signal Processing, 45:209-229, 1995.
47. L. Tong, R. W. Liu, V. Soon, and Y. F. Huang. Indeterminacy and identifiability of blind identification. IEEE Transactions on Circuits and Systems, 38:499-509, 1991.
48. H. Valpola, M. Harva, and J. Karhunen. Hierachical models of variance sources. In Proc.Int. Symposium on Independent Component Analysis and Blind Signal Separation (ICA2003), Nara, Japan, 2003.
49. R. N. Vigario. Extraction of ocular artefacts from EEG using independent component analysis. Electroencephalography and clinical Neurophysiology, 103:395-404, 1997.
50. H. H. Yang and S.-I. Amari. Adaptive on-line learning algorithms for blind separation: Maximum entropy and minimum mutual information. Neural Computation, 9(7): 1457-1482, 1997.
51. A. Ziehe and K.-R. Müller. TDSEP - an efficient algorithm for blind separation using time structure. In L. Niklasson, M. Bodén, and T. Ziemke, editors, Proceedings of the 8th International Conference on Artificial Neural Networks (ICANN'98), pages 675-680, 1998.
52. A. Ziehe, K.-R. Müller, G. Nolte, B.-M. Mackert, and G. Curio. Artifact reduction in magnetoneurography based on time-delayed second order correlations. IEEE Transactions on biomedical Engineering, 47:75-87, 2000.