Blind signal separation: Statistical principles

Proceedings of the IEEE

Volumn 86, Issue 10, 1998, Pages 2009-2025

  Cardoso, Jean François ^a,b  

^a TELECOM PARISTECH   (France)

^b IEEE   (France)

Author keywords

Adaptive arrays; Adaptive signal processing; Array signal processing; Asymptotic stability; Blind source separation; Higher order statistics; Independent component analysis; Maximum likelihood estimation; Minimum entropy methods; Signal analysis

Indexed keywords

ASYMPTOTIC STABILITY; DATA REDUCTION; MAXIMUM LIKELIHOOD ESTIMATION; STATISTICAL METHODS;

ADAPTIVE SIGNAL PROCESSING; ARRAY SIGNAL PROCESSING; BLIND SIGNAL SEPARATION; INDEPENDENT COMPONENT ANALYSIS;

DIGITAL SIGNAL PROCESSING;

EID: 0032187518     PISSN: 00189219     EISSN: None     Source Type: Journal    
DOI: 10.1109/5.720250     Document Type: Article

References (70)

1. S.-I. Amari, "Natural gradient works efficiently in learning," Neural Computation, vol. 10, pp. 251-276, 1998.
2. S.-I. Amari and J.-F. Cardoso, "Blind source separation - Semiparametric statistical approach," IEEE Trans. Signal Processing, vol. 45, pp. 2692-2700, Nov. 1997.
3. S.-I. Amari, T.-P. Chen, and A. Cichocki, "Stability analysis of adaptive blind source separation," Neural Networks, vol. 10, no. 8, pp. 1345-1351, 1997.
4. S.-I. Amari, A. Cichocki, and H. Yang, "A new learning algorithm for blind signal separation," in Advances in Neural Information Processing Systems, vol. 8. Denver, CO: MIT Press, pp. 757-763, 1996.
5. K. Anand, G. Mathew, and V. Reddy, "Blind separation of multiple co-channel BPSK signals arriving at an antenna array," IEEE Signal Processing Lett., vol. 2, pp. 176-178, Sept. 1995.
6. A. Back and A. Weigend, "A first application of independent component analysis to extracting structure from stock returns," int. J. Neural Syst., vol. 8, no. 4, Aug. 1997.
7. Y. Bar-Ness, "Bootstraping adaptive interference cancelers: Some practical limitations," in Proc. Globecom, Nov. 1982, pp. 1251-1255.
8. A. J. Bell and T. J. Sejnowski, "An information-maximization approach to blind separation and blind deconvolution," Neural Computation, vol. 7, no. 6, pp. 1004-1034, 1995.
9. _, "Edges are the 'independent components' of natural scenes," in Advances in Neural Information Processing Systems, vol. 9. Denver, CO: MIT Press, 1996.
10. A. Belouchrani, K. A. Meraim, J.-F. Cardoso, and É. Moulines, "A blind source separation technique based on second-order statistics," IEEE Trans. Signal Processing, vol. 45, pp. 434-44, Feb. 1997.
11. A. Benveniste, M. Goursat, and G. Ruget, "Robust identification of a nonminimum phase system, blind adjustment of a linear equalizer in data communication," IEEE Trans. Automat. Contr., vol. 25, pp. 385-399, March 1980.
12. B. G. Agee, S. V. Schell, and W. A. Gardner, "Spectral self-coherence restoral: A new approach to blind adaptive signal extraction using antenna arrays," Proc. IEEE, vol. 78, pp. 753-766, April 1990.
13. X.-R. Cao and R.-W. Liu, "General approach to blind source separation," IEEE Trans. Signal Processing, vol. 44, pp. 562-571, Mar. 1996.
14. J.-F. Cardoso, "Super-symmetric decomposition of the fourth-order cumulant tensor. Blind identification of more sources than sensors," in Proc. ICASSP, 1991, pp. 3109-3112.
15. _, "On the performance of orthogonal source separation algorithms," in Proc. EUSIPCO, Edinburgh, Sept. 1994, pp. 776-779.
16. _, "The equivariant approach to source separation," in Proc. NOLTA, 1995, pp. 55-60.
17. _, "Estimating equations for source separation," in Proc. ICASSP '97, pp. 3449-52.
18. _, "Infomax and maximum likelihood for source separation," IEEE Signal Processing Lett., vol. 4, pp. 112-114, Apr. 1997.
19. J.-F. Cardoso, S. Bose, and B. Friedlander, "On optimal source separation based on second and fourth order cumulants," in Proc. IEEE Workshop on SSAP, Corfou, Greece, 1996.
20. J.-F. Cardoso and P. Comon, "Tensor based independent component analysis," in Proc. EUSIPCO, 1990, pp. 673-676.
21. J.-F. Cardoso and B. Laheld, "Equivariant adaptive source separation," IEEE Trans. Signal Processing, vol. 44, pp. 3017-3030, Dec. 1996.
22. J.-F. Cardoso and A. Souloumiac, "Blind beamforming for non-Gaussian signals," Proc. Inst. Elect. Eng., vol. 140, pt. F, no. 6, pp. 362-370, Dec. 1993.
23. E. Chaumette, P. Comon, and D. Muller, "ICA-based technique for radiating sources estimation: Application to airport surveillance," Proc. Inst. Elect. Eng., vol. 140, pt. F, no. 6, pp. 395-401, Dec. 1993.
24. A. Cichocki, R. Unbehauen, and E. Rummert, "Robust learning algorithm for blind separation of signals," Electronic Lett., vol. 30, no. 17, pp. 1386-87, 1994.
25. P. Comon, "Independent component analysis, a new concept?," Signal Processing, vol. 36, no. 3, pp. 287-314, Apr. 1994.
26. P. Comon and B. Mourrain, "Decomposition of quantics in sums of powers of linear forms," Signal Processing, vol. 53, no. 2, pp. 93-107, Sept, 1996.
27. T. M. Cover and J. A. Thomas, Elements of Information Theory. New York: Wiley, 1991.
28. A. Dapena, L. Castedo, and C. Escudero, "An unconstrained single stage criterion for blind source separation," in Proc. ICASSP, vol. 5, 1996, pp. 2706-2709.
29. L. De Lathauwer, B. De Moor, and J. Vandewalle, "Blind source separation by higher order singular value decomposition," in Proc. EUSIPCO, vol. 1, 1994, pp. 175-178.
30. _, "Fetal electrocardiogram extraction by source subspace separation," in Proc. HOS'95, Aiguablava, Spain, June 1995, pp. 134-138.
31. _, "Blind source separation by simultaneous third-order tensor diagonalization," in Proc. EUSIPCO, Trieste, Italy, 1996, pp. 2089-2092.
32. _, "Independent component analysis based on higher-order statistics only," in Proc. IEEE SSAP Workshop, Corfu, Greece, 1996, pp. 356-359.
33. N. Delfosse and P. Loubaton, "Adaptative blind separation of independent sources: A deflation approach," Signal Processing, vol. 45, no. 1, pp. 59-83, 1995.
34. Y. Deville, "A unified stability analysis of the Hérault-Jutten source separation neural network," Signal Processing, vol. 51, no. 3, pp. 229-233, June 1996.
35. Y. Deville and L. Andry, "Application of blind source separation techniques to multi-tag contactless identification system," IEICE Trans. Fundamentals Electron., Commun., Comput. Sci., vol. E79-A(10), pp. 1694-1699, 1996.
36. D. Donoho, "On minimum entropy deconvolution," in Applied Time-Series Analysis II. New York: Academic, 1981, pp. 565-609.
37. G. d'Urso, P. Prieur, and C. Vincent, "Blind identification methods applied to EDF civil works and power plants monitoring," in Proc. HOS'97, Banff, Canada, June 1997.
38. L. Féty, "Méthodes de traitement d'antenne adaptées aux radio-communications," Ph.D. dissertation, Télécom Paris, Paris, France, June 1988.
39. J.-C. Fort, "Stability of the source separation algorithm of Jutten and Hérault," in Artificial Neural Nenvorks, T. Kohonen, Makasira, Simula, and Kangas, Eds. Amsterdam, The Netherlands: Elsevier, 1991, pp. 937-941.
40. M. Gaeta and J.-L. Lacoume, "Source separation without a priori knowledge: The maximum likelihood solution," in Proc. EUSIPCO, 1990, pp. 621-624.
41. F. Gamboa and É. Gassiat, "Source separation when the input sources are discrete or have constant modulus," IEEE Trans. Signal Processing, vol. 45, pp. 3062-3072, Dec. 1997.
42. G. Giannakis and S. Shamsunder, "Modeling of non-Gaussian array data using cumulants: DOA estimation of more sources with less sensors," Signal Processing, vol. 30, no. 3, pp. 279-297, July 1993.
43. J. Hérault, C. Jutten, and B. Ans, "Détection de grandeurs primitives dans un message composite par une architecture de calcul neuromimétique en apprentissage non supervisé," in Proc. GRETSI, Nice, France, 1985, pp. 1017-1020.
44. A. Hyvärinen and E. Oja, "A fast fixed-point algorithm for independent component analysis," Neural Computation, vol. 9, no. 7, pp. 1483-1492, 1997.
45. C. Jutten and J. Hérault, "Blind separation of sources I. An adaptive algorithm based on neuromimetic architecture," Signal Processing, vol. 24, no. 1, pp. 1-10, July 1991.
46. J. Karhunen, A. Hyvarinen, R. Vigario, J. Hum, and E. Oja, "Applications of neural blind separation to signal and image processing," in Proc. ICASSP, vol. 1, 1997, pp. 131-134.
47. J. Karhunen, E. Oja, L. Wang, R. Vigârio, and J. Joutsensalo, "A class of neural networks for independent component analysis," IEEE Trans. Neural Networks, vol. 8, pp. 486-504, May 1997.
48. O. Macchi and É. Moreau, "Self-adaptive source separation, Part I: Convergence analysis of a direct linear network controled by the Hérault-Jutten algorithm," IEEE Trans. Signal Processing, vol. 45, pp. 918-926, Apr. 1997.
49. D. J. C. MacKay, submitted for publication.
50. S. Makeig, A. Bell, T.-P. Jung, and T. J. Sejnowski, "Independent component analysis of electroencephalographic data," in Advances in Neural Information Processing Systems, vol. 8. Denver, CO: MIT Press, 1995.
51. P. McCullagh, Tensor Methods in Statistics, (Monographs on Statistics and Applied Probability). London, U.K.: Chapman & Hall, 1987.
52. J. Moody and L. Wu, "What is the 'true price'?-State space models for high frequency financial data," in Progress in Neural Information Processing. Proceedings of the International Conference on Neural Information Processing, vol. 2. New York: Springer-Verlag, 1996, pp. 697-704.
53. E. Moreau and O. Macchi, "High order contrasts for self-adaptive source separation," int. J. Adaptive Contr. Signal Processing, vol. 10, no. 1, pp. 19-46, Jan. 1996.
54. J.-P. Nadal and N. Parga, "Nonlinear neurons in the low-noise limit: A factorial code maximizes information transfer," NETWORK, vol. 5, pp. 565-581, 1994.
55. D. Obradovic and G. Deco, "An information theory based learning paradigm for linear feature extraction," Neurocomputing, vol. 12, pp. 203-221, 1996.
56. B. A. Pearlmutter and L. C. Parra, "A context-sensitive generalization of ICA," presented at Int. Conf. on Neural Information Processing, Hong Kong, 1996.
57. J. Pfanzagl, "Asymptotic expansions related to minimum contrast estimators," Ann. Statistics, vol. 1, no. 6, pp. 993-1026, 1973.
58. D.-T. Pham, "Blind separation of instantaneous mixture of sources via an independent component analysis," LMC IMAG, Grenoble, France, Res. Rep. RT 119, 1994.
59. _, "Blind separation of instantaneous mixture of sources via an independent component analysis," IEEE Trans. Signal Processing, vol. 44, pp. 2768-2779, Nov. 1996.
60. D.-T. Pham and P. Garat, "Séparation aveugle de sources temporellement corrélées," in Proc. GRETSI, 1993, pp. 317-320.
61. _, "Blind separation of mixture of independent sources through a quasimaximum likelihood approach," IEEE Trans. Signal Processing, vol. 45, pp. 1712-1725, July 1997.
62. V. C. Soon, L. Tong, Y. F. Huang, and R. Liu, "An extended fourth order blind identification algorithm in spatially correlated noise," in Proc. ICASSP, 1990, pp. 1365-1368.
63. A. Swindlehurst, M. Goris, and B. Ottersten, "Some experiments with array data collected in actual urban and suburban environments," in IEEE Workshop on Signal Processing Advances in Wireless Communications, Apr. 1997, pp. 301-304.
64. L. Tong, Y. Inouye, and R. Liu, "Waveform preserving blind estimation of multiple independent sources," IEEE Trans. Signal Processing, vol. 41, pp. 2461-2470, July 1993.
65. L. Tong, V. Soon, Y. Huang, and R. Liu, "AMUSE: A new blind identification algorithm," in Proc. ISCAS, 1990.
66. _, "A necessary and sufficient condition for the blind identification of memoryless systems," in Proc. ISCAS, Singapore, vol. 1, pp. 1-4, 1991.
67. A.-J. van der Veen, "Algebraic methods for deterministic blind beamforming," this issue, pp. 1987-2008.
68. H. H. Yang and S. Amari, "Adaptive on-line learning algorithms for blind separation - Maximum entropy and minimum mutual information," Neural Computation, vol. 9, no. 7, pp. 1457-1482, Oct. 1997.
69. D. Yellin and B. Friedlander, "Multi-channel system identification and deconvolution: Performance bounds," in Proc. IEEE SSAP Workshop, Corfu, Greece, 1996, pp. 582-585.
70. N. Yuen and B. Friedlander, "Asymptotic performance analysis of blind signal copy using fourth-order cumulants," int. J. Adaptive Contr. Signal Processing, vol. ?, Mar. 1996, pp. 239-65.