Blind separation of independent sources using Gaussian mixture model

IEEE Transactions on Signal Processing

Volumn 55, Issue 7 II, 2007, Pages 3645-3658

  Todros, K ^a   Tabrikian, Joseph ^a  

^a BEN GURION UNIVERSITY OF THE NEGEV   (Israel)

Author keywords

Blind source separation (BSS); Expectation maximization (EM); Gaussian mixture model (GMM); Joint diagonalization; Maximum likelihood (ML)

Indexed keywords

ALGORITHMS; COVARIANCE MATRIX; GAUSSIAN DISTRIBUTION; MAXIMUM LIKELIHOOD ESTIMATION; OPTIMIZATION; SIGNAL INTERFERENCE; SIGNAL TO NOISE RATIO;

GAUSSIAN MIXTURE MODEL; JOINT DIAGONALIZATION; SENSORS DISTRIBUTION PARAMETERS; SEPARATION MATRIX;

BLIND SOURCE SEPARATION;

EID: 34347393688     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2007.894234     Document Type: Article

References (23)

1. J. F. Cardoso, "Blind signal separation: Statistical principles," Proc. IEEE, vol. 86, no. 10, pp. 2009-2025, Oct. 1998.
2. D. T. Pham and J. F. Cardoso, "Blind separation of instantaneous mixtures of nonstationary sources," IEEE Trans. Signal Process., vol. 49, no. 9, pp. 1837-1848, Sep. 2001.
3. J. F. Cardoso, "High-order contrasts for independent component analysis," Neural Comput., vol. 11, pp. 157-192, 1999.
4. E. Moulines, J. F. Cardoso, and E. Gassiat, "Maximum likelihood for blind separation and de-convolution of noisy signals using mixture models," in Proc. ICASSP, 1997, vol. 5, pp. 3617-3620.
5. H. Attias, "Independent factor analysis," Neural Comput., vol. 11, pp. 803-851, 1999.
6. H. Attias, "Independent factor analysis with temporally structured sources," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2000, vol. 12.
7. M. Welling and M. Weber, "A constraint EM algorithm for independent component analysis," Neural Comput., vol. 13, no. 3, pp. 677-689, 2001.
8. M. Davis and N. Mitianoudis, "Simple mixture model for sparse over-complete ICA," IEE Proc. Vis. Image Signal Process., vol. 151, no. 1, pp. 35-43, Feb. 2004.
9. T. W. Lee, M. S. Lewicki, and T. J. Sejnowsi, "ICA mixture models for unsupervised classification of non-Gaussian classes and automatic context switching in blind signal separation," IEEE Trans. Pattern Anal. Machine Lear., vol. 22, no. 10, pp. 1078-1089, Oct. 2000.
10. A. P. Dempster, N. M. Laird, and D. B. Rubin, "Maximum likelihood from incomplete data via the EM algorithm," J. Roy. Statist. Soc., vol. 39B, pp. 1-38, 1977.
11. J. Bilmes, A gentle tutorial on the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models University of Berkely, Tech. Rep. ICSI-TR-97-021, 1997 [Online]. Available: http://www.citeseer.nj.nec.com/bilmes98gentle.html
12. J. J. Verbeek, N. Vlassis, and B. Kröse, "Efficient greedy learning for Gaussian mixture models," Neural Comput., vol. 15, pp. 469-485, 2003.
13. B. N. Flury and W. G. Gautschi, "An algorithm for orthogonal transformation of several positive definite symmetric matrices to nearly diagonal form," SIAM J. Sci. Statist. Comp., vol. 7, no. 1, pp. 169-184, 1984.
14. Q. Li and A. Barron, "Mixture density estimation," in Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press, 2000, vol. 12, pp. 279-285.
15. S. I. Amari, "Differential-geometrical methods in statistics," in Lecture Notes in Statistics. New York: Springer-Verlag, 1985, vol. 28.
16. A. Hyvarnien and E. Oja, "A fast-fixed-point algorithm for independent component analysis," Neural Comput., vol. 9, pp. 1483-1492, 1997.
17. G. Schwarz, "Estimating the dimension of a model," Ann. Statist. vol. 6, pp. 461-464, 1978.
18. A. Barron, J. Rissanen, and B. Yu, "The minimum description length principle in coding and modeling," IEEE Trans. Inf. Theory, vol. 44, no. 6, pp. 2743-2760, Oct. 1998.
19. H. Akaike, "A new look at the statistical model identification," IEEE Trans. Autom. Control, vol. AC-19, pp. 716-723, 1974.
20. S. Kullback and R. A. Leibler, "On information and sufficiency," Ann. Math. Statist., vol. 22, pp. 79-86, 1951.
21. G. Box and G. Tiao, Bayesian Inference in Statistical Analysis. New York: Wiley, 1973.
22. R. A. Horn and C. R. Johnson, Matrix Analysis. Cambridge, U.K.: Cambridge Univ. Press, 1985.
23. M. Abramowitz and I. A. Stegun, Eds., Handbook of Mathematical Functions with Formulas, Graphs and Mathematical Tables, 9th printing New York: Dover, 1972, p. 928.