Mixing matrix estimation from sparse mixtures with unknown number of sources

IEEE Transactions on Neural Networks

Volumn 22, Issue 2, 2011, Pages 211-221

  Zhou, Guoxu ^a   Yang, Zuyuan ^a   Xie, Shengli ^a   Yang, Jun Mei ^a  

^a SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

Author keywords

Blind source separation; particle swarm optimization; sparse component analysis

Indexed keywords

LOCAL MAXIMUM; MIXING MATRIX; NONLINEAR PROJECTIONS; OBJECTIVE FUNCTIONS; SPARSE COMPONENT ANALYSIS;

ESTIMATION; MATRIX ALGEBRA; MIXING; PARTICLE SWARM OPTIMIZATION (PSO);

BLIND SOURCE SEPARATION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; ARTIFICIAL NEURAL NETWORK; AUTOMATED PATTERN RECOGNITION; COMPUTER SIMULATION; INFORMATION PROCESSING; METHODOLOGY; NONLINEAR SYSTEM; STANDARD; STATISTICS;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; AUTOMATIC DATA PROCESSING; COMPUTER SIMULATION; NEURAL NETWORKS (COMPUTER); NONLINEAR DYNAMICS; PATTERN RECOGNITION, AUTOMATED;

EID: 79951677607     PISSN: 10459227     EISSN: None     Source Type: Journal    
DOI: 10.1109/TNN.2010.2091427     Document Type: Article

References (51)

1. S. Haykin, Unsupervised Adaptive Filtering, Blind Source Separation, vol. 1. New York: Wiley, 2000.
2. A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis. New York: Wiley, 2001.
3. A. Cichocki and S. Amari, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. New York: Wiley, 2002.
4. P. Bofill and M. Zibulevsky, "Underdetermined blind source separation using sparse representations," Signal Process., vol. 81, no. 11, pp. 2353- 2362, Nov. 2001. (Pubitemid 32943462)
5. J. W.-H. Kao, S. M. Berber, and V. Kecman, "Blind multiuser detector for chaos-based CDMA using support vector machine," IEEE Trans. Neural Netw., vol. 21, no. 8, pp. 1221-1231, Aug. 2010.
6. Y. Xiang, S. K. Ng, and V. K. Nguyen, "Blind separation of mutually correlated sources using precoders," IEEE Trans. Neural Netw., vol. 21, no. 1, pp. 82-90, Jan. 2010.
7. D. Liu, S. Hu, and H. Zhang, "Simultaneous blind separation of instantaneous mixtures with arbitrary rank," IEEE Trans. Circuits Syst. I: Regular Papers, vol. 53, no. 10, pp. 2287-2298, Oct. 2006. (Pubitemid 44637795)
8. J. Karhunen, E. Oja, L. Y. Wang, R. Vigario, and J. Joutsensalo, "A class of neural networks for independent component analysis," IEEE Trans. Neural Netw., vol. 8, no. 3, pp. 486-504, May 1997. (Pubitemid 127767795)
9. A. Hyvarinen, "Fast and robust fixed-point algorithms for independent component analysis," IEEE Trans. Neural Netw., vol. 10, no. 3, pp. 626- 634, May 1999.
10. M. Novey and T. Adah, "Complex ICA by negentropy maximization," IEEE Trans. Neural Netw., vol. 19, no. 4, pp. 596-609, Apr. 2008. (Pubitemid 351583577)
11. H. Shen, M. Kleinsteuber, and K. Huper, "Local convergence analysis of FastICA and related algorithms," IEEE Trans. Neural Netw., vol. 19, no. 6, pp. 1022-1032, Jun. 2008.
12. Y. Washizawa, Y. Yamashita, T. Tanaka, and A. Cichocki, "Blind extraction of global signal from multi-channel noisy observations," IEEE Trans. Neural Netw., vol. 21, no. 9, pp. 1472-1481, Sep. 2010.
13. F. Georgiev, F. Theis, and A. Cichocki, "Blind source separation and sparse component analysis of overcomplete mixtures," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Montreal, QC, Canada, May 2004, pp. 493-496.
14. O. Yilmaz and S. Rickard, "Blind separation of speech mixtures via time-frequency masking," IEEE Trans. Signal Process., vol. 52, no. 7, pp. 1830-1847, Jul. 2004.
15. A. E. B. Abdeldjalil, L. T. Nguyen, A. M. Karim, B. Adel, and G. Yves, "Underdetermined blind separation of nondisjoint sources in the time-frequency domain," IEEE Trans. Signal Process., vol. 55, no. 3, pp. 897-907, Mar. 2007.
16. R. Saab, O. Yilmaz, M. J. McKeown, and R. Abugharbieh, "Underdetermined anechoic blind source separation viaλ q -basis-pursuit with q 1," IEEE Trans. Signal Process., vol. 55, no. 8, pp. 4004-4017, Aug. 2007. (Pubitemid 47261523)
17. Y. Q. Li, A. Cichocki, S. Amari, S. L. Xie, and C. T. Guan, "Equivalence probability and sparsity of two sparse solutions in sparse representation," IEEE Trans. Neural Netw., vol. 19, no. 12, pp. 2009-2021, Dec. 2008.
18. Y. Q. Li, A. Cichocki, and S. I. Amari, "Blind estimation of channel parameters and source components for EEG signals: A sparse factorization approach," IEEE Trans. Neural Netw., vol. 17, no. 2, pp. 419-431, Mar. 2006.
19. P. Georgiev, F. Theis, and A. Cichocki, "Sparse component analysis and blind source separation of underdetermined mixtures," IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 992-996, Jul. 2005. (Pubitemid 41064331)
20. C. Fevotte, S. J. Godsill, and P. J. Wolfe, "Bayesian approach for blind separation of underdetermined mixtures of sparse sources," in Proc. 5th Int. Conf. Independent Compon. Anal. Blind Signal Separation, Granada, Spain, Sep. 2004, pp. 398-405. (Pubitemid 39751057)
21. B. D. Rao, K. Engan, S. R. Cotter, J. Pahner, and K. Kreutz-Delgado, "Subset selection in noise based on diversity measure minimization," IEEE Trans. Signal Process., vol. 51, no. 3, pp. 760-770, Mar. 2003.
22. R. Zdunek and A. Cichocki, "Improved M-FOCUSS algorithm with overlapping blocks for locally smooth sparse signals," IEEE Trans. Signal Process., vol. 56, no. 10, pp. 4752-4761, Oct. 2008.
23. Z. S. He, A. Cichocki, R. Zdunek, and S. L. Xie, "Improved FOCUSS method with conjugate gradient iterations," IEEE Trans. Signal Process., vol. 57, no. 1, pp. 399-404, Jan. 2009.
24. H. Mohimani, M. Babaie-Zadeh, and C. Jutten, "A fast approach for overcomplete sparse decomposition based on smoothedλ0 norm," IEEE Trans. Signal Process., vol. 57, no. 1, pp. 289-301, Jan. 2009.
25. P. D. O'Grady and B. A. Pearlmutter, "Soft-LOST: EM on a mixture of oriented lines," in Proc. 5th Int. Conf. Independent Compon. Anal. Blind Signal Separation, Granada, Spain, Sep. 2004, pp. 430-436. (Pubitemid 39751061)
26. A. Aissa-El-Bey, N. Linh-Trung, K. Abed-Meraim, A. Belouchrani, and Y. Grenier, "Underdetermined blind separation of nondisjoint sources in the time-frequency domain," IEEE Trans. Signal Process., vol. 55, no. 3, pp. 897-907, Mar. 2007. (Pubitemid 46444231)
27. S. Araki, H. Sawada, R. Mukai, and S. Makino, "Underdetermined blind sparse source separation for arbitrarily arranged multiple sensors," Signal Process., vol. 87, no. 8, pp. 1833-1847, Aug. 2007. (Pubitemid 46604754)
28. S. P. Floyd, "Least squares quantization in PCM," IEEE Trans. Inform. Theory, vol. 28, no. 2, pp. 129-136, Mar. 1982.
29. D. Arthur and S. Vassilvitskii, "k-means++: The advantages of careful seeding," in Proc. 18th Annu. ACM-SIAM Symp. Discrete Algorithms, Philadelphia, PA, Jun. 2007, pp. 1027-1035.
30. G. W. Milligan and M. C. Cooper, "An examination of procedures for determining the number of clusters in a data set," Psychometrika, vol. 50, no. 2, pp. 159-179, Jun. 1985.
31. R. Kothari and D. Pitts, "On finding the number of clusters," Pattern Recognit. Lett., vol. 20, no. 4, pp. 405-416, Apr. 1999. (Pubitemid 29377623)
32. R. Tibshirani, G. Walther, and T. Hastie, "Estimating the number of clusters in a data set via the gap statistic," J. Royal Statist. Soc. Ser. B-Statist. Methodol., vol. 63, no. 2, pp. 411-423, 2001.
33. L. Wang, C. Leckie, K. Ramamohanarao, and J. Bezdek, "Automatically determining the number of clusters in unlabeled data sets," IEEE Trans. Knowl. Data Eng., vol. 21, no. 3, pp. 335-350, Mar. 2009.
34. A. Cichocki, J. Karhunen, W. Kasprzak, and R. Vigario, "Neural networks for blind separation with unknown number of sources," Neurocomputing, vol. 24, nos. 1-3, pp. 55-93, Feb. 1999. (Pubitemid 29098849)
35. F. Desobry and C. Fevotte, "Kernel PCA based estimation of the mixing matrix in linear instantaneous mixtures of sparse sources," in Proc. IEEE Int. Conf. Acoust., Speech Signal Process., Toulouse, France, May 2006, pp. 669-672.
36. Q. Lv and X. D. Zhang, "A unified method for blind separation of sparse sources with unknown source number," IEEE Signal Process. Lett., vol. 13, no. 1, pp. 49-51, Jan. 2006. (Pubitemid 43072460)
37. P. D. O'Grady and B. A. Pearlmutter, "The LOST algorithm: Finding lines and separating speech mixtures," EURASIP J. Adv. Signal Process., vol. 2008, pp. 784296-1-784296-19, Dec, 2008.
38. H. Frigui and R. Krishnapuram, "A robust algorithm for automatic extraction of an unknown number of clusters from noisy data," Pattern Recognit. Lett., vol. 17, no. 12, pp. 1223-1232, Oct. 1996. (Pubitemid 126384217)
39. J. Kennedy and R. C. Eberhart, "Particle swarm optimization," in Proc. IEEE Int. Conf. Neural Netw., Perth, WA, Australia, Nov.-Dec. 1995, pp. 1942-1948.
40. D. Merkle and M. Middendorf, "Swarm intelligence and signal processing," IEEE Signal Process. Mag., vol. 25, no. 6, pp. 152-158, Nov. 2008.
41. F. V. D. Bergh and A. P. Engelbrecht, "A cooperative approach to particle swarm optimization," IEEE Trans. Evol. Comput., vol. 8, no. 3, pp. 225- 239, Jun. 2004.
42. M. E. H. Pedersen and A. J. Chipperfield, "Simplifying particle swarm optimization," Appl. Soft Comput., vol. 10, no. 2, pp. 618-628, Mar. 2010.
43. Z. H. Zhan, J. Zhang, Y. Li, and H. S. H. Chung, "Adaptive particle swarm optimization," IEEE Trans. Syst. Man, Cybern., Part B: Cybern., vol. 39, no. 6, pp. 1362-1381, Dec. 2009.
44. D. Y. Chen, L. M. Zhang, and J. Y. Weng, "Spatio-temporal adaptation in the unsupervised development of networked visual neurons," IEEE Trans. Neural Netw., vol. 20, no. 6, pp. 992-1008, Jun. 2009.
45. S. S. Rao, Engineering Optimization: Theory and Practice, 4th ed. New York: Wiley, 2009.
46. M. Jiang, Y. P. Luo, and S. Y. Yang, "Stochastic convergence analysis and parameter selection of the standard particle swarm optimization algorithm," Inform. Process. Lett., vol. 102, no. 1, pp. 8-16, Apr. 2007. (Pubitemid 46186357)
47. I. C. Trelea, "The particle swarm optimization algorithm: Convergence analysis and parameter selection," Inform. Process. Lett., vol. 85, no. 6, pp. 317-325, Mar. 2003.
48. T. J. Theis, E. W. Lang, and C. G. Puntonet, "A geometric algorithm for overcomplete linear ICA," Neurocomputing, vol. 56, no. 1, pp. 381-398, Jan. 2004. (Pubitemid 38145634)
49. W. Zhang, J. Liu, J. Sun, and S. Z. Bai, "A new two-stage approach to underdetermined blind source separation using sparse representation," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Honolulu, HI, Apr. 2007, pp. 953-956.
50. D. J. C. MacKay, "An example inference task: Clustering," in Information Theory, Inference and Learning Algorithms. Cambridge, U.K.: Cambridge Univ. Press, 2003, ch. 20, pp. 284-292.
51. geoICA [Online]. Available: http://www.biologie.uniregensburg. de/Biophysik/Theis/research/geoICA.zip