K-hyperline clustering learning for sparse component analysis

Signal Processing

Volumn 89, Issue 6, 2009, Pages 1011-1022

  He, Zhaoshui ^a,b   Cichocki, Andrzej ^a,c,d   Li, Yuanqing ^b   Xie, Shengli ^b   Sanei, Saeid ^e  

^a RIKEN BRAIN SCIENCE INSTITUTE   (Japan)

^b SOUTH CHINA UNIVERSITY OF TECHNOLOGY   (China)

^c SYSTEMS RESEARCH INSTITUTE   (Poland)

^d WARSAW UNIVERSITY OF TECHNOLOGY   (Poland)

^e CARDIFF UNIVERSITY   (United Kingdom)

Author keywords

Blind source separation; Disjoint orthogonality condition; K means clustering; K SVD; Sparse component analysis (SCA); Sparse representation

Indexed keywords

APARTMENT HOUSES; CLUSTER ANALYSIS; CLUSTERING ALGORITHMS; MULTILAYERS; SIGNAL ANALYSIS; SINGULAR VALUE DECOMPOSITION; WATER SUPPLY SYSTEMS;

DISJOINT ORTHOGONALITY CONDITION; K-MEANS CLUSTERING; K-SVD; SPARSE COMPONENT ANALYSIS (SCA); SPARSE REPRESENTATION;

BLIND SOURCE SEPARATION;

EID: 60749095388     PISSN: 01651684     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.sigpro.2008.12.005     Document Type: Article

References (37)

1. Li Y.Q., Cichocki A., and Amari S. Analysis of sparse representation and blind source separation. Neural Computation 16 (2004) 1193-1234
2. He Z., Xie S., Ding S., and Cichocki A. Convolutive blind source separation in frequency domain based on sparse representation. IEEE Transactions on Audio, Speech and Language Processing 15 5 (2007) 1551-1563
3. He Z., Xie S., Zhang L., and Cichocki A. A note on Lewicki-Sejnowski gradient for learning overcomplete representation. Neural Computation 20 3 (2008) 636-643
4. Olshausen B.A., and Field D.J. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature 381 6583 (1996) 607-609
5. Zibulevsky M., and Pearlmutter B.A. Blind source separation by sparse decomposition in a signal dictionary. Neural Computation 13 (2001) 863-882
6. Cichocki A., and Amari S. Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications (2003), Wiley, New York
7. Li Y.Q., Cichocki A., and Amari S. Blind estimation of channel parameters and source components for EEG signals: a sparse factorization approach. IEEE Transactions on Neural Networks 17 2 (2006) 419-431
8. Gorodnitsky I.F., and Rao B.D. Sparse signal reconstruction from limited data using focuss: a recursive weighted minimum norm algorithm. IEEE Transactions on Signal Processing 45 3 (1997) 600-616
9. Aharon M., Elad M., and Bruckstein A.M. The K-SVD: an algorithm for designing of overcomplete dictionaries for sparse representation. IEEE Transactions on Signal Processing 54 11 (2006) 4311-4322
10. Bofill P., and Zibulevsky M. Underdetermined blind source separation using sparse representations. Signal Processing 81 (2001) 2353-2362
11. Lee T.W., Lewicki M.S., Girolami M., and Sejnowski T.J. Blind source separation of more sources than mixtures using overcomplete representation. IEEE Signal Processing Letter 6 4 (1999) 87-90
12. Lewicki M.S., and Sejnowski T.J. Learning overcomplete representations. Neural Computation 12 2 (2000) 337-365
13. Girolami M. A variational method for learning sparse and overcomplete representations. Neural Computation 13 11 (2001) 2517-2532
14. Li Y.Q., Amari S., Cichocki A., Ho D.W.C., and Xie S.L. Underdetermined blind source separation based on sparse representation. IEEE Transactions on Signal Processing 54 2 (2006) 423-437
15. Yilmaz O., and Rickard S. Blind separation of speech mixtures via time-frequency masking. IEEE Transactions on Signal Processing 52 7 (2004) 1830-1847
16. Abrard F., and Deville Y. A time-frequency blind signal separation method applicable to underdetermined mixtures of dependent sources. Signal Processing 85 7 (2005) 1389-1403
17. A. Jourjine, S. Rickard, Ö. Yilmaz, Blind separation of disjoint orthogonal signals: demixing n sources from 2 mixtures, in: Proceeding of IEEE Conference on Acoustics, Speech, and Signal Processing (ICASSP2000), vol. 5, Istanbul, Turkey, 2000, pp. 2985-2988.
18. Chen S., Donoho D.L., and Saunders M.A. Atomic decomposition by basis pursuit. SIAM Journal on Scientific Computing 20 1 (1998) 33-61
19. 1 minimization. Proceedings of the National Academy of Sciences 100 (2003) 2197-2202
20. 1-norm solutions for underdetermined source separation. IEEE Transactions on Signal Processing 52 3 (2004) 582-591
21. Cotter S.F., Rao B.D., Engan K., and Kreutz-Delgado K. Sparse solutions to linear inverse problems with multiple measurement vectors. IEEE Transactions on Signal Processing 53 7 (2005) 2477-2488
22. Kreutz-Delgado K., Murry J.F., Rao B.D., et al. Dictionary learning algorithms for sparse representation. Neural Computation 15 (2003) 349-396
23. Hartigan J.A., and Wong M.A. A K-means clustering algorithm. Applied Statistics 28 1 (1979) 100-108
24. Theis F., Puntonet C., and Lang E. Median-based clustering for underdetermined blind signal processing. IEEE Signal Processing Letters 13 2 (2006) 96-99
25. Theis F., Jung A., Puntonet C., and Lang E. Linear geometric ICA: fundamentals and algorithms. Neural Computation 15 (2003) 419-439
26. P.D. O'Grady, B.A. Pearlmutter, Soft-LOST: EM on a mixture of oriented lines, in: International Conference on Independent Component Analysis 2004, 2004, pp. 428-435.
27. He Z.S., Xie S.L., and Fu Y.L. Sparse representation and blind source separation of ill-posed mixtures. Science in China Series F-Information Sciences 49 5 (2006) 639-652
28. S. Arberet, R. Gribonval, F. Bimbot, A robust method to count and locate audio sources in a stereophonic linear instantaneous mixture, in: Proceedings of ICA 2006, Charleston SC, USA, 2006, pp. 536-543.
29. Z.S. He, A. Cichocki, K-EVD clustering and its applications to sparse component analysis, in: Proceedings of ICA 2006, Charleston SC, USA, 2006, pp. 90-97.
30. Babaie-Zadeh M., Jutten C., and Mansour A. Sparse ICA via cluster-wise PCA. Neurocomputing 69 13-15 (2006) 1458-1466
31. Dempster A., Laird N., and Rubin D. Maximum likelihood from incomplete data via the EM algorithm. Journal of the Royal Statistical Society, Series B 39 1 (1977) 1-38
32. G. McLachlan, T. Krishnan, The EM Algorithm and Extensions, in: Wiley Series in Probability and Statistics, Wiley, New York, 1997.
33. Cichocki A., and Zdunek R. Multilayer nonnegative matrix factorization. Electronics Letters 42 16 (2006) 947-948
34. Neill D., Moore A., et al. Detecting significant multidimensional spatial clusters. Advances in Neural Information Processing Systems 17 (2005) 969-976
35. A. Cichocki, D. Erdogmus, MLSP 2005 competition: large scale, ill-conditioned blind source separation with limited number of samples, 2005, website: 〈http://mlsp2005.conwiz.dk/fileadmin/Cichocki.pdf〉.
36. Tropp J.A. Greed is good: algorithmic results for sparse approximation. IEEE Transactions on Information Theory 50 10 (2004) 2231-2242
37. Horn R.A., and Johnson C.R. Matrix Analysis (1999), Cambridge University Press, Cambridge