Survey of sparse and non-sparse methods in source separation

International Journal of Imaging Systems and Technology

Volumn 15, Issue 1, 2005, Pages 18-33

  O'Grady, Paul D ^a,b   Pearlmutter, Barak A ^a,b   Rickard, Scott T ^b,c  

^a NATIONAL UNIVERSITY OF IRELAND   (Ireland)

^b Ollscoil na hÉireann Má Nuad ^*  (United Kingdom)

^c UNIVERSITY COLLEGE DUBLIN   (Ireland)

Author keywords

Blind Sources Separation; Non negative Matrix Factorization; Sparse methods

Indexed keywords

MEDICAL IMAGE ANALYSIS; NON-NEGATIVE MATRIX FACTORIZATION; NON-SPARSE METHODS; SPARSE METHODS;

IMAGE ANALYSIS; MATRIX ALGEBRA; MEDICAL IMAGING; PROBLEM SOLVING; SIGNAL PROCESSING; SPEECH PROCESSING;

BLIND SOURCE SEPARATION;

EID: 25444508285     PISSN: 08999457     EISSN: None     Source Type: Journal    
DOI: 10.1002/ima.20035     Document Type: Review

References (105)

1. S. Amari, A. Cichocki, and H.H. Yang, A new learning algorithm for blind signal separation. In Advances in neural information processing systems, Vol. 8, MIT Press, Cambridge, MA, 1996.
2. J. Anemüller and B. Kollmeier, Adaptive separation of acoustic sources for anechoic conditions: A constrained frequency domain approach, Speech Commun 39 (2003), 79-95.
3. M. Aoki, M. Okamoto, S. Aoki, H. Matsui, T. Sakurai, and Y. Kaneda, Sound source segregation based on estimating incident angle of each frequency component of input signals acquired by multiple microphones, Acoust Sci Technol 22 (2001), 149-157.
4. A.D. Back and A.S. Weigend, A first application of independent component analysis to extracting structure from stock returns, Int J Neural Syst 8 (1997), 473-484.
5. D. Barry, B. Lawlor, and E. Coyle, Sound source separation: Azimuth discrimination and resynthesis, In Proc 7th Int Conf on Digital Audio Effects (DAFX-04),2004, pp. 240-244.
6. P.D. Baxter and J.O. McWhirter, Blind signal separation of convolutive mixtures, In The Thrity-Seventh Asilomar Conf on Signals, Systems and Computers, 2003, pp. 124-128.
7. A.J. Bell and T.J. Sejnowski, An information-maximization approach to blind separation and blind deconvolution, Neural Comput 7 (1995), 1129-1159.
8. A. Belouchrani, K. Abed Meraim, J.-F. Cardoso, and E. Moulines, A blind source separation technique based on second order statistics, IEEE Trans Signal Proc 45 (1997), 434-444.
9. A. Belouchrani and J.-F. Cardoso, Maximum likelihood source separation for discrete sources, In Proc EUSIPCO, 1994, pp. 768-771.
10. P. Bofill, Underdetermined blind separation of delayed sound sources in the frequency domain. Technical Report UPC-DAC-2001-14, Universitat Politecnica de Catalunya, Barcelona, 2002.
11. P, Bofilland M. Zibulevsky, Blind separation of more sources than mixtures using the sparsity of the short-time Fourier transform, In 2nd Int Workshop on Independent Component Analysis and Blind Signal Separation, Helsinki, Finland, June 19-20, 2000, pp. 87-92.
12. P. Bofilland M. Zibulevsky, Underdetermined blind source separation using sparse representations, Signal Process 81 (2001), 2353-2362.
13. A.S. Bregman, Auditory scene analysis: The perceptual organization of sound, MIT Press, Cambridge, MA, 1990. ISBN 0-262-02297-4.
14. J.J. Bussgang, Crosscorrelation functions of amplitude-distorted Gaussian signals, Technical Report 216, MIT Research Laboratory of Electronics, Cambridge, MA, 1952.
15. J.-F. Cardoso, Eigen-structure of the fourth-order cumulant tensor with application to the blind source separation problem, In Proc IEEE Int Conf on Acoustics, Speech and Signal Processing (ICASSP'90), Albuquerque, NM, 1990, pp. 2655-2658.
16. J.-F. Cardoso, Infomax and maximum likelihood for blind source separation IEEE Signal Process Lett 4 (1997), 112-114.
17. J.-F. Cardoso, Blind signal separation: Statistical principles, Proc of the IEEE, 9(10) (1998), 2009-2025. Available at ftp://sig.enst.fr/pub/jfc/ Papers/Proc IEEE.us.ps.gz.
18. J.-F. Cardoso, J. Delabrouille, and G. Patanchon, Independent component analysis of the cosmic microwave background, In Fourth Int Symp on Independent Component Analysis and Blind Signal Separation, Nara, Japan, April 1-4, 2003, pp. 1111-1116.
19. J.-F. Cardosoand A. Souloumiac, Blind beamforming for non-Gaussian signals, IEE Proc F 140(6) (1993), 362-370. Available at ftp://tsi.enst.fr/pub/ jfc/Papers/iee.ps.gz.
20. S.S. Chen, D.L. Donoho, and M.A. Saunders, Atomic decomposition by basis pursuit, SIAM J Sci Comput 20 (1998), 33-61.
21. C.E. Cherry, Some experiments in the recognition of speech, with one and two ears, J Acoust Soc Am 25 (1953), 975-979.
22. C. Choi, Real-time binaural blind source separation, In Fourth Int Symp on Independent Component Analysis and Blind Signal Separation, Nara, Japan, April 1-4, 2003, pp. 567-572.
23. A. Cichockiand S.-I. Amari, Adaptive blind signal and image processing: Learning algorithms and applications, John Wiley & Sons, New York, 2002. ISBN 0-471-60791-6.
24. P. Comon, Independent component analysis: A new concept, Signal Process 36 (1994), 287-314.
25. G. Darmois, Analyse générale des liaisons stochastiques, Rev Inst Int Stat 21 (1953), 2-8.
26. A.P. Dempster, N.M. Laird, and D.B. Rubin, Maximum likelihood from incomplete data via the EM algorithm, J R Stat Soc Ser B 39 (1976), 1-38.
27. M.R. DeWeese, M. Wehr, and A.M. Zador, Binary spiking in auditory cortex, J Neurosci 23 (2003), 7940-7949.
28. P. Divenyi (Editor). Speech separation by humans and machines, Kluwer Academic Publishers, Boston, 2005. ISBN 1-4020-8001-8.
29. D. Donohoand V. Stodden, When does non-negative matrix factorization give a correct decomposition into parts? InAdvances in neural information processing systems 16. MIT Press, Cambridge, MA, 2004. Available at http://books.nips.cc/ papers/files/nips16/NIPS2003_LT10.pdf.
30. J. Du, C.-H. Lee, H.-K. Lee, and Y.-H. Sun, BSS: A new approach for watermark attack, In Proc 4th Int Symp on Multimedia Software Engineering (ISMSE 2002), 2002, pp. 182-187.
31. R.O. Duda, P.E. Hart, and D.G. Stork, Pattern classification, 2nd edition, John Wiley & Sons, New York, 2001.
32. S. Fiori, Notes on cost functions and estimators for 'Bussgang' adaptive blind equalization, Eur Trans Telecommun (ETT) 13 (2002), 631-634.
33. P. Földiák and M. Young, Sparse coding in the primate cortex, In The handbook of brain theory and neural networks,. MIT Press, Cambridge, MA, 1995, pp. 895-898.
34. M. Gaeta and J.-L. Lacoume, Source separation without prior knowledge: The maximum likelihood solution, In Proc EUSIPCO'90, 1990, pp. 621-624.
35. A. Gorokhov, P. Loubaton, and E. Moulines, Second order blind equalization in multiple input multiple output FIR systems: A weighted least squares approach, In Proc IEEE Int Conf on Acoustics, Speech and Signal Processing, Atlanta, GA, May 7-10 1996, pp. 2415-2418.
36. S.S. Haykin, Blind deconvolution, In Information and system sciences, Prentice-Hall, Englewood Cliffs, NJ, 1994. ISBN 0-13-087362-4.
37. J. Herault and C. Jutten, Space or time adaptive signal processing by neural models, In Proc AIP Conf on Neural Networks for Computing, American Institute of Physics, 1986, pp. 206-211.
38. P.O. Hoyer, Non-negative sparse coding, In IEEE Workshop on Neural Networks for Signal Processing, 2002.
39. M.V. Hulle, Kernel-based equiprobabilistic topographic map formation, Neural Comput 10 (1998), 1847-1871.
40. A. Hyvärinen, Survey on independent component analysis, Neural Comput Surv 2(1999), 94-128.
41. A. Hyvärinen, J. Karhunen, and E. Oja, Independent component analysis, John Wiley & Sons, New York, 2001.
42. A. Hyvärinen and E. Oja, A fast fixed-point algorithm for independent component analysis, Neural Comput 9 (1997), 1483-1492.
43. S. Icart and R. Gautier, Blind separation of convolutive mixtures using second and fourth order moments, In Proc IEEE Int Conf on Acoustics, Speech, and Signal Processing (ICASSP'96), Atlanta, GA, USA, May 1996, pp. 3018-3021.
44. A. Jourjine, S. Rickard, and O. Yilmaz, Blind separation of disjoint orthogonal signals: Demixing N sources from 2 mixtures, In Proc IEEE Conf on Acoustics, Speech, and Signal Processing (ICASSP2000), June 2000, Vol. 5, pp. 2985-2988.
45. T.-P. Jung, C. Humphries, T.-W. Lee, M.J. McKeown, V. Iragui, S. Makeig, and T.J. Sejnowski, Removing electroencephalographic artifacts by blind source separation, Psychophysiology 37 (2000), 163-178.
46. T.-P. Jung, S. Makeig, M. Westerfield, J. Townsend, E. Courchesne, and T.J. Sejnowski, Analyzing and visualizing single-trial event-related potentials, In Advances in neural information processing systems, Vol. 11, MIT Press, Cambridge, MA, 1999, pp. 118-124.
47. C, Jutten and J. Herault, Blind separation of sources, part I: An adaptive algorithm based on neuromimetic architecture, Signal Process 24 (1991), 1-10.
48. Y. Katayama, M. Ito, A.K. Barros, Y. Takeuchi, T. Matsumoto, H. Kudo, N. Ohnishi, and T. Mukai, Closely arranged directional microphone for source separation: Effectiveness in reduction of the number of taps and preventing factors, In Fifth Int Conf on Independent Component Analysis, Granada, Spain, Sept. 22-24, 2004, Lecture Notes in Computer Science, Vol. 3195, Springer-Verlag.
49. M. Kearns, Y. Mansour, and A.Y. Ng, An information-theoretic analysis of hard and soft assignment methods for clustering. Proc Thirteenth Conf on Uncertainty in Artificial Intelligence, 1997, pp. 282-293.
50. K.P. Körding, P. König, and D.J. Klein, Learning of sparse auditory receptive fields, In Int Joint Conf on Neural Networks, 2002. Available at http://www.koerding.com/pubs/KKKijcnn01.pdf.
51. R.H. Lambert, A new method for source separation, In Proc IEEE Conference on Acoustics, Speech, and Signal Processing, Detroit, MI, 1995, pp. 2116-2119.
52. R.H. Lambert, Multichannel blind deconvolution: fir matrix algebra and separation of multipath mixtures. Ph.D. thesis, Univ of Southern California, 1996.
53. R. Lambert and A. Bell, Blind separation of multiple speakers in a multipath environment, In Proc IEEE Int Conf on Acoustics, Speech, and Signal Processing (ICASSP'97), Munich, Germany, April 1997, pp. 423-426.
54. D.D. Lee and H.S. Seung, Learning the parts of objects with nonnegative matric factorization, Nature 401 (1999), 788-791.
55. D.D. Lee and H.S. Seung, Algorithms for non-negative matrix factorization, In Advances in neural information processing systems, Vol. 13, MIT Press, Cambridge, MA, 2001 pp. 556-562. Available at citeseer.ist.psu.edu/ lee00algorithms.html.
56. T.-W. Lee, M.S. Lewicki, M. Girolami, and T.J. Sejnowski, Blind source separation of more sources than mixtures using overcomplete representations, IEEE Signal Process Lett 4 (1999), 87-90.
57. M. Lewicki and T. Sejnowski, Learing overcomplete representations, In Advances in neural information processing systems, Vol. 10, MIT Press, Cambridge, MA, 1998, pp. 556-562.
58. J.K. Lin, D.G. Grier, and J.D. Cowan, Feature extraction approach to blind source separation, In IEEE Workshop on Neural Networks for Signal Processing (NNSP), 1997, pp. 398-405.
59. R. Linsker, An application of the principle of maximum information preservation to linear systems, In Advances in neural information processing systems, Morgan Kaufmann, San Francisco, CA, 1989, pp. 186-194.
60. L. Ljung and J. Sjöberg, A comment on leaking in adaptive algorithms, In 4th IFAC Int Symp on Adaptive Systems in Control and Signal Processing, ACASP92, 1992, pp. 377-382.
61. J. MacQueen, Some methods for classification and analysis of multivariate observations, In L. M. L. Cam and J. Neyman (Editors), Proc of the Fifth Berkeley Symp on Mathematical Statistics and Probability, Berkeley, Vol. 1, University of California Press, 1967, pp. 281-297.
62. M.J. McKeown, S. Makeig, G.G. Brown, T.P. Jung, S.S. Kindermann, A.J. Bell, and T.J. Sejnowski, Analysis of fMRI data by blind separation into independent spatial components, Hum Brain Mapp 6 (1998), 160-188.
63. N. Murata, S. Ikeda, and A. Ziehe, An approach to blind source separation based on temporal structure of speech signals, Neurocomputing 41 (2001), 1-24.
64. K. Nakadai, H.G. Okuno, and H. Kitano, Real-time sound source localization and separation for robot audition. In Proc of 2002 Int Conf on Spoken Language Processing (ICSLP-2002), 2002, pp. 193-196.
65. P.D. O'Grady and B.A. Pearlmutter, Hard-LOST: Modified k-means for oriented lines. In Proc Irish Signals and Systems Conf, Belfast, June 30-July 2, 2004a, pp. 247-252.
66. P.D. O'Grady and B.A. Pearlmutter, Soft-LOST: EM on a mixture of oriented lines. In Fifth Int Conf on Independent Component Analysis, Granada, Spain, Sept. 22-24, 2004b, Lecture Notes In Computer Science, Vol. 3195, Springer-Verlag, pp. 430-436
67. L. Parra, K.-R. Mueller, C. Spence, A. Ziehe, and P. Sajda, Unmixing hyper-spectral data, In Advances in neural information processing systems, Vol. 13, MIT Press, Cambridge, MA, 2000, pp. 942-948.
68. L. Parra and P. Sajda, Blind source separation via generalized eigenvalue decomposition, J Machine Leam Res 4 (2003), 1261-1269.
69. B.A. Pearlmutter and S. Jaramillo, Progress in blind separation of magnetoencephalographic data, In Independent component analyses, wavelets, and neural networks, Proceeding of the SPIE, Vol. 5102, 2003, pp. 129-134.
70. B.A. Pearlmutter and L.C. Parra, A context-sensitive generalization of ICA, In Int Conf on Neural Information Processing, Hong Kong, Sept. 24-27, 1996, Springer-Verlag, pp. 151-157. Available at http://www-bcl.cs.may.ie/~barak/ papers/iconip-96-cica.ps.gz.
71. B.A. Pearlmutter and A.M. Zador, Monaural source separation using spectral cues, In Fifth Int Conf on Independent Component Analysis, Granada, Spain, Sept. 22-24, 2004, Lecture Notes in Computer Science, Vol. 3195, Springer-Verlag, pp. 478-485.
72. K. Pearson, On lines and planes of closest fit to systems of points in space, Philos Mag 2 (1901), 559-572.
73. D.T. Pham, P. Garrat, and C. Jutten, Separation of a mixture of independent sources through a maximum likelihood approach, In European Signal Processing Conf, 1992, pp. 771-774.
74. J.C. Platt and F. Faggin, Networks for the separation of sources that are superimposed and delayed, In Advances in neural information processing systems, Vol. 4, Morgan Kaufmann, San Francisco, CA, 1992, pp. 730-737.
75. M.D. Plumbley, Algorithms for non-negative independent component analysis, IEEE Trans Neural Netw 14 (2003), 534-543.
76. S. Rickard, R. Balan, and J. Rosca, Real-time time-frequency based blind source separation, In 3rd Int Conf on Independent Component Analysis and Blind Source Separation (ICA2001), Dec 2001.
77. S. Rickard and O. Yilmaz, On the approximate W-disjoint orthogonality of speech. In J. Principe and H. Bourlard (Editors), Proc IEEE Int Conf on Acoustics, Speech and Signal Processing, 2002, pp. 529-532.
78. S.J. Roberts and R.M. Everson (Editors), Independent components analysis: Principles and practice, Cambridge University Press, Cambridge, UK, 2001.
79. Z. Roth and Y. Baram, Multi-dimensional density shaping by sigmoids, IEEE Trans Neural Netw 7 (1996), 1291-1298.
80. S.T. Roweis, One microphone source separation, In Advances in neural information processing systems, Vol. 13, MIT Press, Cambridge, MA, 2001, pp. 793-799.
81. H. Sahlin and H. Broman, Separation of real-world signals, Signal Process 64(1998), 103-113.
82. J.M. Sanchis, F. Castells, and J.J. Rieta, Convolutive acoustic mixtures approximation to an instantaneous model using a stereo boundary microphone configuration, In Fifth Int Conf on Independent Component Analysis, Granada, Spain, Sept. 22-24, 2004, Lecture Notes in Computer Science, Vol. 3195, Springer-Verlag, pp. 816-823.
83. P. Smaragdis, Blind separation of convolved mixtures in the frequency domain, Neurocomputing 22 (1998), 21-34.
84. P. Smaragdis, Non-negative matrix factor deconvolution; extraction of multiple sound sources from monophonic inputs, In Fifth Int Conf on Independent Component Analysis, Granada, Spain, Sept. 22-24, 2004, Lecture Notes in Computer Science, Vol. 3195, Springer-Verlag, pp. 494-499.
85. 1 norm signal recovery in underdetermined source separation, In Fifth Int Conf on Independent Component Analysis, Granada, Spain, Sept. 22-24, 2004, Lecture Notes in Computer Science, Vol. 3195, Springer-Verlag, pp. 193-200.
86. A.C. Tang, B.A. Pearlmutter, M. Zibulevsky, and S.A. Carter, Blind separation of multichannel neuromagnetic responses, Neurocomputing 32-33 (2000), 1115-1120.
87. F.J. Theis, A geometric algorithm for overcomplete linear ICA, In Workshop Report I of the Graduiertenkolleg, Windberg, 2001, pp. 67-76.
88. K. Torkkola, Blind separation of convolved sources based on information maximization, In Proc IEEE Workshop on Neural Networks and Signal Processing (NNSP'96), Kyoto, Japan, 1996a, pp. 423-432.
89. K. Torkkola, Blind separation of delayed sources based on information maximization, In Proc IEEE Int Conf on Acoustics, Speech and Signal Processing (ICASSP'96), Atlanta, GA, 1996b, pp. 3509-3512.
90. P.P. Vaidyanathan, Multirate Systems and Filter Banks. Prentice-Hall, Englewood Cliffs, NJ, 1993.
91. M. van Hulle, Clustering approach to square and non-square blind source separation, In IEEE Workshop on Neural Networks for Signal Processing (NNSP), 1999, pp. 315-323.
92. L. Vielva, D. Erdogmus, C. Pantaleon, I. Santamaria, J. Pereda, and J. Principe, Underdetermined blind source separation in a time-varying environment, In J. Principe and H. Bourlard (Editors), Proc IEEE Int Conf on Acoustics, Speech and Signal Processing, Vol. 3, 2002, pp. 3049-3052.
93. L. Vielva, D. Erdogmus, and J. Principe, Underdetermined blind source separation using a probabilistic source sparsity model, In 2nd Int Workshop on Independent Component Analysis and Blind Signal Separation, Helsinki, Finland, June 19-20, 2000, pp. 675-679.
94. R. Vigário, J. Ss̈relä, V. Jousmäki, M. Hämäläinen, and E. Oja, Independent component approach to the analysis of EEG and MEG recordings, IEEE Trans Biomed Eng 47 (2000), 589-593.
95. T. Virtanen, Sound source separation using sparse coding with temporal continuity objective, In Proc Int Computer Music Conf (ICMC 2003), 2003.
96. A. Westnerand V.M. Bove, Blind separation of real world audio signals using overdetermined mixtures, In First Int Conf on Independent Component Analysis, 1999.
97. B. Widrow, J. Glover, J. McCool, J. Kaunitz, C. Williams, R. Hearn, J. Zeidler, E. Dong, and R. Goodlin, Adaptive noise cancelling: Principles and applications, Proc IEEE 63(12) (1975), 1692-1716.
98. N. Wiener, Extrapolation, interpolation and smoothing of stationary time series, MIT Press, Cambridge, MA, 1949.
99. G. Wübbeler, A. Ziehe, B.-M. Mackert, K.-R. Müller, L. Trahms, and G. Curio, Independent component analysis of non-invasively recorded cortical magnetic DC-fields in humans, IEEE Trans Biomed Eng 47 (2000), 594-599.
100. A. Yeredor, Approximate joint diagonalization using non-orthogonal matrices, Proc ICA 2000, June 2000, pp. 33-38.
101. A. Yeredor, Blind source separation with pure delay mixtures, In Int Workshop on Independent Component Analysis and Blind Source Separation Conference (ICA), San Diego, CA, Dec. 9-12, 2001.
102. O. Yilmazand S. Rickard, Blind separation of speech mixtures via time-frequency masking, IEEE Trans Signal Process 52 (2004), 1830-1847.
103. M. Zibulevsky, P. Kisilev, Y.Y. Zeevi, and B.A. Pearlmutter. Blind source separation via multinode sparse representation, In Advances in neural information processing systems, Vol. 14, MIT Press, Cambridge, MA, 2002, pp. 1049-1056.
104. M. Zibulevskyand B.A. Pearlmutter, Blind source separation by sparse decomposition in a signal dictionary, Neural Comput 13 (2001), 863-882.
105. A. Ziehe, K.-R. Müller, G. Nolte, B.-M. Mackert, and G. Curio, Artifact reduction in magnetoneurography based on time-delayed second order correlations, IEEE Trans Biomed Eng 47 (2000), 75-87.