An iterative Bayesian algorithm for sparse component analysis in presence of noise

IEEE Transactions on Signal Processing

Volumn 57, Issue 11, 2009, Pages 4379-4391

  Zayyani, Hadi ^a   Babaie Zadeh, Massoud ^a   Jutten, Christian ^b,c  

^a SHARIF UNIVERSITY OF TECHNOLOGY   (Iran)

^b GIPSA LAB   (France)

^c INSTITUT UNIVERSITAIRE DE FRANCE   (France)

Author keywords

Atomic decomposition; Blind source separation (BSS); Sparse component analysis (SCA); Sparse decomposition; Sparse source separation

Indexed keywords

BAYESIAN NETWORKS; BLIND SOURCE SEPARATION; GAUSSIAN NOISE (ELECTRONIC); GLOBAL OPTIMIZATION; ITERATIVE METHODS; LINEAR EQUATIONS;

ADDITIVE GAUSSIAN NOISE; ATOMIC DECOMPOSITION; MAXIMUM A POSTERIORI ESTIMATION; SIMULATION PARAMETERS; SPARSE COMPONENT ANALYSIS; SPARSE DECOMPOSITION; UNDER-DETERMINED SYSTEMS OF LINEAR EQUATIONS; UNDERDETERMINED SYSTEMS;

PARAMETER ESTIMATION;

EID: 70350517770     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2009.2025154     Document Type: Article

References (50)

1. 1-norm solution is also the sparsest solution," Comm. Pure Appl. Math, vol. 59, no. 6, pp. 797-829, 2006.
2. R. Gribonval and M. Nielsen, "Sparse representations in unions of bases," IEEE Trans. Inf. Theory, vol. 49, no. 12, pp. 3320-3325, Dec. 2003.
3. M. Zibulevsky and B. A. Pearlmutter, "Blind source separation by sparse decomposition in a signal dictionary," Neural Comput., vol. 13, no. 4, pp. 863-882, 2001.
4. D. L. Donoho, M. Elad, and V. Temlyakov, "Stable recovery of sparse overcomplete representations in the presence of noise," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 6-18, Jan. 2006.
5. M. Davies and N. Mitianoudis, "Simple mixture model for sparse over-complete ICA," in Proc. Inst. Electr. Eng. - Vis. Image Signal Process., Feb. 2004, pp. 35-43.
6. Y. Q. Li, S. Amari, A. Cichocki, D. W. C. Ho, and S. Xie, "Underdetermined blind source separation based on sparse representation," IEEE Trans. Signal Process., vol. 54, no. 2, pp. 423-437, Feb. 2006.
7. P. G. Georgiev, F. J. Theis, and A. Cichocki, "Sparse component analysis and blind source separation of underdetermined mixtures," IEEE Trans. Neural Netw., vol. 16, pp. 992-996, Jul. 2005.
8. R. Gribonval and S. Lesage, "A survey of sparse component analysis for blind source separation: Principles, perspectives, and new challenges," in Proc. Eur. Symp. Artificial Neuran Networks (ESANN), Apr. 2006, pp. 323-330.
9. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1999.
10. J. L. Stark, M. Elad, and D. Donoho, "Image decomposition via the combination of sparse representations and a variational approach," IEEE Trans. Image Process., vol. 14, no. 10, pp. 1570-1582, Oct. 2005.
11. M. Elad, R. Goldenberg, and R. Kimmel, "Low bit-rate compression of facial images," IEEE Trans. Image Process., vol. 16, no. 9, pp. 2379-2383, Sep. 2007.
12. M. Elad and M. Aharon, "Image denoising via sparse and redundant representations over learned dictionaries," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3736-3745, 2006.
13. O. G. Guleryuz, "Nonlinear approximation based image recovery using adaptive sparse reconstructions and iterated denoising - Part I: Theory," IEEE Trans. Image Process., vol. 15, no. 3, pp. 539-554, Mar. 2006.
14. E. J. Candès and T. Tao, "Decoding by Linear Programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, Dec. 2005.
15. M. Akcakaya and V. Tarokh, "On sparsity, redundancy and quality of frame representations," in Proc. Int. Symp. Inf. Theory (ISIT , Jun. 2007, pp. 951-955.
16. H. Zayyani, M. Babaie-zadeh, and C. Jutten, "Decoding real-field codes by an iterative Expectation-Maximization (EM) algorithm," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP , Apr. 2008, pp. 3169-3172.
17. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, no. 4, pp. 1289-1306, Apr. 2006.
18. T. Blumensath and M. Davis, "Compressed sensing and source separation," in Proc. IEEE Int. Conf. Acoustics (ICA), Sep. 2007, pp. 341-348.
19. L. Vielva, D. Erdogmus, and C. Principe, "Underdetermined blind source separation using a probabilistic source sparsity model," in Proc. IEEE Int. Conf. Acoustics (ICA), 2001, pp. 675-679.
20. C. Fevotte and S. J. Godsill, "A Bayesian approach for blind separation of sparse sources," IEEE Trans. Speech Audio Process., vol. 14, no. 6, pp. 2174-2188, Nov. 2006.
21. I. F. Gorodnitski and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS: A re-weighted norm minimization algorithm," IEEE Trans. Signal Process., vol. 45, no. 3, pp. 600-616, Mar. 1997.
22. M. Babaie-Zadeh, C. Jutten, and A. Mansour, "Sparse ICA via clusterwise PCA," Neurocomput., vol. 69, pp. 1458-1466, Aug. 2006.
23. A. A. Amini, M. Babaie-Zadeh, and C. Jutten, "A fast method for sparse component analysis based on iterative detection-projection," in MaxEnt'06, AIP Conf. Proc., 2006, vol. 872, pp. 123-130.
24. H. Zayyani, M. Babaie-Zadeh, and C. Jutten, "Source estimation in noisy sparse component analysis," in Proc. 15th Int. Conf. Digital Signal Processing (DSP), Jul. 2007, pp. 219-222.
25. D norm," IEEE Trans. Signal Process., vol. 57, no. 1, pp. 289-301, Jan. 2009.
26. D -norm," in Proc. IEEE Int. Conf. Acoustics (ICA), Sep. 2007, pp. 389-396.
27. H. Zayyani, M. Babaie-Zadeh, G. H. Mohimani, and C. Jutten, "Sparse component analysis in presence of noise using an iterative EM-MAP algorithm," in Proc. IEEE Int. Conf. Acoustics (ICA), Sep. 2007, pp. 438-445.
28. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
29. M. Lewicki and T. J. Sejnowski, "Learning overcomplete representations," Neural Comput., vol. 12, pp. 337-365, 2000.
30. S. Krstulovic and R. Gribonval, "MPTK: Matching pursuit made tractable," in Proc. IEEE Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), May 14-19, 2006, pp. 496-499.
31. Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with application to wavelet decomposition," in Conf. Rec. 27th Asilomar Conf. Signals, Syst. Comput., 1993, pp. 40-44.
32. D. L. Donoho, Y. Tsaig, I. Drori, and J. L. Starck, "Sparse solution of underdetermined linear equations by stagewise orthogonal matching pursuit," Tech. Rep., 2006 [Online]. Available: http:// www-stat.stanford.edu/~idrori/STOMP.pdf
33. D. Wipf and B. D. Rao, "Sparse Bayesian learning for basis selection," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2153-2164, Aug. 2004.
34. S. Ji, Y. Xue, and L. Carin, "Bayesian compressive sensing," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2346-2356, Jun. 2008.
35. T. Blumensath and M. Davies, "Gradient pursuits," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2370-2382, Jun. 2008.
36. M. A. T. Figueirado, R. D. Nowak, and S. J. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE J. Sel. Topics Signal Process. 2007 [Online]. Available: http://www.ece.wisc.edu/~nowak/ GPSR.pdf, to be published
37. A. Dempster,N. Laird, and D. Rubin, "Maximum likelihood estimation from incomplete data via the EM algorithm," J. Roy. Statist. Soc. B, vol. 39, pp. 1-38, 1977.
38. M. A. T. Figueirado and R. D. Nowak, "An EM algorithm for wavelet-based image restoration," IEEE Trans. Image Process., vol. 12, no. 8, pp. 906-916, Aug. 2003.
39. J. M. Mendel, Maximum Likelihood Deconvolution. New York: Springer, 1990.
40. 1 -norm," Geophys., vol. 44, no. 1, pp. 39-52, 1979.
41. J. J. Kormylo and J. M. Mendel, "Maximum likelihood detection and estimation method for sparse deconvolution," IEEE Trans. Inf. Theory vol. 28, no. 3, pp. 482-488, May 1982.
42. M. Lavielle, "Bayesian deconvolution of Bernoulli-Gaussian processes," Signal Process., vol. 33, no. 1, pp. 67-79, Jul. 1993.
43. I. Santamaria-Caballero, C. J. Pantaleon-Prieto, and A. Artes-Rodriguez, "Sparse deconvolution using adaptive mixed-Gaussian models," Signal Process., vol. 54, pp. 161-172, 1996.
44. A. M. Djafari, "Bayesian source separation: Beyond PCA and ICA," in Proc. Eur. Symp. Artificial Neuran Networks (ESANN , Apr. 2006, pp. 313-322.
45. F. Labeau, J. C. Chiang, M. Kieffer, P. Duhamel, L. Vandendorpe, and B. Macq, "Oversampled filter banks as error correcting codes: Theory and impulse noise cancellation," IEEE Trans. Signal Process., vol. 53, no. 12, pp. 4619-4630, Dec. 2005.
46. E. Larsson and Y. Selen, "Linear regression with a sparse parameter vector," IEEE Trans. Signal Process., vol. 55, no. 2, pp. 451-460, Feb. 2007.
47. A. M. Tomasi, Estimating Gaussian Mixture Density With EM - A Tutorial [Online]. Available: http://www.cs.duke.edu/courses/spring04/cps196.1/ handouts/EM/tomasiEM.pdf
48. B. D. Anderson and J. B. Moore, Optimal Filtering. Englewood Cliffs, NJ: Prentice-Hall, 1979.
49. A. Blake and A. Zisserman, Visual Reconstruction. Cambridge, MA: MIT Press, 1987.
50. 1-Magic: Recovery of Sparse Signals Via Convex Programming, 2005 [Online]. Available: http://www.acm.caltech.edu/l1magic/downloads/l1-magic.pdf