A fast approach for overcomplete sparse decomposition based on smoothed ℓ0 norm

IEEE Transactions on Signal Processing

Volumn 57, Issue 1, 2009, Pages 289-301

  Mohimani, Hosein ^a   Babaie Zadeh, Massoud ^a   Jutten, Christian ^b  

^a SHARIF UNIVERSITY OF TECHNOLOGY   (Iran)

^b GIPSA LAB   (France)

Author keywords

Atomic decomposition; Blind source separation (BSS); Compressed sensing; Overcomplete signal representation; Sparse component analysis (SCA); Sparse decomposition; Sparse source separation

Indexed keywords

ALGORITHMS; APARTMENT HOUSES; ATOMIC PHYSICS; ATOMS; DECODING; INDEPENDENT COMPONENT ANALYSIS; LINEARIZATION; OBJECT RECOGNITION; SEPARATION; SIGNAL ANALYSIS; SIGNAL RECONSTRUCTION; SPEECH ANALYSIS;

ATOMIC DECOMPOSITION; BLIND SOURCE SEPARATION (BSS); COMPRESSED SENSING; OVERCOMPLETE SIGNAL REPRESENTATION; SPARSE COMPONENT ANALYSIS (SCA); SPARSE DECOMPOSITION; SPARSE SOURCE SEPARATION;

BLIND SOURCE SEPARATION;

EID: 58649115827     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2008.2007606     Document Type: Article

References (30)

1. R. Gribonval and S. Lesage, "A survey of sparse component analysis for blind source separation: Principles, perspectives, and new challenges," in Proc. Eur. Symp. Artificial Neural Networks (ESANN), Apr. 2006, pp. 323-330.
2. P. Bofill and M. Zibulevsky, "Underdetermined blind source separation using sparse representations," in Signal Process., 2001, vol. 81, pp. 2353-2362.
3. P. G. Georgiev, F. J. Theis, and A. Cichocki, "Blind source separation and sparse component analysis for over-complete mixtures," in Proc. Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), Montreal, QC, Canada, May 2004, pp. 493-496.
4. Y. Li, A. Cichocki, and S. Amari, "Sparse component analysis for blind source separation with less sensors than sources," in Proc. Int. Conf. Independent Component Analysis (ICA), 2003, pp. 89-94.
5. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Scientif. Comput., vol. 20, no. 1, pp. 33-61, 1999.
6. D. L. Donoho, M. Elad, and V. Temlyakov, "Stable recovery of sparse overcomplete representations in the presence of noise," IEEE Trans. Inf. Theory, vol. 52, no. 1, pp. 6-18, Jan. 2006.
7. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol. 52, pp. 1289-1306, Apr. 2006.
8. R. G. Baraniuk, "Compressive sensing," IEEE Signal Process. Mag. vol. 24, no. 4, pp. 118-124, Jul. 2007.
9. E. J. Candès and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, no. 12, pp. 4203-4215, 2005.
10. M. A. T. Figueiredo and R. D. Nowak, "An EM algorithm for wavelet-based image restoration," IEEE Trans. Image Process., vol. 12, no. 8, pp. 906-916, Aug. 2003.
11. M. A. T. Figueiredo and R. D. Nowak, "A bound optimization approach to wavelet-based image deconvolution," in Proc. IEEE Int. Conf. Image Processing (ICIP), Aug. 2005, pp. II-782-II-7855.
12. M. Elad, "Why simple shrinkage is still relevant for redundant representations?," IEEE Trans. Image Process., vol. 52, no. 12, pp. 5559-5569, Dec. 2006.
13. I. F. Gorodnitsky and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS, A re-weighted minimum norm algorithm," IEEE Trans. Signal Process., vol. 45, no. 3, pp. 600-616, Mar. 1997.
14. D. L. Donoho and M. Elad, "Maximal sparsity representation via l 1 minimization," Proc. Nat. Acad. Sci., vol. 100, no. 5, pp. 2197-2202, Mar. 2003.
15. 1-norm solution is also the sparsest solution," Tech. Rep., 2004 [Online]. Available: http:// www-stat.stanford.edu/~donoho/reports.html
16. I. Daubechies, M. Defrise, and C. DeMol, "An iterative thresholding algorithm for linear inverse problems with a sparsity constraint," Commun. Pure Appl. Math., vol. 57, no. 11, pp. 1413-1457, 2004.
17. E. J. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, pp. 489-509, Feb. 2006.
18. A. Hyvarinen, J. Karhunen, and E. Oja, Independent Component Analysis New York: Wiley, 2001.
19. A. Cichocki and S. -I. Amari, Adaptive Blind Signal and Image Processing: Learning Algorithms and Applications. New York: Wiley, 2002.
20. F. Movahedi, G. H. Mohimani, M. Babaie-Zadeh, and C. Jutten, "Estimating the mixing matrix in sparse component analysis (SCA) based on partial k-dimensional subspace clustering," Neurocomput. vol. 71, pp. 2330-2343, 2008.
21. Y. Washizawa and A. Cichocki, "On-line k-plane clustering learning algorithm for sparse comopnent analysis," in Proc. Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), Toulouse, France, 2006, pp. 681-684.
22. Y. Q. Li, A. Cichocki, and S. Amari, "Analysis of sparse representation and blind source separation," Neural Comput., vol. 16, no. 6, pp. 1193-1234, 2004.
23. M. Zibulevsky and B. A. Pearlmutter, "Blind source separation by sparse decomposition in a signal dictionary," Neural Comput., vol. 13, no. 4, pp. 863-882, 2001.
24. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
25. 1-Magic: Recovery of sparse signals via convex programming," 2005 [Online]. Available: www.acm.caltech.edu/l1magic/downloads/l1magic.pdf
26. S. Krstulovic and R. Gribonval, "MPTK: Matching pursuit made tractable," in Proc. Int. Conf. Acoustics, Speech, Signal Processing (ICASSP), Toulouse, France, May 2006, vol. 3, pp. 496-499.
27. A. A. Amini, M. Babaie-Zadeh, and C. Jutten, "A fast method for sparse component analysis based on iterative detection-projection," in AIP Conf. Proc. (MaxEnt2006), 2006, vol. 872, pp. 123-130.
28. G. H. Mohimani, M. Babaie-Zadeh, and C. Jutten, "Fast sparse representation based on smoothed l0 norm," in Proc. 7th Int. Conf. Independent Component Analysis and Signal Separation (ICA), London, U.K., Sep. 2007, pp. 389-396.
29. 0 norm," in Proc. Int. Conf. Acoustics, Speech, Signal Processing (ICASSP , Las Vegas, NV, Apr. 2008, pp. 3881-3884.
30. A. Blake and A. Zisserman, Visual Reconstruction. Cambridge, MA: MIT Press, 1987.