Sparse signal reconstruction via ECME hard thresholding

IEEE Transactions on Signal Processing

Volumn 60, Issue 9, 2012, Pages 4551-4569

  Qiu, Kun ^a   Dogandzic, Aleksandar ^a  

^a Iowa State University of Science and Technology   (United States)

Author keywords

Expectation conditional maximization either (ECME) algorithm; iterative hard thresholding; sparse signal reconstruction; successive overrelaxation; unconstrained sparsity selection

Indexed keywords

GAUSSIAN COMPONENTS; HARD THRESHOLDING; ITERATIVE HARD THRESHOLDING; LIKELIHOOD FUNCTIONS; LOCAL MAXIMUM; MONOTONIC CONVERGENCE; NOVEL ALGORITHM; ONE-DIMENSIONAL SIMULATIONS; ORTHONORMAL; PARAMETER ESTIMATE; PROBABILISTIC MODELS; SMALL-SCALE APPLICATIONS; SPARSE SIGNAL RECONSTRUCTION; SPARSE SIGNALS; SUCCESSIVE OVER RELAXATION; THRESHOLDING; THRESHOLDING METHODS; TWO-DIMENSIONAL IMAGE RECONSTRUCTION; UNCONSTRAINED SPARSITY SELECTION; UNKNOWN PARAMETERS; X-RAY CT;

FAST FOURIER TRANSFORMS; IMAGE RECONSTRUCTION; PARAMETER ESTIMATION;

ALGORITHMS;

EID: 84865267944     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2012.2203818     Document Type: Article

References (45)

1. M. Lustig, D. Donoho, and J. Pauly, "Sparse MRI: The application of compressed sensing for rapid MR imaging," Magn. Reson. Med., vol. 58, pp. 1182-1195, Dec. 2007. (Pubitemid 350234205)
2. W. Bajwa, J. Haupt, A. Sayeed, and R. Nowak, "Joint source-channel communication for distributed estimation in sensor networks," IEEE Trans. Inf. Theory, vol. 53, no. 10, pp. 3629-3653, Oct. 2007. (Pubitemid 47534518)
3. I. F. Gorodnitsky and B. D. Rao, "Sparse signal reconstruction from limited data using FOCUSS: A re-weighted minimum norm algorithm," IEEE Trans. Signal Process., vol. 45, pp. 600-616, Mar. 1997. (Pubitemid 127765947)
4. E. J. Candès, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol. 52, no. 2, pp. 489-509, 2006. (Pubitemid 43174093)
5. E. J. Candès and T. Tao, "Decoding by linear programming," IEEE Trans. Inf. Theory, vol. 51, pp. 4203-4215, Dec. 2005. (Pubitemid 41800353)
6. R. G. Baraniuk, "Compressive sensing," IEEE Signal Process. Mag., vol. 24, pp. 118-121, Jul. 2007.
7. IEEE Signal Process. Mag. (Special Issue on Compressive Sampling), vol. 25, no. 2, Mar. 2008.
8. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, pp. 34-81, Mar. 2009.
9. B. K. Natarajan, "Sparse approximate solutions to linear systems," SIAM J. Comput., vol. 24, pp. 227-234, 1995.
10. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol. 20, no. 1, pp. 33-61, 1998. (Pubitemid 128689501)
11. E. J. Candès, J. K. Romberg, and T. Tao, "Stable signal recovery from incomplete and inaccurate measurements," Comm. Pure Appl. Math., vol. 59, no. 8, pp. 1207-1223, Aug. 2006. (Pubitemid 43988295)
12. E. Candes and T. Tao, "The Dantzig selector: Statistical estimation when is much larger than," Ann. Stat., vol. 35, no. 6, pp. 2313-2351, Dec. 2007.
13. M. A. T. Figueiredo, R. D. Nowak, and S. J. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE J. Sel. Topics Signal Process., vol. 1, no. 4, pp. 586-597, 2007. (Pubitemid 351276802)
14. Z. Wen, W. Yin, D. Goldfarb, and Y. Zhang, "A fast algorithm for sparse reconstruction based on shrinkage, subspace optimization, and continuation," SIAM J. Sci. Comput., vol. 32, no. 4, pp. 1832-1857, 2010.
15. D. Donoho, A. Maleki, and A. Montanari, "Message-passing algorithms for compressed sensing," Proc. Nat. Acad. Sci., vol. 106, no. 45, pp. 18914-18919, 2009.
16. S. Mallat and Z. Zhang, "Matching pursuits with time-frequency dictionaries," IEEE Trans. Signal Process., vol. 41, no. 12, pp. 3397-3415, Dec. 1993.
17. J. Tropp, "Greed is good: Algorithmic results for sparse approximation," IEEE Trans. Inf. Theory, vol. 50, no. 10, pp. 2231-2242, Oct. 2004.
18. J. Tropp and A. Gilbert, "Signal recovery from random measurements via orthogonal matching pursuit," IEEE Trans. Inf. Theory, vol. 53, no. 12, pp. 4655-4666, Dec. 2007.
19. D. Needell and J. A. Tropp, "CoSaMP: Iterative signal recovery from incomplete and inaccurate samples," Appl. Comput. Harmon. Anal., vol. 26, no. 3, pp. 301-321, May 2009.
20. L. Mancera and J. Portilla, "-norm-based sparse representation through alternate projections," in Proc. IEEE Int. Conf. Image Process., Atlanta, GA, Oct. 2006, pp. 2089-2092.
21. K. Herrity, A. Gilbert, and J. Tropp, "Sparse approximation via iterative thresholding," in Proc. IEEE Int. Conf. Acoust., Speech, Signal Process., Toulouse, France, May 2006, vol. 3, pp. 624-627.
22. T. Blumensath and M. E. Davies, "Iterative thresholding for sparse approximations," J. Fourier Anal. Appl., vol. 14, no. 5-6, pp. 629-654, 2008.
23. T. Blumensath and M. E. Davies, "Iterative hard thresholding for compressed sensing," Appl. Comput. Harmon. Anal., vol. 27, no. 3, pp. 265-274, 2009.
24. T. Blumensath and M. E. Davies, "Normalized iterative hard thresholding: Guaranteed stability and performance," IEEE J. Sel. Topics Signal Process., vol. 4, pp. 298-309, Apr. 2010.
25. D. Wipf and B. Rao, "Sparse Bayesian learning for basis selection," IEEE Trans. Signal Process., vol. 52, no. 8, pp. 2153-2164, 2004.
26. S. Ji, Y. Xue, and L. Carin, "Bayesian compressive sensing," IEEE Trans. Signal Process., vol. 56, no. 6, pp. 2346-2356, 2008. (Pubitemid 351795888)
27. K. Qiu and A. Dogandžić, "Variance-component based sparse signal reconstruction and model selection," IEEE Trans. Signal Process., vol. 58, pp. 2935-2952, Jun. 2010.
28. A. Dogandžić and K. Qiu, D. O. Thompson and D. E. Chimenti, Eds., "Automatic hard thresholding for sparse signal reconstruction from NDE measurements," in Rev. Progr, Quantitative Nondestructive Evaluation, ser. AIP Conf. Proc., Melville, NY, 2010, vol. 29, pp. 806-813.
29. K. Qiu and A. Dogandžić, "Double overrelaxation thresholding methods for sparse signal reconstruction," in Proc. 44th Annu. Conf. Inf. Sci. Syst., Princeton, NJ, Mar. 2010, pp. 1-6.
30. A. Maleki and D. L. Donoho, "Optimally tuned iterative thresholding algorithms for compressed sensing," IEEE J. Sel. Topics Signal Process., vol. 4, pp. 330-341, Apr. 2010.
31. G. J. McLachlan and T. Krishnan, The EM Algorithm and Extensions, 2nd ed. New York: Wiley, 2008.
32. S. M. Kay, Fundamentals of Statistical Signal Processing: Estimation Theory. Englewood Cliffs, NJ: Prentice-Hall, 1993.
33. Y. He and C. Liu, "The dynamic 'expectation-conditional maximization either' algorithm," J. Roy. Stat. Soc. Ser. B, vol. 74, no. 2, pp. 313-336, 2012.
34. K. Qiu and A. Dogandžić, "ECME hard thresholding methods for image reconstruction from compressive samples," in Applications of Digital Image Processing XXXIII, ser. Proc. SPIE Optics & Photonics, A. G. Tescher, Ed. San Diego, CA: SPIE, 2010, vol. 7798.
35. T. Blumensath, "Accelerated iterative hard thresholding," Signal Process., vol. 92, no. 3, pp. 752-756, 2012.
36. S. M. Kay, Fundamentals of Statistical Signal Processing: Detection Theory. Englewood Cliffs, NJ: Prentice-Hall, 1998.
37. R. A. Thisted, Elements of Statistical Computing: Numerical Computation. London, U.K.: Chapman & Hall, 1988.
38. C. Liu and D. B. Rubin, "The ECME algorithm: A simple extension of EM and ECM with faster monotone convergence," Biometrika, vol. 81, no. 4, pp. 633-648, 1994.
39. I. Daubechies, Ten Lectures on Wavelets. Philadelphia, PA: SIAM, 1992, vol. 61.
40. E. Candès and J. Romberg, C. A. Bouman and E. L. Miller, Eds., "Signal recovery from random projections," in Proc. Computational Imaging III, San Jose, CA, Jan. 2005, vol. 5674, pp. 76-86. (Pubitemid 40949239)
41. A. C. Kak and M. Slaney, Principles of Computerized Tomographic Imaging. New York: IEEE Press, 1988.
42. J. Fessler and B. Sutton, "Nonuniform fast Fourier transforms using min-max interpolation," IEEE Trans. Signal Process., vol. 51, no. 2, pp. 560-574, Feb. 2003.
43. A. Dogandžić, R. Gu, and K. Qiu, "Mask iterative hard thresholding algorithms for sparse image reconstruction of objects with known contour," in Proc. Asilomar Conf. Signals, Syst., Comput., Pacific Grove, CA, Nov. 2011, pp. 2111-2116.
44. D. A. Harville, Matrix Algebra From a Statistician's Perspective. New York: Springer-Verlag, 1997.
45. S. Colley, Vector Calculus, 3rd ed. Upper Saddle River, NJ: Prentice-Hall, 2006.