Near Optimal Compressed Sensing Without Priors: Parametric SURE Approximate Message Passing

IEEE Transactions on Signal Processing

Volumn 63, Issue 8, 2015, Pages 2130-2141

  Guo, Chunli ^a   Davies, Mike E ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Approximate message passing algorithm; compressed sensing; parametric estimator; signal denoising; Stein's unbiased risk estimate

Indexed keywords

ALGORITHMS; COMPRESSED SENSING; GAUSSIAN NOISE (ELECTRONIC); ITERATIVE METHODS; MEAN SQUARE ERROR; MESSAGE PASSING; RISK PERCEPTION; SIGNAL DENOISING; SIGNAL PROCESSING; SIGNAL RECONSTRUCTION; SPURIOUS SIGNAL NOISE;

DENOISING PROBLEMS; LINEAR PARAMETERIZATIONS; MEAN SQUARED ERROR; MESSAGE PASSING ALGORITHM; NOISE CANCELLATION; NOISY OBSERVATIONS; PARAMETRIC ESTIMATOR; UNBIASED RISK ESTIMATES;

PARAMETER ESTIMATION;

EID: 84961291492     PISSN: 1053587X     EISSN: None     Source Type: Journal    
DOI: 10.1109/TSP.2015.2408569     Document Type: Article

References (32)

1. C. Guo and M. E. Davies, "Bayesian optimal compressed sensing without priors: Parametric sure approximate message passing," in Proc. 22nd Eur. Signal Process. Conf. (EUSIPCO), Sep. 2014, pp. 1347-1351.
2. D. Donoho, A. Maleki, and A. Montanari, "Message-passing algorithms for compressed sensing," Proc. Nat. Acad. Sci., vol. 106, no. 45, pp. 18 914-18 919, 2009.
3. A. Maleki and A. Montanari, "Analysis of approximate message passing algorithm," in Proc. 44th Ann. Conf. Inf. Sci. Syst. (CISS), Mar. 2010, pp. 1-7.
4. D. Donoho, A. Maleki, and A. Montanari, "Message passing algorithms for compressed sensing: II. analysis and validation," in Proc. IEEE Inf. Theory Workshop, Dublin, Ireland, 2010.
5. D. Donoho, A. Maleki, and A. Montanari, "Message passing algorithms for compressed sensing: I. motivation and construction," in Proc. IEEE Inf. Theory Workshop (ITW), Dublin, Ireland, 2010, pp. 1-5.
6. D. Donoho and I. Johnstone, "Adapting to unknown smoothness via wavelet shrinkage," J. Amer. Stat. Assoc., vol. 90, pp. 1200-1224, 1995.
7. J. C. Pesquet and D. Leporini, "A new wavelet estimator for image denoising," in Proc. 6th IEEE Int. Conf. Image Process. Appl., 1997, pp. 249-253.
8. A. Benazza-Benyahia and J. C. Pesquet, "Building robust wavelet estimators for multicomponent images using Steins principle," IEEE Trans. Image Process., vol. 14, no. 11, pp. 1814-1830, 2005.
9. F. Luisier, T. Blu, and M. Unser, "SURE-based wavelet thresholding integrating inter-scale dependencies," in Proc. IEEE Int. Conf. Image Process., Oct. 2006, pp. 1457-1460.
10. F. Luisier, T. Blu, and M. Unser, "A new SURE approach to image denoising: Interscale orthonormal wavelet thresholding," IEEE Trans. Image Process., vol. 16, no. 3, pp. 593-606, Mar. 2007.
11. T. Blu and F. Luisier, "The SURE-LET approach to image denoising,"IEEE Trans. Image Process., vol. 16, no. 11, pp. 2778-2786, Nov. 2007.
12. M. Raphan and P. Simoncelli, "Least squares estimation without priors or supervision," Neural Comput., vol. 23, no. 2, pp. 374-420, 2011.
13. J. C. Pesquet, A. Benazza-Benyahia, and C. Chaux, "ASURE approach for digital signal/image deconvolution problems," IEEE Trans. Signal Process., vol. 57, no. 12, pp. 4616-4632, 2009.
14. C. Stein, "Estimation of the mean of a multivariate normal distribution,"Ann. Statist., pp. 1135-1151, 1981.
15. J.Vila and P. Schniter, "Expectation-maximization Bernoulli-Gaussian approximate message passing," in Conf. Rec. 45th Asilomar Conf. Signals, Syst., Comput. (ASILOMAR), Nov. 2011, pp. 799-803.
16. J. Vila and P. Schniter, "Expectation-maximization Gaussian-mixture approximate message passing," IEEE Trans. Signal Process., vol. 61, no. 19, pp. 4658-4672, Oct. 2013.
17. F. Krzakala, M. Mézard, F. Sausset, Y. Sun, and L. Zdeborová, "Statistical- physics-based reconstruction in compressed sensing," Phys. Rev. X vol. 2, pp. 021 005(1)-021 005(18), May 2012.
18. F. Krzakala, M. Mézard, F. Sausset, Y. Sun, and L. Zdeborová, "Probabilistic reconstruction in compressed sensing: Algorithms, phase diagrams, threshold achieving matrices," J. Statist. Mech., vol. P08009, Aug. 2012.
19. U. S.Kamilov, S.Rangan, A. K. Fletcher, andM. Unser, "Approximate message passing with consistent parameter estimation and applications to sparse learning," IEEE Trans. Inf. Theory, pp. 2969-2985, 2014.
20. J. Tan, Y. Ma, and D. Baron, "Compressive imaging via approximate message passing with image denoising," May 2014, arXiv:1405.4429 [Online]. Available: http://arxiv.org/abs/1405.4429
21. A. Mousavi, A. Maleki, and R. G. Baraniuk, "Parameterless optimal approximate message passing," 2013, arXiv preprint arXiv:1311.0035 [Online]. Available: http://arxiv.org/abs/1311.0035
22. C. A. Metzler, A. Maleki, and R. G. Baraniuk, "From denoising to compressed sensing," Jul. 2014, arXiv:1406.4175v3 [cs.IT] [Online]. Available: http://arxiv-web3.library.cornell.edu/abs/1406.4175v3
23. A. Montanari, "Graphical models concepts in compressed sensing,"Compress. Sens.: Theory Appl., pp. 394-438, 2012.
24. A. Maleki, "Approximate message passing algorithms for compressed sensing," Ph.D. dissertation, Electr. Eng. Dept., Stanford Univ., Stanford, CA, USA, 2011.
25. N. Goertz, C. Guo, A. Jung, M. Davies, and G. Doblinger, "Iterative recovery of dense signals from incomplete measurements," IEEE Signal Process. Lett., vol. 21, no. 9, pp. 1059-1063, Sep. 2014.
26. M. Bayati and A. Montanari, "The dynamics of message passing on dense graphs, with applications to compressed sensing," IEEE Trans. Inf. Theory, vol. 57, no. 2, pp. 764-785, Feb. 2011.
27. D. Donoho and J. Tanner, "Counting faces of randomly projected polytopes when the projection radically lowers dimension," J. Amer. Math. Soc., vol. 22, no. 1, pp. 1-53, 2009.
28. R.Gribonval, "Should penalized least squares regression be interpreted as maximum a posteriori estimation?," IEEE Trans. Signal Process., vol. 59, no. 5, pp. 2405-2410, May 2011.
29. A. Maleki and D. Donoho, "Optimally tuned iterative reconstruction algorithms for compressed sensing," IEEE J. Selt. Topics Signal Process., vol. 4, no. 2, pp. 330-341, Apr. 2010.
30. D. Donoho, Y. Tsaig, I. Drori, and J.-L. Starck, "Sparse solution of underdetermined systems of linear equations by stagewise orthogonal matching pursuit," IEEE Trans. Inf. Theory, vol. 58, no. 2, pp. 1094-1121, Feb. 2012.
31. R. Gribonval, V. Cehver, and M. Davies, "Compressible distributions for high dimensional statistics," IEEE Trans. Inf. Theory, vol. 58, no. 8, pp. 5016-5034, Aug. 2012.
32. E. van den Berg and M. P. Friedlander, "Probing the pareto frontier for basis pursuit solutions," SIAM J. Scientif. Comput., vol. 31, no. 2, pp. 890-912, 2008 [Online]. Available: http://link.aip.org/link/ ?SCE/31/890