Bayesian compressive sensing using laplace priors

IEEE Transactions on Image Processing

Volumn 19, Issue 1, 2010, Pages 53-63

  Babacan, S Derin ^a   Molina, Rafael ^b   Katsaggelos, Aggelos K ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

^b UNIVERSITY OF GRANADA   (Spain)

Author keywords

Bayesian methods; Compressive sensing; Inverse problems; Relevance vector machine (RVM); Sparse Bayesian learning

Indexed keywords

BAYESIAN; BAYESIAN FRAMEWORKS; BAYESIAN METHODS; MODEL PARAMETERS; RECONSTRUCTION ALGORITHMS; RECONSTRUCTION METHOD; RELEVANCE VECTOR MACHINE; SIGNAL ACQUISITIONS; SPARSE BAYESIAN LEARNING;

ALGORITHMS; DIFFERENTIAL EQUATIONS; IMAGE RECONSTRUCTION; INVERSE PROBLEMS; LAPLACE TRANSFORMS; PARAMETER ESTIMATION; REPAIR; SIGNAL PROCESSING; SIGNAL RECONSTRUCTION; UNCERTAINTY ANALYSIS;

BAYESIAN NETWORKS;

EID: 72949095917     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2009.2032894     Document Type: Article

References (31)

1. E. J. Candes, J. Romberg, and T. Tao, "Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information," IEEE Trans. Inf. Theory, vol.52, no.2, pp. 489-509, Feb. 2006.
2. D. L. Donoho, "Compressed sensing," IEEE Trans. Inf. Theory, vol.52, no.4, pp. 1289-1306, Apr. 2006.
3. R. A. DeVore, "Deterministic constructions of compressed sensing matrices," J. Complexity, vol.23, no.4-6, pp. 918-925, 2007.
4. S. Gurevich, R. Hadani, and N. Sochen, "On some deterministic dictionaries supporting sparsity," J. Fourier Anal. Appl., vol.14, pp. 859-876, Dec. 2008.
5. M. Lustig, D. L. Donoho, and J. M. Pauly, "Sparse MRI: The application of compressed sensing for rapid MR imaging," Magn. Res. Med., vol.58, no.6, pp. 1182-1195, Dec. 2007.
6. J. Haupt, W. U. Bajwa, M. Rabbat, and R. Nowak, "Compressed sensing for networked data [A different approach to decentralized compression]," IEEE Signal Process. Mag., vol.25, no.2, pp. 92-101, Mar. 2008.
7. S. S. Chen, D. L. Donoho, and M. A. Saunders, "Atomic decomposition by basis pursuit," SIAM J. Sci. Comput., vol.20, no.1, pp. 33-61, 1999.
8. M. Figueiredo, R. Nowak, and S. J. Wright, "Gradient projection for sparse reconstruction: Application to compressed sensing and other inverse problems," IEEE Trans. Sel. Topics Signal Process., vol.1, no.4, pp. 586-597, Dec. 2007.
9. J. A. Tropp and A. C. Gilbert, "Signal recovery from random measurements via orthogonal matching pursuit," IEEE Trans. Inf. Theory, vol.53, no.12, pp. 4655-4666, Dec. 2007.
10. D. L. Donoho and J. Tanner, "Sparse nonnegative solution of underdetermined linear equations by linear programming," Proc. Nat. Acad. Sci., vol.102, no.27, pp. 9446-9451, 2005.
11. T. Blumensath and M. E. Davies, "Gradient pursuits," IEEE Trans. Signal Process., vol.56, no.6, pp. 2370-2382, Jun. 2008.
12. D. P. Wipf and B. D. Rao, "Sparse Bayesian learning for basis selection," IEEE Trans. Signal Process., vol.52, no.8, pp. 2153-2164, Aug. 2004.
13. S. Ji, Y. Xue, and L. Carin, "Bayesian compressive sensing," IEEE Trans. Signal Process., vol.56, no.6, pp. 2346-2356, Jun. 2008.
14. M. W. Seeger and H. Nickisch, "Compressed sensing and Bayesian experimental design," in Proc. Int. Conf. Machine Learning (ICML), 2008, pp. 912-919.
15. M. Tipping, "Sparse Bayesian learning and the relevance vector machine," J. Mach. Learn. Res., pp. 211-244, 2001.
16. M. A. T. Figueiredo, "Adaptive sparseness for supervised learning," IEEE Trans. Pattern Anal. Mach. Intell., vol.25, no.9, pp. 1150-1159, Sep. 2003.
17. D. Wipf, J. Palmer, and B. D. Rao, "Perspectives on sparse Bayesian learning," Advances in Neural Information Processing Systems, no.16, 2004.
18. J. Palmer, D. Wipf, K. Kreutz-Delgado, and B. Rao, "Variational EM algorithms for non-Gaussian latent variable models," in Advances in Neural Information Processing Systems 18, Y. Weiss, B. Schölkopf, and J. Platt, Eds. Cambridge, MA: MIT Press, 2006, pp. 1059-1066.
19. D. Wipf, J. Palmer, B. D. Rao, and K. Kreutz-Delgado, "Performance analysis of latent variable models with sparse priors," presented at the IEEE Int. Conf. Acoustics, Speech, and Signal Processing (ICASSP), Honolulu, HI, May 2007.
20. M. Girolami, "A variational method for learning sparse and overcomplete representations," Neural Comput., vol.13, no.11, pp. 2517-2532, 2001.
21. S. D. Babacan, R. Molina, and A. K. Katsaggelos, "Parameter estimation in TV image restoration using variational distribution approximation," IEEE Trans. Image Process., no.3, pp. 326-339, 2008.
22. C. M. Bishop, Pattern Recognition and Machine Learning. New York: Springer-Verlag, 2006.
23. K. V. Mardia, J. T. Kent, and J. M. Bibby, Multivariate Analysis. New York: Academic, 1979.
24. G. H. Golub and C. F. Van Loan, Matrix Computations (Johns Hopkins Studies in Mathematical Sciences). Baltimore, MD: Johns Hopkins Univ. Press, Oct. 1996.
25. D. J. C. MacKay, "Bayesian interpolation," Neural Comput., vol.4, no.3, pp. 415-447, 1992.
26. R. Molina, A. K. Katsaggelos, and J. Mateos, "Bayesian and regularization methods for hyperparameter estimation in image restoration," IEEE Trans. Image Process., vol.8, no.2, pp. 231-246, Feb. 1999.
27. M. Tipping and A. Faul, "Fast marginal likelihood maximisation for sparse Bayesian models," in Proc. 9th Int. Workshop Artificial Intelligence and Statistics, C. M. Bishop and B. J. Frey, Eds., 2003.
28. S. Ji, D. Dunson, and L. Carin, "Multi-task compressive sensing," IEEE Trans. Signal Process., vol.57, no.1, pp. 92-106, Jan. 2009.
29. D. L. Donoho, I. Drori, Y. Tsaig, and J. L. Starck, Sparse Solution of Underdetermined Linear Equations by Stagewise Orthogonal Matching Pursuit 2006 [Online]. Available: http://www-stat.stanford. edu/̃donoho/Reports/2006/ StOMP-20060403.pdf, Tech. Rep.
30. Y. Tsaig and D. L. Donoho, "Extensions of compressed sensing," Signal Process., vol.86, no.3, pp. 549-571, 2006.
31. Sparselab [Online]. Available: http://sparselab.stanford.edu/