Bayesian approach with prior models which enforce sparsity in signal and image processing

Eurasip Journal on Advances in Signal Processing

Volumn 2012, Issue 1, 2012, Pages

  Mohammad Djafari, Ali ^a  

^a UNIV PARIS SUD   (France)

Author keywords

Bayesian approach; Inverse problems; Sparse priors; Sparsity

Indexed keywords

BAYESIAN APPROACHES; BAYESIAN COMPUTATION; BAYESIAN ESTIMATORS; BAYESIAN INFERENCE; DENSITY ESTIMATION; DIRICHLET; ELASTIC NET; EXHAUSTIVE LISTS; GAUSSIANS; GENERALIZED GAUSSIAN; HEAVY-TAILED; MAXIMUM A POSTERIORI; MIXTURE MODEL; MIXTURE OF GAUSSIANS; MULTINOMIALS; POSTERIOR MEANS; PROBABILISTIC MODELS; RELATIVE COMPLEXITY; SIGNAL AND IMAGE PROCESSING; SPARSE PRIOR; SPARSE SIGNALS; SPARSITY; VARIATIONAL BAYES APPROXIMATIONS; WEIBULL;

DIFFERENTIAL EQUATIONS; IMAGE PROCESSING; INFERENCE ENGINES; INVERSE PROBLEMS; MIXTURES;

BAYESIAN NETWORKS;

EID: 84872906065     PISSN: 16876172     EISSN: 16876180     Source Type: Journal    
DOI: 10.1186/1687-6180-2012-52     Document Type: Review

References (54)

1. A Tikhonov, Regularization of incorrectly posed problems. Soviet Math Dokl. 4, 1624-1627 (1963)
2. A Tikhonov, V Arénine, Méthodes de Résolution de Problémes Mal Posés, (MIR, Moscu, Russia, 1976). Éditions
3. I Daubechies, M Defrise, CD Mol, An iterative thresholding algorithm for linear inverse problems with a sparsity constraint. Comm Pure Appl Math. 57, 1413-1457 (2004). doi:10.1002/cpa.20042 (Pubitemid 39427442)
4. DL Donoho, Compressive sampling. IEEE Trans Inf Theory. 52(4), 1289-1306 (2006)
5. JA Tropp, AC Gilbert, MJ Strauss, Algorithms for simultaneous sparse approximation. Part I: Greedy pursuit. Signal Processing, special issue "sparse approximations in signal and image processing". 86, 572-588 (2006) (Pubitemid 43106572)
6. JA Tropp, Algorithms for simultaneous sparse approximation. Part II: Convex relaxation. Signal Process (special issue "Sparse approximations in signal and image processing"). 86, 589-602 (2006) (Pubitemid 43106573)
7. R Zass, A Shashua, in Nonnegative Sparse PCA, vol. 19. (Cambridge, MA: MIT Press, 2007), pp. 1561-1568
8. EJ Candés, M Wakin, S Boyd, Enhancing sparsity by reweighted l1 minimization. J Fourier Anal Appl. 14, 877-905 (2008). doi:10.1007/s00041-008- 9045-x
9. DM Witten, R Tibshirani, T Hastie, A penalized matrix decomposition, with applications to sparse principal components and canonical correlation analysis. Biostatistics. 10(3), 515-534 (2009). doi:10.1093/biostatistics/kxp008
10. S Vaiter, G Peyré, C Dossal, J Fadili, Robust Sparse Analysis Reg-ularization. Tech rep, preprint Hal-00627452 http://hal.archives-ouvertes. fr/hal-00627452/ (2011)
11. G Peyré, J Fadili, Learning Analysis Sparsity Priors. Proc of Sampta' 11 http://hal.archives-ouvertes.fr/hal-00542016/ (2011)
12. P Williams, Bayesian regularization and pruning using a Laplace prior. Neural Comput. 71, 117-143 (1995)
13. T Mitchell, J Beauchamp, Bayesian variable selection in linear regression. J Am Stat Assoc. 83(404), 1023 (1988). doi:10.2307/2290129
14. N Polson, J Scott, Shrink globally, act locally: sparse Bayesian regulariza-tion and prediction. Bayesian Stat. 9, 1-24 (2010)
15. A Mohammad-Djafari, On the estimation of hyperparameters in Bayesian approach of solving inverse problems, in Proc IEEE International Conference on Acoustics, Speech, and Signal Processing ICASSP-93, vol. 5. (Minneapolis, MN, USA, 1993), pp. 495-498
16. A Mohammad-Djafari, Joint estimation of parameters and hyperparameters in a Bayesian approach of solving inverse problems, in IEEE Int Conf on Image Processing (ICIP), IEEE ICIP 96, vol. II. (Lausanne, Swisse, 1996), pp. 473-477
17. R Neal, G Hinton, A view of the EM algorithm that justifies incremental, sparse, and other variants. Learn Graph Models. 89, 355-368 (1998)
18. A Doucet, P Duvaut, Bayesian estimation of state-space models applied to deconvolution of Bernoulli-Gaussian processes. Signal Process. 57(2), 147-161 (1997). doi:10.1016/S0165-1684 (96) 00192-2 (Pubitemid 127403390)
19. T Park, G Casella, The Bayesian Lasso. J Am Stat Assoc. 103(482), 681-686 (2008). doi:10.1198/016214508000000337
20. M Tipping, Sparse Bayesian learning and the relevance vector machine. J Mach Learn Res. 1, 211-244 (2001) (Pubitemid 33687203)
21. C Févotte, S Godsill, A Bayesian aproach for blind separation of sparse source. IEEE Trans Audio Speech Lang Process. 14, 2174-2188 (2006)
22. F Caron, A Doucet, Sparse Bayesian nonparametric regression, in International Conference on Machine Learning, pp. 88-95 (2008)
23. J Griffin, P Brown, Inference with normal-gamma prior distributions in regression problems. Bayesian Anal. 5, 171-188 (2010)
24. H Snoussi, J Idier, Bayesian blind separation of generalized hyperbolic processes in noisy and underdeterminate mixtures. IEEE Trans Signa Process. 54, 3257-3269 (2006) (Pubitemid 46414207)
25. H Ishwaran, JS Rao, Spike and slab variable selection: frequentist and Bayesian strategies. Ann Stat. 33(2), 730-733 (2005). doi:10.1214/ 009053604000001147 (Pubitemid 41053721)
26. S Chatzis, T Varvarigou, Factor analysis latent subspace modeling and robust fuzzy clustering using t-distributionsclassification of binary random patterns. IEEE Trans Fuzzy Syst. 17, 505-517 (2009)
27. CA Bouman, KD Sauer, A generalized Gaussian image model for edgepreserving MAP estimation. IEEE Trans Image Process. 2(3), 296-310 (1993). doi:10.1109/83.236536 (Pubitemid 23697158)
28. H Zou, T Hastie, Regularization and variable selection via the elastic net. J Royal Stat Soc, Ser, B. 67(2), 301-320 (2005). doi:10.1111/j.1467-9868. 2005.00503.x (Pubitemid 40465877)
29. S Zhu, A Mohammad-Djafari, H Wang, B Deng, X Li, J Mao, Parameter estimation for SAR micromotion target based on sparse signal representation. Eurasip special issue "Sparse approximations in signal and image processing". 13 (2012)
30. J Idier, Approche Bayésienne Pour les Problémes Inverses, (Traité IC2, Série traitement du signal et de l'image, Hermés, Paris, 2001)
31. F Champagnat, Y Goussard, J Idier, Unsupervised deconvolution of sparse spike trains using stochastic approximation. IEEE Trans Signal Process. 44(12), 2988-2998 (1996). doi:10.1109/78.553473 (Pubitemid 126778045)
32. D Ge, J Idier, E Le Carpentier, A new MCMC algorithm for blind Bernoulli-Gaussian deconvolution, Proceedings of EUSIPCO: Septembre 2008, (Lausanne, Suisse, 2008)
33. JJ Kormylo, JM Mendel, Maximum-likelihood detection and estimation of Bernoulli-Gaussian processes. IEEE Trans Inf Theory. 28, 482-488 (1982). doi:10.1109/TIT.1982.1056496
34. M Lavielle, Bayesian deconvolution of Bernoulli-Gaussian processes. Signal Process. 33, 67-79 (1993)
35. A Mohammad-Djafari, Gauss-Markov-Potts priors for images in computer tomography resulting to joint optimal reconstruction and segmentation. Int J Tomography Stat. 11(W09), 76-92 http://djafari.free.fr/pdf/IJTS08.pdf (2008)
36. N Gac, A Vabre, A Mohammad-Djafari, F Buyens, GPU implementation of a 3D bayesian CT algorithm and its application on real foam reconstruction, Proceedings of the first International Conference on Image Formation in X-Ray Computed Tomography, (Salt Lake City, Utah, USA, 2010)
37. H Ayasso, B Duchne, A Mohammad-Djafari, Bayesian inversion for optical diffraction tomography. J Modern Opt. 57(9), 765-776 (2010). doi:10.1080/09500340903564702
38. H Ayasso, A Mohammad-Djafari, Joint NDT image restoration and segmentation using Gauss-Markov-Potts prior models and variational Bayesian computation. IEEE Trans. Image Process. 19(9), 2265-2277 http://dx.doi.org/10. 1109/TIP.2010.2047902 (2010)
39. H Ayasso, B Duchne, A Mohammad-Djafari, Optical diffraction tomography within a variational Bayesian framework. Inverse Probl Sci Eng. iFirst, 1-15 (2011)
40. MD Fall, ?É? Barat, C Comtat, T Dautremer, T Montagu, A Mohammad-Djafari, A discrete-continuous Bayesian model for emission tomography, IEEE International Conference on Image Processing (ICIP), (Bruxell, Belgium, 2011), pp. 1401-1404
41. O Féron, B Duchêne, A Mohammad-Djafari, Microwave imaging of inhomogeneous objects made of a finite number of dielectric and conductive materials from experimental data. Inverse Probl. 21(6), 95-115 http://djafari.free.fr/pdf/ (2005). doi:10.1088/0266-5611/21/6/S08 (Pubitemid 41744522)
42. O Féron, B Duchêne, A Mohammad-Djafari, Microwave imaging of piecewise constant objects in a 2D-TE configuration. Int J Appl Electromag Mech. 26(6), 167-174 http://djafari.free.fr/pdf/jae00905.pdf (2007) (Pubitemid 47443006)
43. H Snoussi, A Mohammad-Djafari, Fast joint separation and segmentation of mixed images. J Electron Imag. 13(2), 349-361 http://djafari.free.fr/pdf/ (2004). doi:10.1117/1.1666873
44. H Snoussi, A Mohammad-Djafari, Bayesian unsupervised learning for source separation with mixture of Gaussians prior. J VLSI Signal Process Syst. 37(2/3), 263-279 http://djafari.free.fr/pdf/VLSIpapar.pdf (2004)
45. A Mohammad-Djafari, Bayesian source separation: beyond PCA and ICA, in ESANN 2006, (Belgium, 2006) http://djafari.free.fr/pdf
46. M Ichir, A Mohammad-Djafari, Hidden Markov models for wavelet-based blind source separation. IEEE Trans Image Process. 15(7), 1887-1899 (2006) (Pubitemid 43985069)
47. A Mohammad-Djafari, J Giovannelli, G Demoment, J Idier, Regulariza-tion, maximum entropy and probabilistic methods in mass spectrometry data processing problems. Int J Mass Spectrom. 215(1-3), 175-193 http://djafari.free.fr/pdf/ maspec12013.pdf (2002). doi:10.1016/S1387-3806 (01) 00562-0
48. S Moussaoui, D Brie, A Mohammad-Djafari, C Carteret, Separation of nonnegative mixture of non-negative sources using a Bayesian approach and MCMC sampling. IEEE Trans Signal Process. 54(11), 4133-4145 (2006) (Pubitemid 44637747)
49. N Bali, A Mohammad-Djafari, Bayesian approach with hidden Markov modeling and mean field approximation for hyperspectral data analysis. IEEE Trans Image Process. 17(2), 217-225 (2008) (Pubitemid 351279249)
50. F Humblot, A Mohammad-Djafari, Super-resolution using hidden Markov model and bayesian detection estimation framework, in EURASIP J Appl Signal Process, vol. 16. (Special number on Super-Resolution Imaging: Analysis, Algorithms, and Applications, 2006) http://www.hindawi.com/GetArticle.aspx? doi=10.1155/ASP/ 2006/36971. Article ID 36971
51. A Mohammad-Djafari, Super-resolution: a short review, a new method based on hidden Markov modeling of HR image and future challenges. Comput J http://djafari.free.fr/pdf/bxn005v1.pdf (2008)
52. M Mansouri, A Mohammad-Djafari, Joint super-resolution and segmentation from a set of low resolution images using a Bayesian approach with a Gauss-Markov-Potts prior. Int J Signal Imag Syst Eng. 3(4), 211-221 (2010). doi:10.1504/IJSISE.2010.038017
53. O Féron, A Mohammad-Djafari, Image fusion and joint segmentation using an MCMC algorithm. J Electron Imag. 14 (2) http://arxiv.org/abs/physics/ 0403150 (2005). paper no. 023014
54. P Brault, A Mohammad-Djafari, Unsupervised Bayesian wavelet domain segmentation using a Potts-Markov random field modeling. J Electron Imag. 14 (4) http://djafari.free.fr/pdf/ (2005). 043011-1-043011-16