Posterior expectation of the total variation model: Properties and experiments

SIAM Journal on Imaging Sciences

Volumn 6, Issue 4, 2013, Pages 2640-2684

  Louchet, Cécile ^a   Moisan, Lionel ^b  

^a UNIVERSITÉ D'ORLÉANS   (France)

^b UNIVERSITÉ PARIS DESCARTES   (France)

Author keywords

Bayesian model; Estimation in high dimensional spaces; Image denoising; Least square estimate; Maximum a posteriori; Proximity operators; Staircasing effect; Total variation

Indexed keywords

BAYESIAN MODEL; HIGH DIMENSIONAL SPACES; LEAST SQUARE ESTIMATES; MAXIMUM A POSTERIORI; PROXIMITY OPERATOR; STAIRCASING EFFECT; TOTAL VARIATION;

BAYESIAN NETWORKS;

IMAGE DENOISING;

EID: 84891063370     PISSN: None     EISSN: 19364954     Source Type: Journal    
DOI: 10.1137/120902276     Document Type: Article

References (76)

1. L. Ambrosio, N. Fusco, and D. Pallara, Functions of Bounded Variation and Free Discontinuity Problems, The Clarendon Press, Oxford University Press, New York, 2000.
2. G. Aubert and P. Kornprobst, Mathematical Problems in Image Processing: Partial Differential Equations and the Calculus of Variations, 2nd ed., Appl. Math. Sci. 147, Springer-Verlag, New York, 2006.
3. G. Aubert and L. Vese, A variational method in image recovery, SIAM J. Numer. Anal., 34 (1997), pp. 1948-1979.
4. J.-F. Aujol, G. Aubert, L. Blanc-Féraud, and A. Chambolle, Image decomposition into a bounded variation component and an oscillating component, J. Math. Imaging Vision, 22 (2005), pp. 71-88.
5. J.-F. Aujol, G. Gilboa, T. Chan, and S. Osher, Structure-texture image decomposition-Modeling, algorithms, and parameter selection, Int. J. Comput. Vision, 67 (2006), pp. 111-136.
6. M. Bergounioux and L. Piffet, A second-order model for image denoising, Set-Valued Var. Anal., 18 (2010), pp. 277-306.
7. J. Besag, Digital image processing: Towards Bayesian image analysis, J. Appl. Stat., 16 (1989), pp. 395-407.
8. G. Blanchet and L. Moisan, An explicit sharpness index related to global phase coherence, in Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2012, pp. 1065-1068.
9. C. Bouman and K. Sauer, A generalized Gaussian image model for edge-preserving MAP estimation, IEEE Trans. Image Process., 2 (1993), pp. 296-310.
10. K. Bredies, K. Kunisch, and T. Pock, Total generalized variation, SIAM J. Imaging Sci., 3 (2010), pp. 492-526.
11. 2: The one-dimensional case, J. Math. Anal. Appl., 398 (2013), pp. 438-454.
12. H. R. Brezis, Les opérateurs monotones, Séminaire Choquet: 1965166, Initiation à l'Analyse, Fasc. 2, Exp. 10, Secrétariat mathématique, Paris, 1968.
13. A. Buades, B. Coll, and J.-M. Morel, The staircasing effect in neighborhood filters and its solution, IEEE Trans. Image Process., 15 (2006), pp. 1499-1505.
14. V. Caselles, A. Chambolle, and M. Novaga, The discontinuity set of solutions of the TV denoising problem and some extensions, Multiscale Model. Simul., 6 (2007), pp. 879-894.
15. V. Caselles, A. Chambolle, and M. Novaga, Total variation in imaging, in Handbook of Mathematical Methods in Imaging, Springer, New York, 2011, pp. 1016-1057.
16. L. Chaari, Parallel Magnetic Resonance Imaging Reconstruction Problems Using Wavelet Representations, Ph.D. thesis, Université Paris Est, Paris, France, 2010.
17. L. Chaari, J.-C. Pesquet, J.-Y. Tourneret, and P. Ciuciu, Parameter estimation for hybrid wavelettotal variation regularization, in Proceedings of the IEEE Statistical Signal Processing Workshop (SSP), 2011, pp. 461-464.
18. A. Chambolle, V. Caselles, D. Cremers, M. Novaga, and T. Pock, An introduction to total variation for image analysis, in Theoretical Foundations and Numerical Methods for Sparse Recovery, De Gruyter, Berlin, 2010, pp. 263-340.
19. A. Chambolle and T. Pock, A first-order primal-dual algorithm for convex problems with applications to imaging, J. Math. Imaging Vision, 40 (2011), pp. 120-145.
20. T. F. Chan, S. Esedoḡlu, and M. Nikolova, Algorithms for finding global minimizers of image segmentation and denoising models, SIAM J. Appl. Math., 66 (2006), pp. 1632-1648.
21. T. F. Chan, S. Esedoglu, and F. E. Park, Image decomposition combining staircase reduction and texture extraction, J. Vis. Commun. Image Represent., 18 (2007), pp. 464-486.
22. T. F. Chan, S. Esedoglu, and F. E. Park, A fourth order dual method for staircase reduction in texture extraction and image restoration problems, in Proceedings of the 17th IEEE International Conference on Image Processing, 2010, pp. 4137-4140.
23. T. F. Chan and J. Shen, Mathematical models for local nontexture inpaintings, SIAM J. Appl. Math., 62 (2002), pp. 1019-1043.
24. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, Image denoising with block-matching and 3D filtering, in Proc. SPIE 6064, Image Processing: Algorithms and Systems, Neural Networks, and Machine Learning, SPIE, Bellingham, WA, 606414.
25. D. C. Dobson and F. Santosa, Recovery of blocky images from noisy and blurred data, SIAM J. Appl. Math., 56 (1996), pp. 1181-1198.
26. V. Duval, J.-F. Aujol, and Y. Gousseau, The TVL1 model: A geometric point of view, Multiscale Model. Simul., 8 (2009), pp. 154-189.
27. C. Fox and G. K. Nicholls, Exact MAP states and expectations from perfect sampling: Greig, Porteous and Seheult revisited, in Bayesian Inference and Maximum Entropy Methods in Science and Engineering: 20th International Workshop, AIP Conf. Proc. 568, American Institute of Physics, Melville, NY, 2000, pp. 252-263.
28. D. Geman, Random fields and inverse problems in imaging, in école d'été de Probabilités de Saint-Flour XVIII-1988, Lecture Notes in Math. 1427, Springer-Verlag, Berlin, 1990, pp. 113-193.
29. S. Geman and D. Geman, Stochastic relaxation, Gibbs distributions, and the Bayesian restoration of images, in Readings in Computer Vision: Issues, Problems, Principles, and Paradigms, Morgan Kaufmann, Los Altos, CA, 1987, pp. 564-584.
30. P. Getreuer, Rudin-Osher-Fatemi Total Variation Denoising Using Split Bregman, Image Processing On Line, 2012, http://dx.doi.org/10.5201/ipol.2012.g-tvd.
31. C. J. Geyer, Practical Markov chain Monte Carlo, Statist. Sci., 7 (1992), pp. 473-483.
32. G. Gilboa, J. Darbon, S. Osher, and T. Chan, Nonlocal Convex Functionals for Image Regularization, UCLA CAM Report 06-57, UCLA, Los Angeles, CA, 2006.
33. M. Grasmair, The equivalence of the taut string algorithm and BV-regularization, J. Math. Imaging Vision, 27 (2007), pp. 59-66.
34. R. Gribonval, Should penalized least squares regression be interpreted as maximum a posteriori estimation?, IEEE Trans. Signal Process., 59 (2011), pp. 2405-2410.
35. F. Guichard and F. Malgouyres, Total variation based interpolation, in Proceedings of the European Signal Processing Conference, Vol. 3, 1998, pp. 1741-1744.
36. G. Huang and D. Mumford, Statistics of natural images and models, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1999, pp. 541-547.
37. K. Jalalzai, Regularization of Inverse Problems in Image Processing, Ph.D. thesis, école Polytechnique, Palaiseau, France, 2012.
38. K. Jalalzai and A. Chambolle, Enhancement of blurred and noisy images based on an original variant of the total variation, in Scale Space and Variational Methods in Computer Vision, Lecture Notes in Comput. Sci. 5567, Springer, Berlin, Heidelberg, 2009, pp. 368-376.
39. S. Kindermann, S. Osher, and P. W. Jones, Deblurring and denoising of images by nonlocal functionals, Multiscale Model. Simul., 4 (2005), pp. 1091-1115.
40. V. Kolehmainen, M. Lassas, K. Niinimäki, and S. Siltanen, Sparsity-promoting Bayesian inversion, Inverse Problems, 28 (2012), 025005.
41. M. Lassas, E. Saksman, and S. Siltanen, Discretization-invariant Bayesian inversion and Besov space priors, Inverse Probl. Imaging, 3 (2009), pp. 87-122.
42. M. Lassas and S. Siltanen, Can one use total variation prior for edge-preserving Bayesian inversion?, Inverse Problems, 20 (2004), pp. 1537-1563.
43. M. Ledoux, Measure Concentration, Transportation Cost, and Functional Inequalities, Lectures presented at the Instructional Conference on Combinatorial Aspects of Mathematical Analysis, Edinburgh, Scotland, 2002, and the Summer School on Singular Phenomena and Scaling in Mathematical Models, Bonn, Germany, 2003.
44. M. Ledoux, The Concentration of Measure Phenomenon, Math. Surveys Monogr., American Mathematical Society, Providence, RI, 2005.
45. S. Lefkimmiatis, A. Bourquard, and M. Unser, Hessian-based norm regularization for image restoration with biomedical applications, IEEE Trans. Image Process., 21 (2012), pp. 983-995.
46. C. Louchet, Variational and Bayesian Models for Image Denoising: From Total Variation towards Non-Local Means, Ph.D. thesis, Université Paris Descartes, Paris, France, 2008.
47. C. Louchet and L. Moisan, Total variation denoising using posterior expectation, in Proceedings of the 16th European Signal Processing Conference (EUSIPCO 2008), EURASIP, 2008.
48. C. Louchet and L. Moisan, Total variation as a local filter, SIAMJ. Imaging Sci., 4 (2011), pp. 651-694.
49. B. Luo, J.-F. Aujol, and Y. Gousseau, Local scale measure from the topographic map and application to remote sensing images, Multiscale Model. Simul., 8 (2009), pp. 1-29.
50. G. J. Minty, Monotone (nonlinear) operators in Hilbert space, Duke Math. J., 29 (1962), pp. 341-346.
51. J.-M. Mirebeau and A. Cohen, Anisotropic smoothness classes: From finite element approximation to image models, J. Math. Imaging Vision, 38 (2010), pp. 52-69.
52. J.-J. Moreau, Proximité et dualité dans un espace hilbertien, Bull. Soc. Math. France, 93 (1965), pp. 273-299.
53. M. Nikolova, Local strong homogeneity of a regularized estimator, SIAM J. Appl. Math., 61 (2000), pp. 633-658.
54. M. Nikolova, A variational approach to remove outliers and impulse noise, J. Math. Imaging Vision, 20 (2004), pp. 99-120.
55. M. Nikolova, Weakly constrained minimization: Application to the estimation of images and signals involving constant regions, J. Math. Imaging Vision, 21 (2004), pp. 155-175.
56. M. Nikolova, Analysis of the recovery of edges in images and signals by minimizing nonconvex regularized least-squares, Multiscale Model. Simul., 4 (2005), pp. 960-991.
57. M. Nikolova, Model distortions in Bayesian MAP reconstruction, Inverse Probl. Imaging, 1 (2007), pp. 399-422.
58. G. Papandreou and A. L. Yuille, Perturb-and-MAP random fields: Using discrete optimization to learn and sample from energy models, in Proceedings of the 2011 International Conference on Computer Vision (ICCV), IEEE Computer Society, Washington, DC, 2011, pp. 193-200.
59. P. Pletscher, S. Nowozin, P. Kohli, and C. Rother, Putting MAP back on the map, in Proceedings of the 33rd Annual Symposium of the German Association for Pattern Recognition (DAGM), Springer-Verlag, Berlin, Heidelberg, 2011, pp. 111-121.
60. A. Prékopa, On logarithmic concave measures and functions, Acta Sci. Math. (Szeged), 34 (1973), pp. 335-343.
61. W. Ring, Structural properties of solutions of total variation regularization problems, M2AN Math. Model. Numer. Anal., 34 (2000), pp. 799-810.
62. R. T. Rockafellar, Convex Analysis, Princeton University Press, Princeton, NJ, 1970.
63. S. Roth and M. J. Black, Fields of experts, Int. J. Comput. Vision, 82 (2009), pp. 205-229.
64. L. I. Rudin, S. Osher, and E. Fatemi, Nonlinear total variation based noise removal algorithms, Phys. D, 60 (1992), pp. 259-268.
65. H. Rue and M. A. Hurn, Loss functions for Bayesian image analysis, Scand. J. Statist., 24 (1997), pp. 103-114.
66. J. Salmon, Agrégation d'estimateurs et méthodes à patch pour le débruitage d'images numériques, Ph.D. thesis, Université Paris-Diderot, Paris, France, 2010.
67. U. Schmidt, Q. Gao, and S. Roth, A generative perspective on MRFs in low-level vision, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR), San Francisco, CA, 2010, pp. 1751-1758.
68. C. E. Shannon, Communication in the presence of noise, Proc. I.R.E., 37 (1949), pp. 10-21.
69. n, Bull. Soc. Roy. Sci. Liège, 73 (2004), pp. 21-25.
70. C. Stein, Estimation of the mean of a multivariate normal distribution, Ann. Statist., 9 (1981), pp. 1135-1151.
71. J. Tropp, Just relax: Convex programming methods for identifying sparse signals in noise, IEEE Trans. Inform. Theory, 52 (2006), pp. 1030-1051.
72. S. Vaiter, C. A. Deledalle, G. Peyré, C. Dossal, and J. Fadili, Local behavior of sparse analysis regularization: Applications to risk estimation, Appl. Comput. Harmon. Anal., 35 (2013), pp. 433-451.
73. D. Vandeville, SURE-based non-local means, IEEE Signal Process. Lett., 16 (2009), pp. 973-976.
74. P. Weiss, L. Blanc-Féraud, and G. Aubert, Efficient schemes for total variation minimization under constraints in image processing, SIAM J. Sci. Comput., 31 (2009), pp. 2047-2080.
75. O. J. Woodford, C. Rother, and V. Kolmogorov, A global perspective on MAP inference for lowlevel vision, Proceedings of the 2009 IEEE 12th International Conference on Computer Vision (ICCV), 2009, pp. 2319-2326.
76. 1 optical flow, in Proceedings of the 29th DAGM Symposium on Pattern Recognition, Springer-Verlag, Berlin, Heidelberg, 2007, pp. 214-223.