Image denoising methods. A new nonlocal principle

SIAM Review

Volumn 52, Issue 1, 2010, Pages 113-147

  Buades, A ^a,b   Coll, B ^a   Morel, J M ^c  

^a UNIVERSITAT DE LES ILLES BALEARS   (Spain)

^b UNIVERSITÉ PARIS DESCARTES   (France)

^c UNIVERSITÉ PARIS SACLAY   (France)

Author keywords

Adaptive filters; Frequency domain filters; Image restoration; Nonparametric estimation; PDE smoothing filters

Indexed keywords

FREQUENCY DOMAIN FILTERS; IMAGE RESTORATION; NON-PARAMETRIC ESTIMATIONS; PDE SMOOTHING FILTERS; SMOOTHING FILTERS;

ADAPTIVE FILTERING; ADAPTIVE FILTERS; AIRCRAFT ENGINES; ALGORITHMS; ASYMPTOTIC ANALYSIS; ELECTRIC FILTERS; ESTIMATION; FREQUENCY DOMAIN ANALYSIS; IMAGE RECONSTRUCTION; PARTIAL DIFFERENTIAL EQUATIONS; RESTORATION;

FREQUENCY ESTIMATION;

EID: 77249112222     PISSN: 00361445     EISSN: None     Source Type: Journal    
DOI: 10.1137/090773908     Document Type: Article

References (100)

1. A. ADAMS, N. GELFAND, J. DOLSON, AND M. LEVOY, Gaussian KD-trees for fast high-dimensional filtering, ACM Trans. Graphics, 28 (2009), article 21.
2. S. ALEXANDER, E. VRSCAY, AND S. TSURUMI, A simple, general model for the affine self-similarity of images, in Proceedings of the 5th International Conference on Image Anal-ysis and Recognition, Lecture Notes in Comput. Sci. 5112, Springer-Verlag, Berlin, 2008, pp. 192-203.
3. L. ALVAREZ, P.-L. LIONS, AND J.-M. MOREL, Image selective smoothing and edge detection by nonlinear diffusion. II, SIAM J. Numer. Anal., 29 (1992), pp. 845-866.
4. P. ARIAS, V. CASELLES, AND G. SAPPIRO, A variational framework for non-local image inpaint-ing, in Proceedings of the 7th International Conference on Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR), Lecture Notes in Comput. Sci. 5681, Springer-Verlag, Berlin, 2009, pp. 345-358.
5. F. ATTNEAVE, Some informational aspects of visual perception, Psychol. Rev., 61 (1954), pp. 183-193.
6. S. AwATE AND R. WHITAKER, Unsupervised, information-theoretic, adaptive image filtering for image restoration, IEEE Trans. Pattern Anal. Mach. Intell., 28 (2006), pp. 364-376.
7. R. BILCU AND M. VEHVILAINEN, Combined non-local averaging and intersection of confidence intervals for image denoising, in Proceedings of the 15th IEEE International Conference on Image Processing, 2008, pp. 1736-1739.
8. J. BOULANGER, C. KERVRANN, AND P. BOUTHEMY, Space-time adaptation for patch-based image sequence restoration, IEEE Trans. Pattern Anal. Mach. Intell., 29 (2007), pp. 1096-1102.
9. J. BOULANGER, J. SIBARITA, C. KERVRANN, AND P. BOUTHEMY, Non-parametric regression for patch-based fluorescence microscopy image sequence denoising, in Proceedings of the 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 2008, pp. 748-751.
10. X. BRESSON AND T. CHAN, Non-local Unsupervised Variational Image Segmentation Models, UCLA CAM Report 08-67, University of California, Los Angeles, 2008.
11. T. BROX AND D. CREMERS, Iterated nonlocal means for texture restoration, Scale Space and Variational Methods in Computer Vision, Lecture Notes in Comput. Sci. 4485, Springer-Verlag, Berlin, 2007, pp. 13-24.
12. A. BUADES, A. CHIEN, J. M. MOREL, AND S. OSHER, Topology preserving linear filtering applied to medical imaging, SIAM J. Imaging Sci., 1 (2008), pp. 26-50.
13. A. BUADES, B. COLL, AND J. MOREL, Image Data Process by Image Noise Reduction and Camera Integrating the Means for Implementing This Process, French Patent 0404837.
14. A. BUADES, B. COLL, AND J. MOREL, Denoising image sequences does not require motion estimation, in Proceedings of the IEEE Conference on Advanced Video and Signal Based Surveillance, 2005, pp. 70-74.
15. A. BUADES, B. COLL, AND J. MOREL, Image Enhancement by Non-local Reverse Heat Equation, CMLA Preprint 22, Centre de Mathématiques et Leurs Applications, Cachan, France, 2006.
16. A. BUADES, B. COLL, AND J. MOREL, Neighborhood filters and PDE's, Numer. Math., 105 (2006), pp. 1-34.
17. A. BUADES, B. COLL, AND J. MOREL, The staircasing effect in neighborhood filters and its solution, IEEE Trans. Image Process., 15 (2006), pp. 1499-1505.
18. A. BUADES, B. COLL, AND J. MOREL, Nonlocal image and movie denoising, Internat. J. Com-puter Vision, 76 (2008), pp. 123-139.
19. A. BUADES, B. COLL, J. MOREL, AND C. SBERT, Self-similarity driven color demosaicking, IEEE Trans. Image Process., 18 (2009), pp. 1192-1202.
20. A. BUADES, B. COLL, AND J. M. MOREL, A review of image denoising algorithms, with a new one, Multiscale Model. Simul., 4 (2005), pp. 490-530.
21. F. CATTÉ, F. DIBOS, AND G. KOEPFLER, A morphological scheme for mean curvature motion and applications to anisotropic diffusion and motion of level sets, SIAM J. Numer. Anal., 32 (1995), pp. 1895-1909.
22. A. CHAMBOLLE AND P. L. LIONS, Image recovery via total variation minimization and related problems, Numer. Math., 76 (1997), pp. 167-188.
23. P. CHATT'ERJEE AND P. MILANFAR, Image denoising using locally learned dictionaries, in Com-putational Imaging VII, P. Chatterjee and P. Milanfar, eds., Proc. SPIE 7246, SPIE, Bellingham, WA, 2009, article 72460V.
24. R. R. COIFMAN AND D. DONOHO, Translation-invariant de-noising, in Wavelets and Statistics, Lecture Notes in Statist., Springer-Verlag, New York, 1995, pp. 125-150.
25. P. COUPE, P. YGER, AND C. BARILLOT, Fast non local means denoising for 3D MR images, in Medical Image Computing and Computer-Assisted Intervention (MICCAI), Springer-Verlag, Berlin, 2006, pp. 33-40.
26. P. COUPÉ, P. YGER, S. PRIMA, P. HELLIER, C. KERVRANN, AND C. BARILLOT, An optimized blockwise nonlocal means denoising filter for 3D magnetic resonance images, Trans. Med. Imaging, 27 (2008), pp. 425-441.
27. K. DABOV, A. FOI, V. KATKOVNIK, AND K. EGIAZARIAN, Image denoising by sparse 3-D transform-domain collaborative filtering, IEEE Trans. Image Process., 16 (2007), pp. 2080-2095.
28. A. DANIELYAN, A. FOI, V. KATKOVNIK, AND K. EGIAZARIAN, Image and Video Super-Resolution via Spatially Adaptive Block-Matching Filtering, in Proceedings of the International Work-shop on Local and Non-local Approximation in Image Processing, 2008.
29. J. DARBON, A. CUNHA, T. CHAN, S. OSHER, AND G. JENSEN, Fast nonlocal filtering applied to electron cryomicroscopy, in Proceedings of the 5th IEEE International Symposium on Biomedical Imaging: From Nano to Macro, 2008, pp. 1331-1334.
30. J. DELON AND A. DESOLNEUX, Flicker Stabilization in Image Sequences, preprint; available online from http://hal.archives-ouvertes.fr/docs/00/40/77/ 96/PDF/flicker-hal -juillet2009.pdf.
31. B. DONG, J. YE, S. OSHER, AND I. DINOV, Level set based nonlocal surface restoration, Multi-scale Model. Simul., 7 (2008), pp. 589-598.
32. D. DONOHO, De-noising by soft-thresholding, IEEE Trans. Inform. Theory, 41 (1995), pp. 613-627.
33. D. DONOHO AND I. JOHNSTONE, Ideal spatial adaptation via wavelet shrinkage, Biometrika, 81 (1994), pp. 425-455.
34. S. DURAND AND M. NIKOLOVA, Restoration of wavelet coefficients by minimizing a specially designed objective function, in Proceedings of the IEEE Workshop on Variational and Level Set Methods in Computer Vision, 2003, pp. 145-152.
35. M. EBRAHIMI AND E. VRSCAY, Multi-frame super-resolution with no explicit motion estimation, in Proceedings of the 2008 International Conference on Image Processing, Computer Vision, and Pattern Recognition, 2008, pp. 455-1159
36. M. EBRAHIMI AND E. VRSCAY, Solving the Inverse Problem of Image Zooming Using "Self-Examples," in Image Analysis and Recognition, Lecture Notes in Comput. Sci. 4633, Springer-Verlag, Berlin, 2007, pp. 117-130.
37. M. EBRAHIMI AND E. VRSCAY, Examming the role of scale in the context of the non-local-means filter, in Image Analysis and Recognition, Lecture Notes in Comput. Sci. 5112, Springer-Verlag, Berlin, 2008, pp. 170-181.
38. A. EFROS AND T. LEUNG, Texture synthesis by non-parametric sampling, in Proceedings of the IEEE International Conference on Computer Vision, Vol.2, Corfu, Greece, 1999, pp. 1033-1038.
39. M. ELAD AND D. DATSENKO, Example-based regularization deployed to super-resolution recon-struction of a single image, The Computer J., 50 (2007), pp. 1-16.
40. A. ELMOATAZ, O. LEZORAY, AND S. BOUGLEUX, Nonlocal discrete regularization on weighted graphs: A framework for image and manifold processing, IEEE Trans. Image Process., 17 (2008), pp. 1047-1060.
41. A. ELMOATAZ, O. LEZORAY, S. BOUGLEUX, AND V. TA, Unifying local and nonlocal process-ing with partial difference operators on weighted graphs, in International Workshop on Local and Non-Local Approximation in Image Processing, 2008; available online from http://www.eurasip.org/Proceedings/Ext/LNLA2008/ papers/cr1028.pdf.
42. D. GABOR, Information theory in electron microscopy, Laboratory Investigation, 14 (1965), pp. 801-807.
43. G. GILBOA AND S. OSHER, Nonlocal linear image regularization and supervised segmentation, Multiscale Model. Simul., 6 (2007), pp. 595-630.
44. B. GOOSSENS, H. LUONG, A. PIZURICA, AND W. PHILIPS, An improved non-local denoising algorithm, in Proceedings of the 2008 International Workshop on Local and Non-local Approximation in Image Processing, Lausanne, Switzerland, 2008; available online from http://130.230.88.154/images/8/8b/Crl026-lausanne.pdf.
45. S. GORNALE, R. MANZA, V. HUMBE, AND K. KALE, Performance analysis of bi-orthogonal wavelet filters for lossy fingerprint image compression, Internat. J. Image Sci. Engrg., 1 (2007), pp. 16-20.
46. F. GUICHARD, J. M. MOREL, AND R. RYAN, Contrast Invariant Image Analysis and PDE's, book in preparation.
47. Y. HEO, K. LEE, AND S. LEE, Simultaneous depth reconstruction and restoration of noisy stereo images using non-local pixel distribution, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2007, pp. 1-8.
48. B. HUHLE, T. SCHAIRER, P. JENKE, AND W. STRASSER, Robust non-local denoising of colored depth data, in Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops, 2008, pp. 1-7.
49. M. JUNG AND L. VESE, Nonlocal variational image deblurring models in the presence of Gaussian or impulse noise, in Proceedings of the 2nd International Conference on Scale Space and Variational Methods in Computer Vision, Lecture Notes in Comput. Sci. 5567, Springer-Verlag, Berlin, 2009, pp. 401-412.
50. C. KERVRANN, J. BOULANGER, AND P. COUPE, Bayesian non-local means filter, image redun-dancy and adaptive dictionaries for noise removal, in Scale Space and Variational Methods in Computer Vision, Lecture Notes In Comput. Sci. 4485, Springer-Verlag, Berlin, 2007, pp. 520-532.
51. S. KINDERMANN, S. OSHER, AND P. W. JONES, Deblurring and denoising of images by nonlocal functional, Multiscale Model. Simul., 4 (2005), pp. 1091-1115.
52. E. LEVINA, Statistical Issues in Texture Analysis, Ph.D. thesis, University of California, Berke-ley, CA, 2002.
53. O. LEZORAY, V. TA, AND A. ELMOATAZ, Nonlocal graph regularization for image colorization, in Proceedings of the 19th International Conference on Pattern Recognition, 2008, pp. 1-4.
54. M. LINDENBAUM, M. FISCHER, AND A. M. BRUCKSTEIN, On Gabor's contribution to image enhancement, Pattern Recognition, 27 (1994), pp. 1-8.
55. Y. Lou, X. ZHANG, S. OSHER, AND A. BERTOZZI, Image Recovery via Nonlocal Operators, UCLA CAM Report 08-35, University of California, Los Angeles, 2008.
56. M. MAHMOUDI AND G. SAPIRO, Fast image and video denoising via nonlocal means of similar neighborhoods, IEEE Signal Process. Lett., 12 (2005), pp. 839-842.
57. J. MAIRAL, M. ELAD, AND G. SAPIRO, Sparse representation for color image restoration, IEEE Trans. Image Process., 17 (2008), pp. 53-69.
58. J. MAIRAL, G. SAPIRO, AND M. ELAD, Learning multiscale sparse representations for image and video restoration, Multiscale Model. Simul., 7 (2008), pp. 214-241.
59. F. MALGOUYRES, Noise selection approach to image restoration, in Wavelets: Applications in Signal and Image Processing IX, Proc. SPIE 4478, SPIE, Bellingham, WA, 2001, pp. 34-41.
60. S. MALLAT, A Wavelet Tour of Signal Processing, Academic Press, San Diego, CA, 1999.
61. J. MANJÓN, J. CARBONELL-CABALLERO, J. LULL, G. GAROÍA-MARTÍ, L. MARTÍ-BONMATÍ, AND M. ROBLES, MRI denoising using non-local means, Med. Image Anal., 12 (2008), pp. 514-523.
62. J. MANJÓN, M. ROBLES, AND N. THACKER, Multispectral MRI denoising using non-local means, in Proceedings of Medical Image Understanding and Analysis 2007 (MIUA 2007), Vol.7, Wales, 2007, pp. 41-45.
63. G. MAYER., E. VRSCAY, M. LAUZON, B. GOODYEAR, AND J. MITCHELL, Self-similarity of Images in the Fourier Domain, with Applications to MRI, in Image Analysis and Recognition, Lecture Notes in Comput. Sci. 5112, Springer-Verlag, Berlin, 2008, pp. 43-52.
64. B. MERRIMAN, J. BENCE, AND S. OSHER, Diffusion generated motion by mean curvature, in Computational Crystal Growers Workshop, AMS, Providence, RI, 1992.
65. Y. MEYER, Oscillating Patterns in Image Processing and Nonlinear Evolution Equations, Univ. Lecture Ser. 22, AMS, Providence, RI, 2002.
66. M. MIGNOTTE, A non-local regularization strategy for image deconvolution, Pattern Recognition Lett., 29 (2008), pp. 2206-2212.
67. É. A. NADARAYA, On non-parametric estimates of density functions and regression curves, Theory Probab. Appl., 10 (1964), pp. 186-190.
68. B. NAEGEL, A. CERNICANU, J. HYACINTHE, M. TOGNOLINI, AND J. VALLÉE, SNR enhance-ment of highly-accelerated real-time cardiac MRI acquisitions based on non-local means algorithm, Med. Image Anal., 13 (2009), pp. 598-608.
69. J. ORCHARD, M. EBRAHIMI, AND A. WONG, Efficient non-local-means denoising using the SVD, in Proceedings of the 15th IEEE International Conference on Image Processing, 2008, pp. 1732-1735.
70. E. ORDENTLICH, G. SEROUSSI, S. VERDÚ, M. WEINBERGER, AND T. WEISSMAN, A discrete universal denoiser and its application to binary images, in Proceedings of the 2003 IEEE International Conference on Image Processing, Vol.1, Barcelona, Spain, 2003, pp. 117-120.
71. S. OSHER, M. BURGER, D. GOLDFARB, J. XU, AND W. YIN, Using Geometry and Iterated Refinement for Inverse Problems 1: Total Variation Based Image Restoration, Department of Mathematics, University of California, Los Angeles, 2004, pp. 4-13.
72. P. PERONA AND J. MALIK, Scale-space and edge detection using anisotropic diffusion, IEEE Trans. Pattern Anal. Mach. Intell., 12 (1990), pp. 629-639.
73. G. PEYRÉ, Sparse modeling of textures, J. Math. Imaging Vision, 34 (2009), pp. 17-31.
74. C. PIERRICK ET AL., 3D wavelet subbands mixing for image denoising, Internat. J. Biomed. Imaging, 2008 (2008), pp. 1-11.
75. M. PROTTER AND M. ELAD, Image sequence denoising via sparse and redundant representa-tions, IEEE Trans. Image Process., 18 (2009), pp. 27-35.
76. M. PROTTER, M. ELAD, H. TAKEDA, AND P. MILANFAR, Generalizing the non-local-means to super-resolution reconstruction, IEEE Trans. Image Process., 18 (2009), pp. 36-51.
77. G. G. ROUSSAS, Nonparametric regression estimation under mixing conditions, Stochastic Pro-cess. Appl, 36 (1990), pp. 107-116.
78. L. RUDIN AND S. OSHER, Total variation based image restoration with free local constraints, in Proceedings of the IEEE International Conference on Image Processing, Vol.1, Austin, TX, 1994, pp. 31-35.
79. L. RUDIN, S. OSHER., AND E. FATEMI, Nonlinear total variation based noise removal algorithms, Phys. D, 60 (1992), pp. 259-268.
80. H. SEO, P. CHATTERJEE, H. TAKEDA, AND P. MILANFAR, A comparison of some state of the art image denoising methods, in Proceedings of the 41st Asilomar Conference on Signals, Systems, and Computers, 2007.
81. C. SHANNON, A mathematical theory of communication, ACM SIGMOBILE Mobile Comput. Commun. Rev., 5 (2001), pp. 3-55.
82. A. SHARF, M. ALEXA, AND D. COHEN-OR, Context-based surface completion, ACM Trans. Graphics, 23 (2004), pp. 878-887.
83. S. M. SMITH AND J. M. BRADY, SUSAN-a new approach to low level image processing, In-ternat. J. Computer Vision, 23 (1997), pp. 45-78.
84. A. SZLAM, M. MAGGIONI, AND R. COIFMAN, A General Framework for Adaptive Regularization Based on Diffusion Processes on Graphs, Technical Report, Yale University, New Haven, CT, 2006.
85. N. THACKER, J. MANJON, AND P. BROMILEY, A statistical interpretation of non-local means, in Proceedings of the 5th International Conference on Visual Information Engineering, 2008, pp. 250-255.
86. C. TOMASI AND R. MANDUCHI, Bilateral filtering for gray and color images, in Proceedings of the 6th International Conference on Computer Vision, 1998, pp. 839-846.
87. J. WANG, Y. GUO, Y. YING, Y. LIU, AND Q. PENG, Fast non-local algorithm for image denois-ing, in Proceedings of the 2006 IEEE International Conference on Image Processing, 2006, pp. 1429-1432.
88. G. S. WATSON, Smooth regression analysis, Sankhyã Ser. A, 26 (1964), pp. 359-372.
89. T. WEISSMAN, E. ORDENTLICH, G. SEROUSSI, S. VERDU, AND M. WEINBERGER, Universal discrete denoising: Known channel, IEEE Trans. Inform. Theory, 51 (2005), pp. 5-28.
90. N. WIEST-DAESSLÉ, S. PRIMA, P. COUPÉ, S. MORRISSEY, AND C. BARILLOT, Non-local means variants for denoising of diffusion-weighted and diffusion tensor MRI, in Medical Image Computing and Computer-Assisted Intervention (MICCAI), Lecture Notes in Comput. Sci. 4792, Springer-Verlag, Berlin, 2007, pp. 344-351.
91. N. WIEST-DAESSLE, S. PRIMA, P. COUPÉ, S. MORRISSEY, AND C. BARILLOT, Rician noise removal by non-local means filtering for low signal-to-noise ratio MRI: Applications to DT-MRI, in Medical Image Computing and Computer-Assisted Intervention (MICCAI), Lecture Notes in Comput. Sci. 5242, Springer-Verlag, Berlin, 2008, pp. 171-179.
92. A. WONG AND J. ORCHARD, A nonlocal-means approach to exemplar-based inpainting, in Pro-ceedings of the 15th IEEE International Conference on Image Processing, 2008, pp. 2600-2603.
93. H. Xu, J. Xu, AND F. Wu, On the biased estimation of nonlocal means filter, in Proceedings of the 2008 IEEE International Conference on Multimedia and Expo, 2008, pp. 1149-1152.
94. L. YAROSLAVSKY, Local adaptive image restoration and enhancement with the use of DFT and DCT in a running window, in Mathematical Imaging: Wavelet Applications in Signal and Image Processing IV, Proc. SPIE 2825, SPIE, Bellingham, WA, 1996, pp. 2-13.
95. L. YAROSLAVSKY AND M. EDEN, Fundamentals of Digital Optics, Birkhäuser, Boston, 2003.
96. L. YAROSLAVSKY, K. EGIAZARIAN, AND J. ASTOLA, Transform domain image restoration meth-ods: Review, comparison and interpretation, in Nonlinear Image Processing and Pattern Analysis, SPIE, Bellingham, WA, 2001, pp. 155-169.
97. L. P. YAROSLAVSKY, Digital Picture Processing. An Introduction, Springer-Verlag, Berlin, 1985.
98. S. YOSHIZAWA, A. BELYAEV, AND H. SEIDEL, Smoothing by example: Mesh denoising by aver-aging with similarity-based weights, in Proceedings of the IEEE International Conference on Shape Modeling and Applications, 2006, p. 9.
99. X. ZHANG, M. BURGER, X. BRESSON, AND S. OSHER, Bregmanized Nonlocal Regularization for Deconvolution and Sparse Reconstruction, UCLA CAM Report 09-103, University of California, Los Angeles, 2009.
100. S. ZIMMER, S. DIDAS, AND J. WEICKERT, A rotationally invariant block matching strategy improving image denoising with non-local means, in Proceedings of the 2008 International Workshop on Local and Non-local Approximation in Image Processing, 2008, pp. 135-142.