A general framework for regularized, similarity-based image restoration

IEEE Transactions on Image Processing

Volumn 23, Issue 12, 2014, Pages 5136-5151

  Kheradmand, Amin ^a   Milanfar, Peyman ^a  

^a University of California Santa Cruz   (United States)

Author keywords

Deblurring; Denoising; Graph Laplacian; Kernel Similarity Matrix; Sharpening

Indexed keywords

DE-NOISING; DEBLURRING; GRAPH LAPLACIAN; SHARPENING; SIMILARITY MATRIX;

ALGORITHM; COMPUTER SIMULATION; HUMAN; IMAGE PROCESSING; MOTION; PROCEDURES;

ALGORITHMS; COMPUTER SIMULATION; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MOTION;

EID: 84908432911     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2362059     Document Type: Article

References (51)

1. P. C. Hansen, J. G. Nagy, and D. P. O'Leary, Deblurring Images:Matrices, Spectra, and Filtering, 1st ed. Philadelphia, PA, USA: SIAM,2006.
2. M. Donatelli, C. Estatico, A. Martinelli, and S. Serra-Capizzano,"Improved image deblurring with anti-reflective boundary conditions andre-blurring," Inverse Problems, vol. 22, no. 6, p. 2035, 2006.
3. M. Elad, P. Milanfar, and R. Rubinstein, "Analysis versus synthesis insignal priors," Inverse Problems, vol. 23, no. 3, pp. 947-968, Jun. 2007.
4. M. Zibulevsky and M. Elad, "L1-L2 optimization in signal and imageprocessing," IEEE Signal Process. Mag., vol. 27, no. 3, pp. 76-88,May 2010.
5. G. Chantas, N. P. Galatsanos, R. Molina, and A. K. Katsaggelos,"Variational Bayesian image restoration with a product of spatiallyweighted total variation image priors," IEEE Trans. Image Process.,vol. 19, no. 2, pp. 351-362, Feb. 2010.
6. Y. Wang, J. Yang, W. Yin, and Y. Zhang, "A new alternating minimizationalgorithm for total variation image reconstruction," SIAMJ. Imag. Sci., vol. 1, no. 3, pp. 248-272, Aug. 2008.
7. J. P. Oliveira, J. M. Bioucas-Dias, and M. A. T. Figueiredo, "Adaptivetotal variation image deblurring: A majorization-minimizationapproach," Signal Process., vol. 89, no. 9, pp. 1683-1693, 2009.
8. G. Peyré, S. Bougleux, and L. Cohen, "Non-local regularization ofinverse problems," in Proc. 10th Eur. Conf. Comput. Vis. (ECCV),Oct. 2008, pp. 57-68.
9. X. Zhang, M. Burger, X. Bresson, and S. Osher, "Bregmanized nonlocalregularization for deconvolution and sparse reconstruction," SIAM J.Imag. Sci., vol. 3, no. 3, pp. 253-276, 2010.
10. H. Takeda, S. Farsiu, and P. Milanfar, "Deblurring using regularizedlocally adaptive kernel regression," IEEE Trans. Image Process., vol. 17,no. 4, pp. 550-563, Apr. 2008.
11. R. N. Neelamani, H. Choi, and R. Baraniuk, "ForWaRD: Fourierwaveletregularized deconvolution for ill-conditioned systems," IEEE Trans. Signal Process., vol. 52, no. 2, pp. 418-433, Feb. 2004.
12. W. Dong, L. Zhang, G. Shi, and X. Li, "Nonlocally centralized sparserepresentation for image restoration," IEEE Trans. Image Process.,vol. 22, no. 4, pp. 1620-1630, Apr. 2013.
13. S. Lefkimmiatis, A. Bourquard, and M. Unser, "Hessian-based normregularization for image restoration with biomedical applications," IEEE Trans. Image Process., vol. 21, no. 3, pp. 983-995, Mar. 2012.
14. J. Ni, P. Turaga, V. M. Patel, and R. Chellappa, "Example-drivenmanifold priors for image deconvolution," IEEE Trans. Image Process.,vol. 20, no. 11, pp. 3086-3096, Nov. 2011.
15. T. S. Cho, C. L. Zitnick, N. Joshi, S. B. Kang, R. Szeliski, andW. T. Freeman, "Image restoration by matching gradient distributions,"IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 683-694,Apr. 2012.
16. K. Dabov, A. Foi, V. Katkovnik, and K. Egiazarian, "Image denoisingby sparse 3-D transform-domain collaborative filtering," IEEE Trans.Image Process., vol. 16, no. 8, pp. 2080-2095, Aug. 2007.
17. X. Li, "Fine-granularity and spatially-adaptive regularization forprojection-based image deblurring," IEEE Trans. Image Process.,vol. 20, no. 4, pp. 971-983, Apr. 2011.
18. A. Danielyan, V. Katkovnik, and K. Egiazarian, "BM3D frames andvariational image deblurring," IEEE Trans. Image Process., vol. 21,no. 4, pp. 1715-1728, Apr. 2012.
19. A. Levin, R. Fergus, F. Durand, and W. T. Freeman, "Image and depthfrom a conventional camera with a coded aperture," ACM Trans. Graph.,vol. 26, no. 3, Jul. 2007, Art. ID 70.
20. D. Krishnan and R. Fergus, "Fast image deconvolution using hyperlaplacianpriors," in Advances in Neural Information Processing Systems22. Red Hook, NY, USA: Curran Associates, 2009, pp. 1033-1041.
21. L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Progressive inter-scale andintra-scale non-blind image deconvolution," ACM Trans. Graph., vol. 27,no. 3, Aug. 2008, Art. ID 74.
22. Q. Shan, J. Jia, and A. Agarwala, "High-quality motion deblurringfrom a single image," ACM Trans. Graph., vol. 27, no. 3, pp. 1-10,Aug. 2008, Art. ID 73.
23. S. Bougleux, A. Elmoataz, and M. Melkemi, "Local and nonlocal discreteregularization on weighted graphs for image and mesh processing,"Int. J. Comput. Vis., vol. 84, no. 2, pp. 220-236, 2009.
24. J. Boulanger, C. Kervrann, P. Bouthemy, P. Elbau, J.-B. Sibarita, andJ. Salamero, "Patch-based nonlocal functional for denoising fluorescencemicroscopy image sequences," IEEE Trans. Med. Imag., vol. 29, no. 2,pp. 442-454, Feb. 2010.
25. G. Gilboa and S. Osher, "Nonlocal linear image regularization andsupervised segmentation," Multiscale Model. Simul., vol. 6, no. 2,pp. 595-630, 2007.
26. G. Gilboa and S. Osher, "Nonlocal operators with applications to imageprocessing," Multiscale Model. Simul., vol. 7, no. 3, pp. 1005-1028,2008.
27. F. G. Meyer and X. Shen, "Perturbation of the eigenvectors of the graphlaplacian: Application to image denoising," Appl. Comput. Harmon.Anal., vol. 36, no. 2, pp. 326-334, 2014.
28. A. D. Szlam, M. Maggioni, and R. R. Coifman, "Regularization ongraphs with function-adapted diffusion processes," J. Mach. Learn. Res.,vol. 9, pp. 1711-1739, Jun. 2008.
29. G. Taubin, "A signal processing approach to fair surface design," in Proc.22nd Annu. Conf. Comput. Graph. Interact. Techn., 1995, pp. 351-358.
30. P. A. Knight and D. Ruiz, "A fast algorithm for matrix balancing,"IMA J. Numer. Anal., vol. 33, pp. 1029-1047, 2013.
31. A. Kheradmand and P. Milanfar, "A general framework for kernelsimilarity-based image denoising," in Proc. IEEE Global Conf. SignalInf. Process. (GlobalSIP), Dec. 2013, pp. 415-418.
32. P. Milanfar, "Symmetrizing smoothing filters," SIAM J. Imag. Sci., vol. 6,no. 1, pp. 263-284, 2013.
33. P. Knopp and R. Sinkhorn, "Concerning nonnegative matrices anddoubly stochastic matrices," Pacific J. Math., vol. 21, no. 2, pp. 343-348,1967.
34. D. I. Shuman, S. K. Narang, P. Frossard, A. Ortega, andP. Vandergheynst, "The emerging field of signal processing on graphs:Extending high-dimensional data analysis to networks and other irregulardomains," IEEE Signal Process. Mag., vol. 30, no. 3, pp. 83-98,May 2013.
35. F. R. Chung, Spectral Graph Theory, vol. 92. Providence, RI, USA:AMS, 1997.
36. J. Shi and J. Malik, "Normalized cuts and image segmentation,"IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 888-905,Aug. 2000.
37. A. Elmoataz, O. Lezoray, and S. Bougleux, "Nonlocal discrete regularizationon weighted graphs: A framework for image and manifoldprocessing," IEEE Trans. Image Process., vol. 17, no. 7, pp. 1047-1060,Jul. 2008.
38. U. von Luxburg, "A tutorial on spectral clustering," Statist. Comput.,vol. 17, no. 4, pp. 395-416, 2007.
39. T. Hofmann, B. Schölkopf, and A. J. Smola, "Kernel methods in machinelearning," Ann. Statist., vol. 36, no. 3, pp. 1171-1220, 2008.
40. P. Milanfar, "A tour of modern image filtering: New insights andmethods, both practical and theoretical," IEEE Signal Process. Mag.,vol. 30, no. 1, pp. 106-128, Jan. 2013.
41. A. Buades, B. Coll, and J. M. Morel, "A review of image denoisingalgorithms, with a new one," Multiscale Model. Simul., vol. 4, no. 2,pp. 490-530, 2005.
42. M. Meila and J. Shi, "A random walks view of spectral segmentation," inProc. 8th Int. Workshop Artif. Intell. Statist. (AISTATS), 2001, pp. 1-6.
43. J. Immerkær, "Fast noise variance estimation," Comput. Vis. ImageUnderstand., vol. 64, no. 2, pp. 300-302, 1996.
44. P. C. Hansen, "Regularization tools version 4.0 for Matlab 7.3," Numer.Algorithms, vol. 46, no. 2, pp. 189-194, 2007.
45. S. Ramani, T. Blu, and M. Unser, "Monte-Carlo SURE: A blackboxoptimization of regularization parameters for general denoisingalgorithms," IEEE Trans. Image Process., vol. 17, no. 9, pp. 1540-1554,Sep. 2008.
46. A. M. Thompson, J. C. Brown, J. W. Kay, and D. M. Titterington,"A study of methods of choosing the smoothing parameter in imagerestoration by regularization," IEEE Trans. Pattern Anal. Mach. Intell.,vol. 13, no. 4, pp. 326-339, Apr. 1991.
47. M. Hussein, F. Porikli, and L. Davis, "Kernel integral images:A framework for fast non-uniform filtering," in Proc. IEEE Conf.Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
48. S. Cho and S. Lee, "Fast motion deblurring," ACM Trans. Graph.,vol. 28, no. 5, Dec. 2009, Art. ID 145.
49. J. G. Nagy, K. Palmer, and L. Perrone, "Iterative methods for imagedeblurring: A MATLAB object-oriented approach," Numer. Algorithms,vol. 36, no. 1, pp. 73-93, 2004.
50. Z. Wang and A. C. Bovik, "Mean squared error: Love it or leave it?A new look at signal fidelity measures," IEEE Signal Process. Mag.,vol. 26, no. 1, pp. 98-117, Jan. 2009.
51. A. Gupta, N. Joshi, C. L. Zitnick, M. Cohen, and B. Curless, "Singleimage deblurring using motion density functions," in Proc. 11th Eur.Conf. Comput. Vis. (ECCV), 2010, pp. 171-184.