Blind image blur estimation via deep learning

IEEE Transactions on Image Processing

Volumn 25, Issue 4, 2016, Pages 1910-1921

  Yan, Ruomei ^a,b   Shao, Ling ^a,c  

^a NANJING UNIVERSITY OF INFORMATION SCIENCE AND TECHNOLOGY   (China)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

^c NORTHUMBRIA UNIVERSITY   (United Kingdom)

Author keywords

blind image deblurring; blur classification; blur parameter estimation

Indexed keywords

BLIND EQUALIZATION; CONVOLUTION; FACE RECOGNITION; IMAGE ENHANCEMENT; IMAGE SEGMENTATION; NEURAL NETWORKS;

BLIND DECONVOLUTION; CLASSIFICATION ABILITY; DEEP NEURAL NETWORKS; DISCRIMINATIVE FEATURES; GENERAL REGRESSION NEURAL NETWORK; IMAGE DEBLURRING; LEARNING-BASED METHODS; REGION SEGMENTATION;

PARAMETER ESTIMATION;

EID: 84964681290     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2535273     Document Type: Article

References (46)

1. R. L. Lagendijk and J. Biemond, Basic Methods for Image Restoration and Identification. London, U.K.: Academic, 2000.
2. D. Krishnan and R. Fergus, "Fast image deconvolution using hyper- Laplacian priors," in Proc. Conf. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, 2009, pp. 1-9.
3. R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, and W. T. Freeman, "Removing camera shake from a single photograph," ACM Trans. Graph., vol. 25, no. 3, pp. 787-794, Jul. 2006.
4. S. Cho and S. Lee, "Fast motion deblurring," in Proc. ACM SIGGRAPH Asia, Yokohama, Japan, 2009, Art. no. 145.
5. D. Zoran and Y. Weiss, "From learning models of natural image patches to whole image restoration," in Proc. IEEE Int. Conf. Comput. Vis., Barcelona, Spain, Nov. 2011, pp. 479-486.
6. M. S. C. Almeida and L. B. Almeida, "Blind and semi-blind deblurring of natural images," IEEE Trans. Image Process., vol. 19, no. 1, pp. 36-52, Jan. 2010.
7. Q. Shan, J. Jia, and A. Agarwala, "High-quality motion deblurring from a single image," ACM Trans. Graph., vol. 27, no. 3, pp. 721-730, Aug. 2008.
8. N. Joshi, R. Szeliski, and D. J. Kriegman, "PSF estimation using sharp edge prediction," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, 2008, pp. 1-8.
9. A. Levin, Y. Weiss, F. Durand, and W. T. Freeman, "Efficient marginal likelihood optimization in blind deconvolution," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 2657-2664.
10. D. Krishnan, T. Tay, and R. Fergus, "Blind deconvolution using a normalized sparsity measure," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 233-240.
11. T. S. Cho, S. Paris, B. K. P. Horn, and W. T. Freeman, "Blur kernel estimation using the radon transform," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Colorado Springs, CO, USA, Jun. 2011, pp. 241-248.
12. L. Sun, S. Cho, J. Wang, and J. Hays, "Edge-based blur kernel estimation using patch priors," in Proc. IEEE Int. Conf. Comput. Photography, Cambridge, MA, USA, Apr. 2013, pp. 1-8.
13. A. Levin, Y. Weiss, F. Durand, and W. T. Freeman, "Understanding and evaluating blind deconvolution algorithms," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Miami Beach, FL, USA, Jun. 2009, pp. 1964-1971.
14. R. Liu, Z. Li, and J. Jia, "Image partial blur detection and classification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Anchorage, AK, USA, Jun. 2008, pp. 1-8.
15. B. Su, S. Lu, and C. L. Tan, "Blurred image region detection and classification," in Proc. 19th ACM Multimedia, Scottsdale, AZ, USA, 2011, pp. 1397-1400.
16. V. Jain and H. Seung, "Natural image denoising with convolutional networks," in Proc. Conf. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, 2008, pp. 769-776.
17. A. Ciancio, A. L. N. T. da Costa, E. A. B. da Silva, A. Said, R. Samadani, and P. Obrador, "No-reference blur assessment of digital pictures based on multifeature classifiers," IEEE Trans. Image Process., vol. 20, no. 1, pp. 64-75, Jan. 2011.
18. D. Erhan, P. Manzagol, Y. Bengio, S. Bengio, and P. Vincent, "The difficulty of training deep architectures and the effect of unsupervised pre-training," in Proc. IEEE Int. Conf. Artif., Intell., Statist., Clearwater Beach, FL, USA, May 2009, pp. 153-160.
19. J. Rugna and H. Konik, "Automatic blur detection for metadata extraction in conten-based retrieval context," in Proc. SPIE Internet Imag. V, vol. 5304. San Diego, CA, USA, 2003.
20. K. Gu, G. Zhai, W. Lin, X. Yang, and W. Zhang, "No-reference image sharpness assessment in autoregressive parameter space," IEEE Trans. Image Process., vol. 24, no. 10, pp. 3218-3231, Oct. 2015.
21. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Comput., vol. 14, no. 8, pp. 1771-1800, Aug. 2002.
22. R. Molina, J. Mateos, and A. K. Katsaggelos, "Blind deconvolution using a variational approach to parameter, image, and blur estimation," IEEE Trans. Image Process., vol. 15, no. 12, pp. 3715-3727, Dec. 2006.
23. W. Hu, J. Xue, and N. Zheng, "PSF estimation via gradient domain correlation," IEEE Trans. Image Process., vol. 21, no. 1, pp. 386-392, Jan. 2012.
24. F. Chen and J. Ma, "An empirical identification method of Gaussian blur parameter for image deblurring," IEEE Trans. Signal Process., vol. 57, no. 7, pp. 2467-2478, Jul. 2009.
25. D. Kundur and D. Hatzinakos, "Blind image deconvolution," IEEE Signal Process. Mag., vol. 13, no. 3, pp. 43-64, May 1996.
26. S.-H. Zhong, Y. Liu, and Y. Liu, "Bilinear deep learning for image classification," in Proc. 19th ACM Int. Conf. Multimedia, Scottsdale, AZ, USA, 2011, pp. 343-352.
27. M. Cannon, "Blind deconvolution of spatially invariant image blurs with phase," IEEE Trans. Acoust., Speech, Signal Process., vol. 24, no. 1, pp. 58-63, Feb. 1976.
28. Y. Bengio, P. Lamblin, D. Popovici, and H. Larochelle, "Greedy layerwise training of deep networks," in Proc. Conf. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, 2006, pp. 1-6.
29. R. Yan and L. Shao, "Image blur classification and parameter identification using two-stage deep belief networks," in Proc. Brit. Mach. Vis. Conf., Bristol, U.K., 2013, pp. 70.1-70.11.
30. D. F. Specht, "A general regression neural network," IEEE Trans. Neural Netw., vol. 2, no. 6, pp. 568-576, Nov. 1991.
31. P. Bao, L. Zhang, and X. Wu, "Canny edge detection enhancement by scale multiplication," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 9, pp. 1485-1490, Sep. 2005.
32. W. McIlhagga, "The Canny edge detector revisited," Int. J. Comput. Vis., vol. 91, no. 3, pp. 251-261, Feb. 2011.
33. C. Lee, S. Xie, P. Gallagher, Z. Zhang, and Z. Tu. (2014). "Deeplysupervised nets." Online. Available: http://arxiv.org/abs/1409.5185.
34. Y. LeCun et al., "Backpropagation applied to handwritten zip code recognition," Neural Comput., vol. 1, no. 4, pp. 541-551, Dec. 1989.
35. D. Tomandl and A. Schober, "A modified general regression neural network (MGRNN) with new, efficient training algorithms as a robust black box-tool for data analysis," Neural Netw., vol. 14, no. 8, pp. 1023-1034, Oct. 2001.
36. S. Roth and M. J. Black, "Fields of experts: A framework for learning image priors," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., San Diego, CA, USA, Jun. 2005, pp. 860-867.
37. D. Martin, D. Fowlkes, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. IEEE Int. Conf. Comput. Vis., Vancouver, BC, Canada, Jul. 2001, pp. 416-423.
38. K. Gu, G. Zhai, X. Yang, and W. Zhang, "Using free energy principle for blind image quality assessment," IEEE Trans. Multimedia, vol. 17, no. 1, pp. 50-63, Jan. 2015.
39. M. Everingham, V. G. L., C. Williams, J. Winn, and A. Zisserman, "The pascal visual object classes challenge," Int. J. Comput. Vis., vol. 88, no. 2, pp. 303-338, Jan. 2010.
40. T. Mitchell. Machine Learning. New York, NY, USA: McGraw-Hill, 1997.
41. R. Palm, "Prediction as a candidate for learning deep hierarchical models of data," M.S. thesis, Dept. Inform., Tech. Univ. Denmark, Kongens Lyngby, Denmark, 2012.
42. S. Duan and K. Keerthi, "Which is the best multiclass svm method? An empirical study," in Proc. Int. Conf. Multiple Classifier Syst., Seaside, CA, USA, 2005.
43. W. Xue, L. Zhang, X. Mou, and A. C. Bovik, "Gradient magnitude similarity deviation: A highly efficient perceptual image quality index," IEEE Trans. Image Process., vol. 23, no. 2, pp. 684-695, Feb. 2014.
44. A. Liu, W. Lin, and M. Narwaria, "Image quality assessment based on gradient similarity," IEEE Trans. Image Process., vol. 21, no. 4, pp. 1500-1512, Apr. 2012.
45. S. R. Gunn, "Support vector machines for classification and regression," School Electron. Comput. Sci., University of Southampton, Southampton, U.K., Tech. Rep., 1998.
46. Q. Li, Q. Meng, J. Cai, H. Yoshino, and A. Mochida, "Predicting hourly cooling load in the building: A comparison of support vector machine and different artificial neural networks," Energy Convers. Manage., vol. 50, no. 1, pp. 90-96, Jan. 2009.