Generative Bayesian image super resolution with natural image prior

IEEE Transactions on Image Processing

Volumn 21, Issue 9, 2012, Pages 4054-4067

  Zhang, Haichao ^a   Zhang, Yanning ^a   Li, Haisen ^a   Huang, Thomas S ^b  

^a NORTHWESTERN POLYTECHNICAL UNIVERSITY   (China)

^b University of Illinois at Urbana Champaign   (United States)

Author keywords

Bayesian minimum mean square error estimation; field of experts; Markov chain Monte Carlo (MCMC); Markov random field; natural image statistics; super resolution (SR)

Indexed keywords

FIELD-OF-EXPERTS; MARKOV CHAIN MONTE CARLO; MARKOV RANDOM FIELDS; MINIMUM MEAN SQUARE ERROR ESTIMATIONS; NATURAL IMAGE STATISTICS; SUPER RESOLUTION;

ALGORITHMS; ESTIMATION; IMAGE PROCESSING; MEDICAL IMAGING; SIGNAL RECEIVERS;

DISCRETE COSINE TRANSFORMS;

ALGORITHM; ARTICLE; BAYES THEOREM; DIAGNOSTIC IMAGING; FACE; HISTOLOGY; HUMAN; IMAGE PROCESSING; METHODOLOGY; PROBABILITY; REGRESSION ANALYSIS;

ALGORITHMS; BAYES THEOREM; DIAGNOSTIC IMAGING; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MARKOV CHAINS; REGRESSION ANALYSIS;

EID: 84865444179     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2199330     Document Type: Article

References (41)

1. R. Y. Tsai and T. Huang, "Multiframe image restoration and registration," in Proc. Adv. Comput. Vision Image Process., 1984, pp. 317-339.
2. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example based superresolution," IEEE Comput. Graph. Appl., vol. 22, no. 2, pp. 56-65, Mar.- Apr. 2002.
3. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. IEEE Int. Conf. Comput. Vision, Oct. 2009, pp. 349- 356.
4. H. Zhang, J. Yang, Y. Zhang, and T. Huang, "Non-local kernel regression for image and video restoration," in Proc. Eur. Conf. Comput. Vision, 2010, pp. 566-579.
5. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
6. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167- 1183, Sep. 2002. (Pubitemid 35242579)
7. X. Li and M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001. (Pubitemid 32981825)
8. H. Takeda, S. Farsiu, and P. Milanfar, "Kernel regression for image processing and reconstruction," IEEE Trans. Image Process., vol. 16, no. 2, pp. 349-366, Feb. 2007. (Pubitemid 46421678)
9. M. F. Tappen, B. C. Russell, and W. T. Freeman, "Exploiting the sparse derivative prior for super-resolution and image demosaicing," in Proc. IEEE Workshop Stat. Comput. Theories Vision, Oct. 2003, pp. 1-24.
10. K. I. Kim and Y. Kwon, "Single-image super-resolution using sparse regression and natural image prior," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 1127-1133, Jun. 2010.
11. R. Fattal, "Image upsampling via imposed edge statistics," ACM Trans. Graph., vol. 26, no. 3, pp. 95-102, 2007.
12. S. Dai, M. Han, W. Xu, Y. Wu, Y. Gong, and A. K. Katsaggelos, "Softcuts: A soft edge smoothness prior for color image super-resolution," IEEE Trans. Image Process., vol. 18, no. 5, pp. 969-981, May 2009.
13. J. Sun, J. Sun, Z. Xu, and H. Y. Shum, "Image super-resolution using gradient profile prior," in Proc. IEEE Conf. Comput. Vision Pattern Recognit., Jun. 2008, pp. 1-8.
14. A. Mohebi and P. Fieguth, "Posterior sampling of scientific images," in Proc. Int. Conf. Image Anal. Recognit., 2006, pp. 1-12.
15. S. D. Babacan, R. Molina, and A. K. Katsaggelos, "Variational Bayesian super resolution," IEEE Trans. Image Process., vol. 20, no. 4, pp. 984- 999, Apr. 2011.
16. T. Katsuki, A. Torii, and M. Inoue, "Posterior mean super-resolution with a causal Gaussian Markov random field prior," IEEE Trans. Image Process., to be published.
17. M. E. Tipping and C. M. Bishop, "Bayesian image super-resolution, " in Proc. Adv. Neural Inf. Process. Syst., 2005, pp. 1303-1310.
18. Q. Shan, Z. Li, J. Jia, and C. K. Tang, "Fast image/video upsampling," ACM Trans. Graph., vol. 27, no. 5, pp. 1-5, 2008.
19. Y. W. Tai, S. Liu, M. S. Brown, and S. Lin, "Super resolution using edge prior and single image detail synthesis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2400-2407.
20. L. C. Pickup, S. J. Roberts, and A. Zisserman, "A sampled texture prior for image super-resolution," in Proc. Adv. Neural Inf. Process. Syst., 2003, pp. 1587-1594.
21. Y. HaCohen, R. Fattal, and D. Lischinski, "Image upsampling via texture hallucination," in Proc. IEEE Int. Conf. Comput. Photography, Mar. 2010, pp. 1-8.
22. D. J. Field, "Relations between the statistics of natural images and the response profiles of cortical cells," J. Opt. Soc. Amer., vol. 4, no. 12, pp. 2379-2394, 1987.
23. M. Zontak and M. Irani, "Internal statistics of a single natural image," in Proc. IEEE Conf. Comput. Vis. Patern Recognit., Jun. 2011, pp. 977- 984.
24. Y. Weiss and W.T. Freeman, "What makes a good model of natural images?" in Proc. IEEE Conf. Comput. Vis. Patern Recognit., Jun. 2007, pp. 1-8.
25. S. Roth and M. J. Black, "Fields of experts," Int. J. Comput. Vis., vol. 82, no. 2, pp. 205-229, 2009.
26. R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, and W. T. Freeman, "Removing camera shake from a single photograph," ACM Trans. Graph. (SIGGRAPH), vol. 25, pp. 787-794, Aug. 2006. (Pubitemid 44481040)
27. S. Osher, M. Burger, and D. Goldfarb, "An iterative regularization method for total variation-based image restoration," Multiscale Model. Simul., vol. 4, no. 2, pp. 460-489, 2005. (Pubitemid 43885248)
28. D. Krishnan and R. Fergus, "Fast image deconvolution using hyperlaplacian priors," in Proc. Adv. Neural Inf. Process. Syst., 2009, pp. 1033-1041.
29. G. E. Hinton, "Training products of experts by minimizing contrastive divergence," Neural Comput., vol. 14, no. 8, pp. 1771-1800, 2002.
30. T. S. Cho, C. L. Zitnick, N. Joshi, S. B. Kang, R. Szeliski, and W. T. Freeman, "Image restoration by matching gradient distributions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 683-694, Apr. 2012.
31. S. Lyu, "Interpretation and generalization of score matching," in Proc. 25th Conf. Annu. Conf. Uncertainty Artif. Intell., 2009, pp. 359-366.
32. U. Schmidt, Q. Gao, and S. Roth, "A generative perspective on MRFs in low-level vision," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 1751-1758.
33. J. Miskin and D. J. C. Mackay, "Ensemble learning for blind image separation and deconvolution," in Advances in Independent Component Analysis, M. Girolami, Ed. New York: Springer-Verlag, 2000.
34. L. He, H. Chen, and L. Carin, "Tree-structured compressive sensing with variational Bayesian analysis," IEEE Signal Process. Lett., vol. 17, no. 3, pp. 233-236, Mar. 2010.
35. E. Levi, "Using natural image priors-maximizing or sampling?" M.S. thesis, School Comput. Sci. Eng., Hebrew Univ. Jerusalem, Jerusalem, Israel, 2009.
36. G. Papandreou and A. Yuille, "Gaussian sampling by local perturbations," in Proc. Adv. Neural Inf. Process. Syst., 2010, pp. 1858-1866.
37. G. Papandreou and A. Yuille, "Perturb-and-map random fields: Using discrete optimization to learn and sample from energy models," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 193-200.
38. F. Orieux, O. Féron, and J.-F. Giovannelli, "Efficient sampling of high-dimensional Gaussian fields: The non-stationary/non-sparse case," CoRR, vol. abs/1105.5887, 2011.
39. U. Schmidt, K. Schelten, and S. Roth, "Bayesian deblurring with integrated noise estimation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 2625-2632.
40. D. Martin, C. Fowlkes, D. Tal, and J. Malik, "A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics," in Proc. IEEE Int. Conf. Comput. Vis., vol. 2. Jul. 2001, pp. 416-423. (Pubitemid 32795086)
41. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.