A statistical prediction model based on sparse representations for single image super-resolution

IEEE Transactions on Image Processing

Volumn 23, Issue 6, 2014, Pages 2569-2582

  Peleg, Tomer ^a   Elad, Michael ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Dictionary learning; feedforward neural networks; MMSE estimation; nonlinear prediction; restricted Boltzmann machine; single image super resolution; sparse representations; statistical models; zooming deblurring

Indexed keywords

CLUSTERING ALGORITHMS; COMPUTATIONAL COMPLEXITY; FEEDFORWARD NEURAL NETWORKS;

DEBLURRING; DICTIONARY LEARNING; MMSE ESTIMATION; NON-LINEAR PREDICTIONS; RESTRICTED BOLTZMANN MACHINE; SINGLE IMAGES; SPARSE REPRESENTATION;

OPTICAL RESOLVING POWER;

EID: 84901060118     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2305844     Document Type: Article

References (37)

1. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
2. S. Farisu, D. Robinson, M. Elad, and P. Milanfar, "Advances and challenges in super-resolution," Int. J. Imag. Syst. Technol., vol. 14, no. 2, pp. 47-57, 2004.
3. X. Zhang and X. Wu, "Image interpolation by adaptive 2D autoregressive modeling and soft-decision estimation," IEEE Trans. Image Process., vol. 17, no. 6, pp. 887-896, Jun. 2008. (Pubitemid 351780121)
4. J. Sun, Z. Xu, and H. Shum, "Image super-resolution using gradient profile prior," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
5. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
6. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. IEEE 12th Int. Conf. Comput. Vis., Oct. 2009, pp. 349-356.
7. G. Freedman and R. Fattal, "Image and video upscaling from local selfexamples," ACM Trans. Graph., vol. 30, no. 2, p. 12, 2011.
8. S. Mallat and G. Yu, "Super-resolution with sparse mixing estimators," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2889-2900, Nov. 2010.
9. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
10. R. Zeyde, M. Elad, and M. Protter, "On single image scale-up using sparse-representations," in Proc. 7th Int. Conf. Curves Surf., 2010, pp. 711-730.
11. A. Adler, Y. Hel-Or, and M. Elad, "A shrinkage learning approach for single image super-resolution with overcomplete representations," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 622-635.
12. W. Dong, L. Zhang, G. Shi, and X. Wu, "Image deblurring and super-resolution by adaptive sparse domain selection and adaptive regularization," IEEE Trans. Image Process., vol. 20, no. 7, pp. 1838-1857, Jul. 2011.
13. X. Gao, K. Zhang, D. Tao, and X. Li, "Joint learning for single-image super-resolution via a coupled constraint," IEEE Trans. Image Process., vol. 21, no. 2, pp. 469-480, Feb. 2012.
14. G. Yu, G. Sapiro, and S. Mallat, "Solving inverse problems with piecewise linear estimators: From Gaussian mixture models to structured sparsity," IEEE Trans. Image Process., vol. 21, no. 5, pp. 2481-2499, May 2012.
15. J. Yang, Z. Wang, Z. Lin, S. Cohen, and T. Huang, "Coupled dictionary training for image super-resolution," IEEE Trans. Image Process., vol. 21, no. 8, pp. 3467-3478, Aug. 2012.
16. K. Zhang, X. Gao, D. Tao, and X. Li, "Single image super-resolution with non-local means and steering kernel regression," IEEE Trans. Image Process., vol. 21, no. 11, pp. 4544-4556, Nov. 2012.
17. S. Wang, L. Zhang, Y. Liang, and Q. Pan, "Semi-coupled dictionary learning with applications to image super-resolution and photosketch synthesis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2216-2223.
18. K. Zhang, X. Gao, D. Tao, and X. Li, "Multi-scale dictionary for single image super-resolution," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1114-1121.
19. K. Jia, X. Wang, and X. Tang, "Image transformation based on learning dictionaries across image spaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 2, pp. 367-380, Feb. 2013.
20. S. Hawe, M. Kleinsteuber, and K. Diepold, "Analysis operator learning and its application to image reconstruction," IEEE Trans. Image Process., vol. 22, no. 6, pp. 2138-2150, Mar. 2013.
21. W. Dong, L. Zhang, G. Shi, and X. Li, "Sparse representation based image interpolation with nonlocal autoregressive modeling," IEEE Trans. Image Process., vol. 22, no. 4, pp. 1382-1394, Apr. 2013.
22. W. Dong, L. Zhang, R. Lukac, and G. Shi, "Nonlocal centralized sparse representation for image restoration," IEEE Trans. Image Process., vol. 22, no. 4, pp. 1620-1630, Apr. 2013.
23. L. He, H. Qi, and R. Zaretzki, "Beta process joint dictionary learning for coupled feature spaces with application to single image superresolution," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 345-352.
24. J. Yang, Z. Lin, and S. Cohen, "Fast image super-resolution based on in-place example regression," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 1059-1066.
25. A. M. Bruckstein, D. L. Donoho, and M. Elad, "From sparse solutions of systems of equations to sparse modeling of signals and images," SIAM Rev., vol. 51, no. 1, pp. 34-81, 2009.
26. Y. Le Cun and Y. Bengio, "Convolutional networks for images, speech and time series," in The Handbook of Brain Theory and Neural Networks, M. A. Arbib, Ed. Cambridge, MA, USA: MIT Press, 1995, pp. 255-258.
27. P. J. Wolfe, S. J. Godsill, and W. J. Ng, "Bayesian variable selection and regularization for time-frequency surface estimation," J. R. Statist. Soc. B, vol. 66, no. 3, pp. 575-589, 2004. (Pubitemid 39015902)
28. P. J. Garrigues and B. A. Olshausen, "Learning horizontal connections in a sparse coding model of natural images," in Proc. Adv. NIPS, 2008, pp. 505-512.
29. V. Cevher, M. F. Duarte, C. Hedge, and R. G. Baraniuk, "Sparse signal recovery using Markov random fields," in Proc. Adv. NIPS, 2009, pp. 257-264.
30. T. Peleg, Y. C. Eldar, and M. Elad, "Exploiting statistical dependencies in sparse representations for signal recovery," IEEE Trans. Signal Process., vol. 60, no. 5, pp. 2286-2303, May 2012.
31. P. Smolensky, Information Processing in Dynamical Systems: Foundations of Harmony Theory. Cambridge, MA, USA: MIT Press, 1986.
32. G. E. Hinton and R. R. Salakhutdinov, "Reducing the dimensionality of data with neural networks," Science, vol. 313, no. 5786, pp. 504-507, 2006. (Pubitemid 44148451)
33. G. E. Hinton, S. Osindero, and Y. Teh, "A fast learning algorithm for deep belief nets," Neural Comput., vol. 18, no. 7, pp. 1527-1554, 2006. (Pubitemid 44024729)
34. M. Elad and I. Yavneh, "A plurality of sparse representations is better than the sparsest one alone," IEEE Trans. Inf. Theory, vol. 55, no. 10, pp. 4701-4714, Oct. 2009.
35. M. Aharon, M. Elad, and A. M. Bruckstein, "K-SVD: An algorithm for designing overcomplete dictionaries for sparse representation," IEEE Trans. Signal Process., vol. 54, no. 11, pp. 4311-4322, Nov. 2006. (Pubitemid 44637761)
36. Y. C. Pati, R. Rezaiifar, and P. S. Krishnaprasad, "Orthogonal matching pursuit: Recursive function approximation with applications to wavelet decomposition," in Proc. 27th Asilomar Conf. Signals, Systems, Comput., 1993, pp. 40-44.
37. H. C. Burger, C. J. Schuler, and S. Harmeling, "Image denoising: Can plain neural networks compete with BM3D?" in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 4321-4328.