Viewing-distance aware super-resolution for high-definition display

IEEE Transactions on Image Processing

Volumn 24, Issue 1, 2015, Pages 403-418

  Shen, Chih Tsung ^a,b   Liu, Hung Hsun ^c   Yang, Ming Hsuan ^d   Hung, Yi Ping ^a,b   Pei, Soo Chang ^a  

^a NATIONAL TAIWAN UNIVERSITY   (Taiwan)

^b INSTITUTE OF INFORMATION SCIENCE   (Taiwan)

^c CHUNGHWA TELECOM CO LTD   (Taiwan)

^d University of California   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ALGORITHMS; IMAGE DENOISING; OPTICAL RESOLVING POWER;

HIGH RESOLUTION IMAGE; INTERPOLATED IMAGES; LOW RESOLUTION IMAGES; RECONSTRUCTION ERROR; STATE-OF-THE-ART METHODS; SUPER RESOLUTION ALGORITHMS; TOTAL VARIATION REGULARIZATION; VISUAL PERCEPTION;

IMAGE ENHANCEMENT;

ALGORITHM; ANIMAL; HUMAN; IMAGE PROCESSING; PHOTOGRAPHY; PROCEDURES; VISION;

ALGORITHMS; ANIMALS; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; PHOTOGRAPHY; VISUAL PERCEPTION;

EID: 84919904357     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2375639     Document Type: Article

References (57)

1. M. A. Webster, M. A. Georgeson, and S. M. Webster, "Neural adjustments to image blur," Natural Neurosci., vol. 5, no. 9, pp. 839-840, 2002.
2. M. Trentacoste, R. Mantiuk, and W. Heidrich, "Blur-aware image downsampling," Comput. Graph. Forum, vol. 30, no. 2, pp. 573-582, 2011.
3. V. F. Pamplona, M. M. Oliveira, D. G. Aliaga, and R. Raskar, "Tailored displays to compensate for visual aberrations," ACM Trans. Graph., vol. 31, no. 4, 2012, Art. ID 81.
4. J. Kopf, A. Shamir, and P. Peers, "Content-adaptive image downscaling," ACM Trans. Graph., vol. 32, no. 6, 2013, Art. ID 173.
5. P. Milanfar, Super-Resolution Imaging. Boca Raton, FL, USA: CRC Press, 2011.
6. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multiframe super resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
7. Y. Wang, W. Yin, J. Yang, and Y Zhan, "A new alternating minimization algorithm for total variation image reconstruction," SIAM J. Imag. Sci., vol. 1, no. 3, pp. 248-272, 2008.
8. W Yin, S. Osher, D. Goldfarb, and J. Darbon, "Bregman iterative algorithms for 11-minimization with applications to compressed sensing," SIAM J. Imag. Sci., vol. 1, no. 1, pp. 143-168, 2008.
9. Q. Shan, Z. Li, J. Jia, and C.-K. Tang, "Fast image/video upsampling," ACM Trans. Graph., vol. 27, no. 5, 2008, Art. ID 153.
10. Q. Shan, J. Jia, and A. Agarwala, "High-quality motion deblurring from a single image," ACM Trans. Graph., vol. 27, no. 3, 2008, Art. ID 73.
11. M. Zibulevsky and M. Elad, "L1-L2 optimization in signal and image processing," IEEE Signal Process. Mag., vol. 27, no. 3, pp. 76-88, May 2010.
12. L. Xu and J. Jia, "Two-phase kernel estimation for robust motion deblurring," in Proc. 11th Eur. Conf. Comput. Vis., 2010, pp. 157-170.
13. r-TV framework for color image restoration," Int. J. Comput. Vis., vol. 92, no. 3, pp. 296-307, 2011.
14. S. H. Chan, R. Khoshabeh, K. B. Gibson, P. E. Gill, and T. Q. Nguyen, "An augmented Lagrangian method for total variation video restoration," IEEE Trans. Image Process., vol. 20, no. 11, pp. 3097-3111, Nov. 2011.
15. R.-Y. Tsai and T.-S. Huang, "Multiframe image restoration and registration," Adv. Comput. Vis. Image Process., vol. 1, no. 2, pp. 317-339, 1984.
16. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
17. D. Capel and A. Zisserman, "Computer vision applied to super resolution," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 75-86, May 2003.
18. B. Bascle, A. Blake, and A. Zisserman, "Motion deblurring and super-resolution from an image sequence," in Proc. 4th Eur. Conf. Comput. Vis., 1996, pp. 571-582.
19. M.-S. Lee, M.-Y. Shen, C.-C. J. Kuo, and A. Yoneyama, "Techniques for flexible image/video resolution conversion with heterogeneous terminals," IEEE Commun. Mag., vol. 45, no. 1, pp. 61-67, Jan. 2007.
20. C. Liu and D. Sun, "On Bayesian adaptive video super resolution," IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 2, pp. 346-360, Feb. 2014.
21. C. Lee, M. Eden, and M. Unser, "High-quality image resizing using oblique projection operators," IEEE Trans. Image Process., vol. 7, no. 5, pp. 679-692, May 1998.
22. X. Li and M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001.
23. A. Giachetti and N. Asuni, "Real-time artifact-free image upscaling," IEEE Trans. Image Process., vol. 20, no. 10, pp. 2760-2768, Oct. 2011.
24. K.-W. Hung and W.-C. Siu, "Robust soft-decision interpolation using weighted least squares," IEEE Trans. Image Process., vol. 21, no. 3, pp. 1061-1069, Mar. 2012.
25. R. Fattal, "Image upsampling via imposed edge statistics," ACM Trans. Graph., vol. 26, no. 3, 2007, Art. ID 95.
26. J. Sun, J. Sun, Z. Xu, and H.-Y. Shum, "Image super-resolution using gradient profile prior," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
27. S. Mallat and G. Yu, "Super-resolution with sparse mixing estimators," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2889-2900, Nov. 2010.
28. W. T. Freeman, E. C. Pasztor, and O. T. Carmichael, "Learning low-level vision," Int. J. Comput. Vis., vol. 40, no. 1, pp. 25-47, 2000.
29. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based superresolution," IEEE Comput. Graph. Appl., vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002.
30. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002.
31. Y. HaCohen, R. Fattal, and D. Lischinski, "Image upsampling via texture hallucination," in Proc. IEEE Int. Conf. Comput. Photograph., Mar. 2010, pp. 1-8.
32. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
33. K. Zhang, X. Gao, D. Tao, and X. Li, "Multi-scale dictionary for single image super-resolution," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 1114-1121.
34. S. Wang, D. Zhang, Y. Liang, and Q. Pan, "Semi-coupled dictionary learning with applications to image super-resolution and photosketch synthesis," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2012, pp. 2216-2223.
35. W. Dong, L. Zhang, G. Shi, and X. Li, "Nonlocally centralized sparse representation for image restoration," IEEE Trans. Image Process., vol. 22, no. 4, pp. 1620-1630, Apr. 2013.
36. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. Int. Conf. Comput. Vis., 2009, pp. 349-356.
37. G. Freedman and R. Fattal, "Image and video upscaling from local self-examples," ACM Trans. Graph., vol. 30, no. 2, pp. 1-10, 2011.
38. K. I. Kim and Y. Kwon, "Single-image super-resolution using sparse regression and natural image prior," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 1127-1133, Jun. 2010.
39. P. Green, W. Sun, W. Matusik, and F. Durand, "Multi-aperture photography," ACM Trans. Graph., vol. 26, no. 3, 2007, Art. ID 68.
40. D. A. Forsyth and J. Ponce, Computer Vision: A Modern Approach. Upper Saddle River, NJ, USA: Prentice-Hall, 2011.
41. C.-T. Shen, H.-H. Liu, M.-S. Lee, Y.-P. Hung, and S.-C. Pei, "Spatially-varying super-resolution for HDTV," in Proc. IEEE Int. Symp. Circuits Syst., May 2013, pp. 1195-1198.
42. S. Bae and F. Durand, "Defocus magnification," Comput. Graph. Forum, vol. 26, no. 3, pp. 571-579, 2007.
43. N. Joshi, R. Szeliski, and D. Kriegman, "PSF estimation using sharp edge prediction," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
44. Y.-W. Tai and M. S. Brown, "Single image defocus map estimation using local contrast prior," in Proc. 16th IEEE Int. Conf. Image Process., Nov. 2009, pp. 1797-1800.
45. S. Zhuo and T. Sim, "Defocus map estimation from a single image," Pattern Recognit., vol. 44, no. 9, pp. 1852-1858, 2011.
46. K. He, J. Sun, and X. Tang, "Guided image filtering," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 6, pp. 1397-1409, Jun. 2013.
47. C.-T. Shen, F.-J. Chang, Y.-P. Hung, and S.-C. Pei, "Edge-preserving image decomposition using L1 fidelity with L0 gradient," in Proc. SIGGRAPH Asia Tech. Briefs, 2012, Art. ID 6.
48. T. F. Chan and C.-K. Wong, "Total variation blind deconvolution," IEEE Trans. Image Process., vol. 7, no. 3, pp. 370-375, Mar. 1998.
49. T. S. Cho, C. L. Zitnick, N. Joshi, S. B. Kang, R. Szeliski, and W. T. Freeman, "Image restoration by matching gradient distributions," IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 4, pp. 683-694, Apr. 2012.
50. Y.-N. Liu, Y.-C. Lin, Y.-L. Huang, and S.-Y. Chien, "Algorithm and architecture design of high-quality video upscaling using database-free texture synthesis," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 7, pp. 1221-1234, Jul. 2014.
51. A. Mittal, A. K. Moorthy, and A. C. Bovik, "No-reference image quality assessment in the spatial domain," IEEE Trans. Image Process., vol. 21, no. 12, pp. 4695-4708, Dec. 2012.
52. Q. Shan, J. Jia, and A. Agarwala, "High-quality motion deblurring from a single image," ACM Trans. Graph., vol. 27, no. 3, 2008, Art. ID 73.
53. H. Takeda, S. Farsiu, and P. Milanfar, "Deblurring using regularized locally adaptive kernel regression," IEEE Trans. Image Process., vol. 17, no. 4, pp. 550-563, Apr. 2008.
54. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Image and video restorations via nonlocal kernel regression," IEEE Trans. Cybern., vol. 43, no. 3, pp. 1035-1046, Jun. 2013.
55. O. Whyte, J. Sivic, A. Zisserman, and J. Ponce, "Non-uniform deblurring for shaken images," Int. J. Comput. Vis., vol. 98, no. 2, pp. 168-186, 2012.
56. D. Krishnan, T. Tay, and R. Fergus, "Blind deconvolution using a normalized sparsity measure," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 233-240.
57. L. Yuan, J. Sun, L. Quan, and H.-Y. Shum, "Image deblurring with blurred/noisy image pairs," ACM Trans. Graph., vol. 26, no. 3, 2007, Art. ID 1.