Joint learning for single-image super-resolution via a coupled constraint

IEEE Transactions on Image Processing

Volumn 21, Issue 2, 2012, Pages 469-480

  Gao, Xinbo ^a   Zhang, Kaibing ^a   Tao, Dacheng ^b   Li, Xuelong ^c  

^a XIDIAN UNIVERSITY   (China)

^b UNIVERSITY OF TECHNOLOGY SYDNEY   (Australia)

^c XI AN INSTITUTE OF OPTICS AND PRECISION MECHANICS   (China)

Author keywords

Grouping patch pairs (GPPs); joint learning; neighbor embedding (NE); super resolution (SR)

Indexed keywords

COUPLED CONSTRAINTS; FEATURE SPACE; FEATURE SUBSPACE; GROUPING PATCH PAIRS (GPPS); HIGH RESOLUTION; IMAGE PATCHES; JOINT LEARNING; K-NEAREST NEIGHBORS; LEARNING TECHNIQUES; MAXIMUM A POSTERIORI; NEIGHBOR EMBEDDING (NE); NUMBER OF SAMPLES; ONE-TO-MANY MAPPING; PROJECTION MATRIX; SUPERRESOLUTION;

ALGORITHMS; FEATURE EXTRACTION; IMAGE RECONSTRUCTION; OPTICAL RESOLVING POWER;

PROBABILISTIC LOGICS;

EID: 84863011854     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2011.2161482     Document Type: Article

References (44)

1. S. Park, M. Park, and M. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, May 2003.
2. X. Li and M. T. Orchard, "New edge-directed interpolation," IEEE Trans. Image Process., vol. 10, no. 10, pp. 1521-1527, Oct. 2001. (Pubitemid 32981825)
3. N. A. Dodgson, "Quadratic interpolation for image resampling," IEEE Trans. Image Process., vol. 6, no. 9, pp. 1322-1326, Sep. 1997. (Pubitemid 127776973)
4. L. Zhang and X. Wu, "An edge-guided image interpolation algorithm via directional filtering and data fusion," IEEE Trans. Image Process., vol. 15, no. 8, pp. 2226-2238, Aug. 2006. (Pubitemid 44089097)
5. K. S. Ni and T. Q. Nguyen, "An adaptable fc-nearest neighbors algorithm for MMSE image interpolation," IEEE Trans. Image Process., vol. 18, no. 9, pp. 1976-1987, Sep. 2009.
6. T. S. Huang and R. Y. Tsai, "Multi-frame image restoration and registration," Adv. Comput. Vis. Image Process., vol. 1, no. 2, pp. 317-339, 1984.
7. S. P. Kim, N. K. Bose, and H. M. Valenzuela, "Recursive reconstruction of high resolution image from noisy undersampled multiframes," IEEE Trans. Acoust., Speech, Signal Process., vol. 38, no. 6, pp. 1013-1027, Jun. 1990. (Pubitemid 20713538)
8. S. P. Kim and W. Y. Su, "Recursive high-resolution reconstruction of blurred multiframe images," IEEE Trans. Image Process., vol. 2, no. 4, pp. 534-539, Oct. 1993.
9. M. C. Hong, M. G. Kang, and A. K. Katsaggelos, "A regularized multichannel restoration approach for globally optimal high resolution video sequence," in Proc. SPIE VCIP, San Jose, CA, Feb. 1997, vol. 3024, pp. 1306-1317.
10. S. Farsiu, M. D. Robinson, M. Elad, and P. Milanfar, "Fast and robust multi-frame super resolution," IEEE Trans. Image Process., vol. 13, no. 10, pp. 1327-1344, Oct. 2004.
11. X. Li, X. Gao, Y. Hu, D. Tao, and B. Ning, "A multi-frame image super-resolution method," Signal Process., vol. 90, no. 2, pp. 405-414, Feb. 2010.
12. H. Stark and P. Oskoui, "High-resolution image recovery from image plane arrays, using convex projections," J. Opt. Soc. Amer. A, Opt. Image Sci., Vis., vol. 6, no. 11, pp. 1715-1726, Nov. 1989.
13. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP, Graph. Models Image Process., vol. 53, no. 3, pp. 231-239, May 1991. (Pubitemid 21651453)
14. M. Elad and A. Feuer, "Superresolution restoration of an image sequence: Adaptive filtering approach," IEEE Trans. Image Process., vol. 8, no. 3, pp. 387-395, Mar. 1999.
15. M. Protter and M. Elad, "Super resolution with probabilistic motion estimation," IEEE Trans. Image Process., vol. 18, no.8, pp. 1899-1904, Aug. 2009.
16. H. Takeda, P. Milanfar, M. Protter, and M. Elad, "Super-resolution without explicit subpixel motion estimation," IEEE Trans. Image Process., vol. 18, no. 9, pp. 1958-1975, Sep. 2009.
17. X. Gao, Q. Wang, X. Li, D. Tao, and K. Zhang, "Zernike-moment-based image super resolution," IEEE Trans. Image Process., vol. 20, no. 10, Oct. 2011.
18. H. Zhang, J. Yang, Y. Zhang, and T. S. Huang, "Non-local kernel regression for image and video restoration," in Proc. Eur. Conf. Comput. Vis., 2010, pp. 566-579.
19. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002. (Pubitemid 35242579)
20. W. T. Freeman, T. R. Jones, and E. C. Pasztor, "Example-based super-resolution," IEEE Comput. Graph. Appl., vol. 22, no. 2, pp. 56-65, Mar./Apr. 2002. (Pubitemid 34265891)
21. H. Chang, D.-Y. Yeung, and Y. Xiong, "Super-resolution through neighbor embedding," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jul. 2004, pp. 275-282.
22. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
23. T.-M. Chan and J. Zhang, "An improved super-resolution with manifold learning and histogram matching," in Proc. IAPR Int. Conf. Bio-metric, 2006, pp. 756-762. (Pubitemid 43856443)
24. T.-M. Chan, J. Zhang, J. Pu, and H. Huang, "Neighbor embedding based super-resolution algorithm through edge detection and feature selection," Pattern Recognit. Lett., vol. 30, no. 5, pp. 494-502, Apr. 2009.
25. W. Fan and D. Y. Yeung, "Image hallucination using neighbor embedding over visual primitive manifolds," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2007, pp. 1-7.
26. B. Li, H. Chang, S. Shan, and X. Chen, "Locality preserving constraints for super resolution with neighbor embedding," in Proc. IEEE Int. Conf. Image Process., Nov. 2009, pp. 1189-1192.
27. K. Zhang, X. Gao, X. Li, and D. Tao, "Partially supervised neighbor embedding for example-based image super-resolution," IEEE J. Sel. Topics Signal Process., vol. 5, no. 2, pp. 230-239, Apr. 2011.
28. T. Zhou, D. Tao, and X. Wu, "Manifold elastic net: A unified framework for sparse dimension reduction," Data Mining Knowl. Discov., vol. 22, no. 3, pp. 340-371, May 2011.
29. D. Tao, X. Li, X. Wu, and S. J. Maybank, "Geometric mean for sub-space selection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 2, pp. 260-274, Feb. 2009.
30. W. Bian and D. Tao, "Biased discriminant Euclidean embedding for content based image retrieval," IEEE Trans. Image Process., vol. 19, no. 2, pp. 545-554, Feb. 2010.
31. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution as sparse representation of raw image patches," in Proc. IEEE Conf. Comput. Vis. Pattern Recog., Jun. 2008, pp. 1-8.
32. J. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
33. D. Glasner, S. Bagon, and M. Irani, "Super-resolution from a single image," in Proc. IEEE Int. Conf. Comput. Vis., 2009, pp. 349-356.
34. B. Li, H. Chang, S. Shan, and X. Chen, "Low-resolution face recognition via coupled local preserving mappings," IEEE Signal Process. Lett., vol. 17, no. 1, pp. 20-23, Jan. 2010.
35. J. Sun, Q. Chen, S. Yan, and L.-F. Cheong, "Selective image super-resolution," Computer Vision and Pattern Recognition 2010, arXiv: 1010. 5610v1.
36. M. Song, D. Tao, C. Chen, X. Li, and C. W. Chen, "Color to gray: Visual cue preservation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 9, pp. 1537-1552, Sep. 2010.
37. K. Su, Q. Tian, Q. Que, N. Sebe, and J. Ma, "Neighborhood issue in single-frame image super-resolution," in Proc. IEEE Int. Conf. Multimedia Expo, Jul. 2005, pp. 1122-1125. (Pubitemid 44669067)
38. W. Bian and D. Tao, "Max-min distance analysis by using sequential SDP relaxation for dimension reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 5, pp. 1037-1050, May 2011.
39. S. Si, D. Tao, and B. Geng, "Bregman divergence based regularization for transfer subspace learning," IEEE Trans. Knowl. Data Eng., vol. 22, no. 7, pp. 929-942, Jul. 2010.
40. D. Tao, X. Li, X. Wu, and S. J. Maybank, "General tensor discriminant analysis and gabor features for gait recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 10, pp. 1700-1715, Oct. 2007.
41. M. Irani and S. Peleg, "Motion analysis for image enhancement: Resolution, occlusion and transparency," J. Vis. Commun. Image Represent., vol. 4, no. 4, pp. 324-335, Dec. 1993.
42. Y.Tang, P. Yan, Y. Yuan, and X. Li, "Single-image super resolution via local learning," Int. J. Mach. Learn. Cybern., vol. 2, no. 1, pp. 15-23, Mar. 2011, DOI: 10.1007/s13042-011-0011-6.
43. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
44. X. Gao, W. Lu, D. Tao, and X. Li, "Image quality assessment based on multiscale geometric analysis," IEEE Trans. Image Process., vol. 18, no. 7, pp. 1409-1423, May 2009.