Face super-resolution via multilayer locality-constrained iterative neighbor embedding and intermediate dictionary learning

IEEE Transactions on Image Processing

Volumn 23, Issue 10, 2014, Pages 4220-4231

  Jiang, Junjun ^a   Hu, Ruimin ^a   Wang, Zhongyuan ^a   Han, Zhen ^a  

^a WUHAN UNIVERSITY   (China)

Author keywords

dictionary learning; face hallucination; Face super resolution; manifold learning; neighbor embedding

Indexed keywords

GEOMETRY; MULTILAYERS; OPTICAL RESOLVING POWER;

DICTIONARY LEARNING; FACE HALLUCINATION; FACE SUPER-RESOLUTION; MANIFOLD LEARNING; NEIGHBOR EMBEDDING;

ITERATIVE METHODS;

EID: 84906860902     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2347201     Document Type: Article

References (43)

1. W. W. W. Zou and P. C. Yuen, "Very low resolution face recognition problem, " IEEE Trans. Image Process., vol. 21, no. 1, pp. 327-340, Jan. 2012.
2. S. Baker and T. Kanade, "Limits on super-resolution and how to break them, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002.
3. Z. Lin and H.-Y. Shum, " Fundamental limits of reconstruction-based superresolution algorithms under local translation," IEEE Trans. Pattern Anal. Mach. Intell., vol. 26, no. 1, pp. 83-97, Jan. 2004.
4. S. Baker and T. Kanade, "Hallucinating faces, " in Proc. 4th IEEE Int. Conf. Autom. Face Gesture Recogni t., Mar. 2000, pp. 83-88.
5. C. Liu, H.-Y. Shum, and C.-S. Zhang, " A two-step approach to hallucinating faces: Global parametric model and local nonparametric model," in Proc. IEEE Comput. Soc. Conf. CVPR, vol. 1. Dec. 2001, pp. I192-I198.
6. K. Jia and S. Gong, "Generalized face super-resolution, " IEEE Trans. Image Process., vol. 17, no. 6, pp. 873-886, Jun. 2008.
7. N. Wang, D. Tao, X. Gao, X. Li, and J. Li, " A comprehensive survey to face hallucination," Int. J. Comput. Vis., vol. 106, no. 1, pp. 1-22, 2013.
8. X. Wang and X. Tang, "Hallucinating face by eigentransformation, " IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 3, pp. 425-434, Aug. 2005.
9. A. Chakrabarti, A. N. Rajagopalan, and R. Chellappa, " Super-resolution of face images using kernel PCA-based prior," IEEE Trans. Multimedia, vol. 9, no. 4, pp. 888-892, Jun. 2007.
10. J.-S. Park and S.-W. Lee, " An example-based face hallucination method for single-frame, low-resolution facial images," IEEE Trans. Image Process., vol. 17, no. 10, pp. 1806-1816, Oct. 2008.
11. X. Zhang, S. Peng, and J. Jiang, "An adaptive learning method for face hallucination using locality preserving projections, " in Proc. 8th IEEE Int. Conf. Autom. Face Gesture Recognit., Sep. 2008, pp. 1-8.
12. J. Yang, J. Wright, T. S. Huang, and Y. Ma, "Image super-resolution via sparse representation, " IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
13. H. Huang, H. He, X. Fan, and J. Zhang, "Super-resolution of human face image using canonical correlation analysis, " Pattern Recognit., vol. 43, no. 7, pp. 2532-2543, Jul. 2010.
14. H. Chang, D.-Y. Yeung, and Y. Xiong, " Super-resolution through neighbor embedding," in Proc. IEEE Comput. Soc. Conf. CVPR, vol. 1. Jun./Jul. 2004, pp. 275-282.
15. B. Li, H. Chang, S. Shan, and X. Chen, "Aligning coupled manifolds for face hallucination, " IEEE Signal Process. Lett., vol. 16, no. 11, pp. 957-960, Nov. 2009.
16. X. Ma, J. Zhang, and C. Qi, "Hallucinating face by position-patch, " Pattern Recognit., vol. 43, no. 6, pp. 2224-2236, 2010.
17. C. Jung, L. Jiao, B. Liu, and M. Gong, " Position-patch based face hallucination using convex optimization," IEEE Signal Process. Lett., vol. 18, no. 6, pp. 367-370, Jun. 2011.
18. Y. Hu, K.-M. Lam, G. Qiu, and T. Shen, " From local pixel structure to global image super-resolution: A new face hallucination framework," IEEE Trans. Image Process., vol. 20, no. 2, pp. 433-445, Feb. 2011.
19. W. Zhang and W.-K. Cham, "Hallucinating face in the DCT domain, " IEEE Trans. Image Process., vol. 20, no. 10, pp. 2769-2779, Oct. 2011.
20. J. Jiang, R. Hu, Z. Han, T. Lu, and K. Huang, " Position-patch based face hallucination via locality-constrained representation," in Proc. IEEE ICME, Jul. 2012, pp. 212-217.
21. J. Jiang, R. Hu, Z. Wang, and Z. Han, "Noise robust face hallucination via locality-constrained representation," IEEE Trans. Multimedia, vol. 16, no. 5, pp. 1268-1281, Aug. 2014.
22. J. Jiang, R. Hu, Z. Han, Z. Wang, T. Lu, and J. Chen, " Localityconstraint iterative neighbor embedding for face hallucination," in Proc. IEEE ICME, Jul. 2013, pp. 1-6.
23. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 5500, pp. 2323-2326, Dec. 2000.
24. X. Ma, H. Q. Luong, W. Philips, H. Song, and H. Cui, " Sparse representation and position prior based face hallucination upon classified over-complete dictionaries," Signal Process., vol. 92, no. 9, pp. 2066-2074, Sep. 2012.
25. K. Yu, T. Zhang, and Y. Gong, "Nonlinear learning using local coordinate coding, " in Advances in Neural Information Processing Systems. Red Hook, NY, USA: Curran Associates, Inc., 2009, pp. 2223-2231.
26. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, " Localityconstrained linear coding for image classification," in Proc. IEEE Conf. CVPR, Jun. 2010, pp. 3360-3367.
27. K. Su, Q. Tian, Q. Xue, N. Sebe, and J. Ma, " Neighborhood issue in single-frame image super-resolution," in Proc. IEEE ICME, Jul. 2005, pp. 1122-1125.
28. W. T. Freeman, E. C. Pasztor, and O. T. Carmichael, "Learning low-level vision, " Int. J. Comput. Vis., vol. 40, no. 1, pp. 25-47, Oct. 2000.
29. M. Bevilacqua, A. Roumy, C. Guillemot, and M. Alberi, " Lowcomplexity single-image super-resolution based on nonnegative neighbor embedding," in Proc. BMVC, 2012, pp. 1-10.
30. X. Gao, K. Zhang, D. Tao, and X. Li, "Image super-resolution with sparse neighbor embedding, " IEEE Trans. Image Process., vol. 21, no. 7, pp. 3194-3205, Jul. 2012.
31. W. Gao et al., " The CAS-PEAL large-scale chinese face database and baseline evaluations," IEEE Trans. Syst., Man, Cybern. A, Syst., Humans, vol. 38, no. 1, pp. 149-161, Jan. 2008.
32. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, " Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
33. P. P. Gajjar and M. V. Joshi, "New learning based super-resolution: Use of D WT and IGMRF prior," IEEE Trans. Image Process., vol. 19, no. 5, pp. 1201-1213, May 2010.
34. M. Everingham, J. Sivic, and A. Zisserman, "Hello! my name is. . . Buffy-Automatic naming o f characters in TV video," in Proc. BMVC, 2006, pp. 899-908.
35. K. Zhang, X. Gao, D. Tao, and X. Li, "Single image super-resolution with multiscale similarity learning, " IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 10, pp. 1648-1659, Oct. 2013.
36. M.F. Tappen,C. Liu, A Bayesian approach to alignment-based image hallucination, Proc. 12th ECCV 7578, Oct. 2012, 236-249.
37. C.-Y. Yang, S. Liu, and M.-H. Yang, "Structured face hallucination, " in Proc. IEEE Conf. CVPR, Jun. 2013, pp. 1099-1106.
38. K. Nasrollahi and T. B. Moeslund, "Extracting a good quality frontal face image from a low-resolution video sequence, " IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 10, pp. 1353-1362, Oct. 2011.
39. P. H. Hennings-Yeomans, S. Baker, and B. V. K. V. Kumar, " Simultaneous super-resolution and feature extraction for recognition of lowresolution faces," in Proc. IEEE Conf. CVPR, Jun. 2008, pp. 1-8.
40. W. W. W. Zou and P. C. Yuen, "Very low resolution face recognition problem, " IEEE Trans. Image Process., vol. 21, no. 1, pp. 327-340, Jan. 2012.
41. Y. Liang, X. Xie, and J.-H. Lai, "Face hallucination based on morphological component analysis, " Signal Process., vol. 93, no. 2, pp. 445-458, Feb. 2013.
42. J. Jiang, R. Hu, Z. Han, Z.Wang, and J. Chen, " Two-step superresolution approach for surveillance face image through radial basis function-partial least squares regression and locality-induced sparse representation, " J. Electron. Imag., vol. 22, no. 4, p. 041120, Oct. 2013.
43. T. Kurita, N. Otsu, and T. Sato, " A face recognition method using higher order local autocorrelation and multivariate analysis," in Proc. Int. Conf. Pattern Recognit., Aug./Sep. 1992, pp. 213-216.