Robust framework of single-frame face superresolution across head pose, facial expression, and illumination variations

IEEE Transactions on Human-Machine Systems

Volumn 45, Issue 2, 2015, Pages 238-250

  Ma, Xiang ^a   Song, Huansheng ^a   Qian, Xueming ^b  

^a CHANG'AN UNIVERSITY   (China)

^b XI'AN JIAOTONG UNIVERSITY   (China)

Author keywords

face hallucination; Face superresolution; superresolution

Indexed keywords

FACE RECOGNITION; OPTICAL RESOLVING POWER; TARGET TRACKING;

FACE HALLUCINATION; FACE SUPER-RESOLUTION; FACIAL EXPRESSIONS; HIERARCHICAL TENSORS; ILLUMINATION VARIATION; SPARSE REPRESENTATION; STATE-OF-THE-ART METHODS; SUPER RESOLUTION;

LOADING;

EID: 85027942419     PISSN: 21682291     EISSN: None     Source Type: Journal    
DOI: 10.1109/THMS.2014.2375329     Document Type: Article

References (39)

1. X. Ma, H. Q. Luong, W. Philips, H. Song, and H. Cui, "Sparse representation and position prior based face hallucination upon classified overcomplete dictionaries," Signal Process., vol. 92, no. 9, pp. 2066-2074, 2012.
2. X. Li, Y. Hu, X. Gao, D. Tao, and B. Ning, "A multi-frame image superresolution method," Signal Process., vol. 90, pp. 405-414, 2010.
3. K. I. Kim and Y. Kown, "Single-image super-resolution using sparse regression and natural image prior," IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 6, pp. 127-1133, Jun. 2010.
4. S. Baker and T. Kanade, "Hallucinating faces," Proc. Int. Conf. Autom. Face Gesture Recognit., Grenoble, France, 2000, pp. 83-88.
5. C. Liu, H. Shum, and C. Zhang, "A two-step approach to hallucinating faces: Global parametric model and local nonparametric model," Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., 2001, pp. 192-198.
6. H. Chang, D. Y. Yeung, and Y. Xiong. "Super-resolution through neighbor embedding," Proc. IEEE Comput. Soc. Conf. Comput. Vision Pattern Recognit., Washington, DC, USA, 2004, pp. 1275-1282.
7. X.Wang and X. Tang, "Hallucinating face by eigentransformation," IEEE Trans. Syst. Man Cybernetics C, Appl. Rev., vol. 35, no. 3, pp. 425-434, Aug. 2005.
8. Y. Zhuang, J. Zhang, and F. Wu, "Hallucinating faces: LPH superresolution and neighbor reconstruction for residue compensation," Pattern Recognit., vol. 40, pp. 3178-3194, 2007.
9. X. Ma, J. P. Zhang, and C. Qi, "Hallucinating faces: Global linear modal based super-resolution and position based residue compensation," Lecture Notes in Comput. Sci., vol. 5716, pp. 835-843, 2009.
10. J. S. Park and S.W. Lee, "An example-based face hallucinationmethod for single-frame, low-resolution facial images," IEEE Trans. Image Process., vol. 17, no. 10, pp. 1806-1816, Oct. 2008.
11. H. Huang, H. T He, X. Fan, and J. P. Zhang, "Super-resolution of human face image using canonical correlation analysis," Pattern Recognit., vol. 43, no. 7, pp. 2532-2543, 2010.
12. X. Ma, J. P. Zhang, and C. Qi, "Hallucinating face by position-patch," Pattern Recognit., vol. 43, no. 6, pp. 2224-2236, 2010.
13. T. Shan, B. Lovell, and S. Chen, "Face recognition robust to head pose from one sample image," in Proc. Int. Conf. Pattern Recognit., 2006, pp. 515-518.
14. V. Blanz and T. Vetter, "Face recognition based on fitting 3d morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
15. V. Blanz and T. Vetter, "Face recognition based on frontal views generated from non-frontal images," in Proc. IEEE Int. Conf. Computer Vision Pattern Recognit., 2005, pp. 454-461.
16. C. Tian and G. L. Fan, "Multiview face recognition: From TensorFace to V-TensorFace and K-TensorFace," IEEE Trans. Syst., Man, Cybern. B, Cybern., vol. 42, no. 2, pp. 320-331, Apr. 2012.
17. M. A. O. Vasilesescu and D. Terzopoulos. "Multilinear image analysis for facial recognition," in Proc. Int. Conf. Pattern Recognit., 2002, pp. 511-514.
18. M. A. O. Vasilescu and D. Terzopoulos. "Multilinear analysis of image ensembles: TensorFaces," in Proc. Eur. Conf. Comput. Vision, 2002, pp. 447-460.
19. Y. Li and X. Y. Lin, "Face Hallucination with pose variation," in Proc. 6th IEEE Int. Conf. Autom. Face Gesture Recognit., 2004, pp. 723-728.
20. X. Chai, S. Shan, X. Chen, and W. Gao, "Locally linear regression for pose-invariant face recognition," IEEE Trans. Image Process., vol. 16, no. 7, pp. 1716-1725, Jul. 2007.
21. T. H. Fang, X. Zhao, O. Ocegueda, S. K. Shah, and I. A. Kakadiaris, "3D/4D facial expression analysis: An advanced annotated face model approach," Image Vision Comput., vol. 30, no. 10, pp. 738-749, 2012.
22. W. Gu, X. Cheng, Y. V. Venkatesh, D. Huang, and H. Lin, "Facial expression recognition using radial encoding of local Gabor features and classifier synthesis," Pattern Recognit., vol. 45, pp. 80-91, 2012.
23. P. Vageeswaran, K. Mitra, and R. Chellappa, "Blur and illumination robust face recognition via set-theoretic characterization," IEEE Trans. Image Process., vol. 22, no. 4, pp. 1362-1372, Apr. 2013.
24. K. Jia and S. G. Gong. "Multi-modal tensor face for simultaneous superresolution and recognition," in Proc. IEEE Int. Conf. Comput. Vision, 2005, pp. 1683-1690.
25. K. Jia and S. G. Gong. "Multi-modal Face image super-resolution inTensor space," in Proc. IEEE Int. Conf. Adv. Video Signal Based Surveillance, 2005, pp. 264-269.
26. K. Jia and S. G. Gong. "Generalized face super-resolution," IEEE Trans. Image Process., vol. 17, no. 6, pp. 873-886, Jun. 2008.
27. J. C. Yang, J. Wright, T. Huang, and Y. Ma, "Image super-Resolution via sparse representation," IEEE Trans. Image Process., vol. 19, no. 11, pp. 2861-2873, Nov. 2010.
28. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 22, no. 12, pp. 2323-2326, 2000.
29. H. S. Lee and D. J. Kim, "Generating frontal view face image for pose invariant face recognition," Pattern Recognit. Lett., vol. 27, pp. 747-754, 2006.
30. J. Wang, J. Yang, K. Yu, F. Lv, T. Huang, and Y. Gong, "Localityconstrained linear coding for image classification," in Proc. IEEE Conf. Computer Vision Pattern Recognit., 2010, pp. 3360-3367.
31. C. Jung, L. Jiao, B. Liu, and M. Gong, "position-patch based face hallucination using convex optimization," IEEE Signal Process. Lett., vol. 18, no. 6, pp. 367-370, Jun. 2011.
32. A. M. Martinez and R. Benavente, "The AR face database," CVC Tech. Report #24, 1998.
33. H. A. Rowley, S. Baluja, and T. Kanade, "Neural network-based face detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 1, pp. 23-38, Jan. 1998.
34. W. Zhang and W.-K. Cham, "Hallucinating face in the DCT domain," IEEE Trans. Image Process., vol. 20, no. 10, pp. 2769-2779, Nov. 2011.
35. Y. Hu, K.-M. Lam, G. Qiu, and T. Shen, "From local pixel structure to global image super-resolution: A new face hallucination framework," IEEE Trans. Image Process., vol. 20, no. 2, pp. 433-445, Feb. 2011.
36. H. Li, L. Xu, G. Liu, and M. Gong, "Face hallucination via similarity constraints," IEEE Signal Process. Lett., vol. 20, no. 1, pp. 19-22, Jan. 2013.
37. X. M. Qian, X. S. Hua, P. Chen, and L. J. Ke, "PLBP: An effective local binary patterns texture descriptor with pyramid representation," Pattern Recognit., vol. 44, pp. 2502-2515, 2011.
38. W. Gao, B. Cao, S. G. Shan, X. L. Chen, D. L. Zhou, X. H. Zhang and D. B. Zhao, "The CAS-PEAL large-scale Chinese face database and baseline evaluations," IEEE Trans. System Man, Cybernetics A, Syst. Humans, vol. 38, no. 1, pp. 149-161, Jan. 2008.
39. T. Vetter, "Synthesis of novel views from a single face image," Int. J. Comput. Vision, vol. 28, no. 2, pp. 103-116, 1998.