An example-based face hallucination method for single-frame, low-resolution facial images

IEEE Transactions on Image Processing

Volumn 17, Issue 10, 2008, Pages 1806-1816

  Park, Jeong Seon ^a   Lee, Seong Whan ^b  

^a Chonnam National University   (South Korea)

^b Korea University   (South Korea)

Author keywords

Error back projection; Example based reconstruction; Extended morphable face model; Face hallucination; Face recognition; Region based reconstruction

Indexed keywords

CANNING; ERRORS; IMAGE ENHANCEMENT; LAWS AND LEGISLATION; RECONSTRUCTION (STRUCTURAL); REPAIR; RESTORATION;

BACK-PROJECTION; ERROR BACK-PROJECTION; EXAMPLE-BASED RECONSTRUCTION; EXTENDED MORPHABLE FACE MODEL; FACE DETECTION; FACE HALLUCINATION; FACE MODELING; FACE-RECOGNITION SYSTEMS; FACIAL IMAGING; FACIAL REGIONS; HIGH RESOLUTIONS; LOW-RESOLUTION; MORPHABLE FACE MODEL; RECOGNITION RATES; RECONSTRUCTION ERRORS; RECONSTRUCTION METHODS; REGION-BASED; REGION-BASED RECONSTRUCTION; RESIDUAL ERRORS; SHAPE ESTIMATION; STRUCTURAL SIMILARITIES;

FACE RECOGNITION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY;

EID: 52549116762     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.2001394     Document Type: Article

References (29)

1. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002.
2. S. C. Park, M. K. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, Mar. 2003.
3. X. Wang and X. Tang, "Hallucinating face by eigentransform," IEEE Trans. Syst., Man, Cybern. C, Appl. Rev., vol. 35, no. 3, pp. 425-434, Mar. 2005.
4. G. Dedeoglu, T. Kanade, and J. August, "High-zoom video hallucination by exploiting spatio-temporal regularities," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, Washington, DC, Jun. 2004, vol. 2, pp. 151-158.
5. F. Dekeyser, P. Perez, and P. Bouthemy, "Restoration of noisy, blurred, undersampled image sequences using parametric motion model," in Proc. Int. Symp. Image/Video Communications Over Fixed and Mobile Networks, Rabat, Morocco, Apr. 2000, pp. 1071-1073.
6. M. Elad and A. Feuer, "Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1646-1658, Dec. 1997.
7. R. C. Hardie, K. J. Barnar, and E. E. Armstrong, "Joint map registration and high-resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997.
8. T. A. Stephenson and T. Chen, "Adaptive Markov random fields for example-based super-resolution of faces," EURASIP J. Appl. Signal Process., vol. 2006, pp. 1-11, 2006, Article ID 31062.
9. B. K. Gunturk, A. U. Batur, Y. Altunbasak, M. H. Hayes, and R. M. Mersereau, "Eigenface-domain super-resolution for face recognition," IEEE Trans. Image Process., vol. 12, no. 5, pp. 597-606, May 2003.
10. C. Liu, H.-Y. Shum, and C.-S. Zhang, "A two-step approach to hallucinating faces: Global parametric model and local nonparametric model," in Proc. IEEE Conf. Computer Vision and Pattern Recognition Dec. 2001, vol. 1, pp. 192-198.
11. Y. Li and X. Lin, "An improved two-step approach to hallucinating faces," in Proc. IEEE Conf. Image and Graphics, Dec. 2004, pp. 298-301.
12. Y. Li and X. Lin, "Face hallucination with pose variation," in Proc. 6th IEEE Conf. Automatic Face and Gesture Recognition, Seoul, Korea, May 2004, pp. 723-728.
13. W. Liu, D. Lin, and X. Tang, "Hallucinating faces: TensorPatch super-resolution and coupled residue compensation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, San Diego, CA, Jun. 2005, vol. 2, pp. 478-484.
14. W. Liu, X. Tang, and J. Liu, "Bayesian tensor inference for sketch-based facial photo hallucination," in Proc. 20th Int. Joint Conf. Artificial Intelligence, Hyderabad, India, Jan. 2007, pp. 2141-2146.
15. J.-S. Park and S.-W. Lee, "Resolution enhancement of facial image using an error back-projection of example-based learning," in Proc. 6th IEEE Conf. Automatic Face and Gesture Recognition, Seoul, Korea, May 2004, pp. 831-836.
16. H. Sato, W. Freeman, and A. Onozawa, "Quality improvement for intermediate views using example-based super-resolution," NTT Tech. Rev., vol. 1, no. 6, pp. 44-47, Sep. 2003.
17. C. Liu, H.-Y. Shum, and W. T. Freeman, "Face hallucination: Theory and practice," Int. J. Comput. Vis., vol. 75, no. 1, pp. 115-134, 2007.
18. T. Vetter and N. E. Troje, "Separation of texture and shape in images of faces for image coding and synthesis," J. Opt. Soc. Amer. A, vol. 14, no. 9, pp. 2152-2161, 1997.
19. B.-W. Hwang and S.-W. Lee, "Reconstruction of partially damaged face images based on a morphable face model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 3, pp. 365-372, Mar. 2003.
20. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
21. B. Tom and A. Katsaggelos, "Resolution enhancement of monochrome and color video using motion compensation," IEEE Trans. Image Process. vol. 10, no. 2, pp. 278-287, Feb. 2001.
22. W. Liu, D. Lin, and X. Tang, "Neighbor combination and transformation for hallucinating faces," in Proc. IEEE Conf. Multimedia and Expo Amsterdam, The Netherlands, Jul. 2005, pp. 145-148.
23. M.-H. Yang, D. J. Kriegman, and N. Ahuja, "Detecting faces in images: A survey," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 1, pp. 34-58, Jan. 2002.
24. P. Kakumanua, S. Makrogiannisa, and N. Bourbakis, "A survey of skin-color modeling and detection methods," Pattern Recognit., vol. 40, no. 3, pp. 1106-1122, Mar. 2007.
25. M.-C. Roh and S.-W. Lee, "Performance analysis of face recognition algorithms on Korean face database," Int. J. Pattern Recognit. Artif. Intell., vol. 21, no. 6, pp. 1017-1033, 2007.
26. [Online]. Available: http://www.ee.surrey.ac.uk/CVSSP/xm2vtsdb/
27. Z. Wang, A. C. Bovik, H. R. Sheikh, and E. P. Simoncelli, "Image quality assessment: From error visibility to structural similarity," IEEE Trans. Image Process., vol. 13, no. 4, pp. 600-612, Apr. 2004.
28. [Online]. Available: http://www.cns.nyu.edu/~lcv/ssim/
29. M. A. Turk and A. P. Pentland, "Eigenfaces for recognition," J. Cogn. Neurosci., vol. 3, no. 1, pp. 71-86, 1991.