Generalized face super-resolution

IEEE Transactions on Image Processing

Volumn 17, Issue 6, 2008, Pages 873-886

  Jia, Kui ^a   Gong, Shaogang ^b  

^a SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^b QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

Author keywords

Face hallucination; Super resolution; Tensor

Indexed keywords

ALGORITHMS; FACE RECOGNITION; GESTURE RECOGNITION; ITERATIVE METHODS; PIXELS; TENSORS;

FACE HALLUCINATION; MULTIMODAL HALLUCINATION;

IMAGE RESOLUTION;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; METHODOLOGY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRY; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; PATTERN RECOGNITION, AUTOMATED; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE;

EID: 44649136068     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2008.922421     Document Type: Article

References (45)

1. M. Elad and A. Feuer, "Restoration of a single superresolution image from several blurred, noisy, and undersampled measured images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1646-1658, Dec. 1997.
2. M. Irani and S. Peleg, "Improving resolution by image registration," CVGIP: Graph Models Image Process., vol. 53, pp. 231-239, 1991.
3. R. R. Schulz and R. L. Stevenson, "Extraction of high-resolution frames from video sequences," IEEE Trans. Image Process., vol. 5, no. 6, pp. 996-1011, Jun. 1996.
4. R. C. Hardie, K. J. Barnard, and E. E. Armstrong, "Joint MAP registration and high-resolution image estimation using a sequence of undersampled images," IEEE Trans. Image Process., vol. 6, no. 12, pp. 1621-1633, Dec. 1997.
5. G. Rochefort, F. Champagnat, G. Le Besnerais, and J. F. Giovannelli, "An improved observation model for super-resolution under affine motion," IEEE Trans. Image Process., vol. 15, no. 11, pp. 3325-3337, Nov. 2006.
6. H. He and L. P. Kondi, "An image super-resolution algorithm for different error levels per frame," IEEE Trans. Image Process., vol. 15, no. 3, pp. 592-603, Mar. 2006.
7. S. Farsiu, M. Elad, and P. Milanfar, "Multiframe demosaicing and super-resolution of color images," IEEE Trans. Process., vol. 15, no. 1, pp. 141-159, Jan. 2006.
8. D. Robinson and P. Milanfar, "Statistical performance analysis of super-resolution," IEEE Trans. Image Process., vol. 15, no. 6, pp. 1413-1428, Jun. 2006.
9. A. S. Georghiades, P. N. Belhumeur, and D. J. Kriegman, "From few to many: Illumination cone models for face recognition under variable and pose," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 643-660, Jun. 2001.
10. M. A. O. Vasilesescu and D. Terzopoulos, "Multilinear image analysis for facial recognition," in Proc. Int. Conf. Pattern Recognition, 2002, pp. 511-514.
11. M. A. O. Vasilescu and D. Terzopoulos, "Multilinear analysis of image ensembles: TensorFaces," in Proc. Eur. Conf. Computer Vision, 2002, pp. 447-460.
12. D. Vlasic, M. Brand, H. Pfister, and J. Popovic, "Face transfer with multilinear model," ACM Trans. Graphics, vol. 24, no. 3, pp. 426-433, 2005.
13. T. G. Kolda, "Orthogonal tensor decompositions," SIAM J. Matrix Anal. Appl., vol. 23, pp. 243-255, 2001.
14. L. D. Lathauwer, B. D. Moor, and J. Vandewalle, "Multilinear singular value, tensor decompositions," SIAM J. Matrix Anal. Appl., vol. 21, no. 4, pp. 1253-1278, 2000.
15. H. Wang and N. Ahuja, "Facial expression decomposition," in Proc. IEEE Int. Conf. Computer Vision, 2003, pp. 958-965.
16. K. Jia and S. Gong "Multi-modal tensor face for simultaneous super-resolution and recognition," in Proc. IEEE Int. Conf. Computer Vision, 2005, pp. 1683-1690.
17. K. Jia and S. Gong, "Multi-resolution tensor for facial expression hallucination," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2006, pp. 395-402.
18. L. Zhang and D. Samaras, "Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 3, pp. 351-363, Mar. 2006.
19. X. He, S. Yan, Y. Hu, P. Niyogi, and H. J. Zhang, "Face recognition using laplacianfaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 27, no. 3, pp. 328-340, Mar. 2005.
20. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
21. X. Wang and X. Tang "Hallucinating face by eigentransformation," IEEE Trans. Syst. Man. Cybern. C, Cybern., vol. 35, no. 3, pp. 425-434, Mar. 2005.
22. W. Liu, D. Lin, and X. Tang, "Hallucinating faces: TensorPatch super-resolution and coupled residue compensation," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2005, pp. 478-484.
23. H. Chang, D. Yeung, and Y. Xiong, "Super-resolution through neighbour embedding, in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, pp. 275-282.
24. X. Lu, A. K. Jain, and D. Colbry, "Matching 2.5D face scans to 3D models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 31-43, Jan. 2006.
25. S. Farsiu, D. Robinson, M. Elad, and P. Milanfar, "Advances and challenges in super-resolution," Int. J. Imag. Syst. Technol., vol. 14, no. 2, pp 47-57, 2004.
26. S. Park, M. Park, and M. G. Kang, "Super-resolution image reconstruction: A technical overview," IEEE Signal Process. Mag., vol. 20, no. 3, pp. 21-36, Mar. 2003.
27. S. Baker and T. Kanade, "Limits on super-resolution and how to break them," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 9, pp. 1167-1183, Sep. 2002.
28. S. Baker and T. Kanade, "Hallucinnating faces," in Proc. IEEE Automatic Face and Gesture Recognition, 2000, pp. 83-90.
29. W. T. Freeman and E. C. Pasztor, "Learning low-level vision," in Proc. IEEE Int. Conf. Computer Vision, 1999, pp. 1182-1189.
30. W. T. Freeman, E. C. Pasztor, and O. T. Carmichael, "Learning low-level vision," Int. J. Comput. Vis., vol. 40, no. 1, pp. 25-47, 2000.
31. D. P. Capel and A. Zisserman, "Super-resolution from multiple views using learnt image models," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, pp. 627-634.
32. B. K. Gunturk, A. U. Batur, Y. Altunbasak, M. H. Hayes, III, and R. M. Mersereau, "Eigenface-domain super-resolution for face recognition," IEEE Trans. Image Process., vol. 12, no. 5, pp. 597-606, May, 2003.
33. S. Baker and I. Matthews, "Lucas-Kanade 20 years on: A unifying framework," Int. J. Comput. Vis., vol. 56, no. 3, pp. 221-255, Mar. 2004.
34. H. A. Rowley, S. Baluja, and T. Kanade, "Neural network-based face detection," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 1, pp. 23-38, Jan. 1998.
35. P. Viola and M. J. Jones, "Robust real-time face detestion," Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
36. C. Liu, H. Shum, and C. Zhang, "A two-step approach to hallucinating faces: Global parametric model and local nonparametric model," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2001, pp. 192-198.
37. C. Liu, H. Shum, and W. T. Freeman, "Face hallucination: Theory and practice," Int. J. Comput. Vis., vol. 75, no. 1, pp. 115-134, 2007.
38. P. J. Burt, "Fast filter transforms for image processing," Comput. Graph. Image Process., vol. 16, pp. 20-51, 1980.
39. P. J. Burt and E. H. Adelson, "The Laplacian pyramid as a compact image code," IEEE Trans. Commun., vol. COM-31, no. 4, pp. 532-540, Apr. 1983.
40. P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 2001, pp. 511-518.
41. J. E. Besag, "On the statistical analysis of dirty pictures (with discussion)," J. Roy. Statist. Soc. B, vol. 48, no. 3, pp. 259-302, 1986.
42. C. M. Bishop, A. Blake, and B. Marthi, "Super-resolution enhancement of video," presented at the Artificial Intelligence and Statistics, Society for Artificial Intelligence and Statistics, 2003.
43. G. Dedeoglu, T. Kanade, and J. August, "High-zooom video hallucination by exploiting spatio-temporal regularities," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2004, pp. 151-158.
44. J. S. Park and S. W. Lee, "Resolution enhancement of facial image based on top-down learning," in Proc. Int. Multimedia Conf.: 1st ACM SIGMM Int. Workshop on Video Surveillance, 2003, pp. 59-64.
45. J. Sun, N. Zhang, H. Tao, and H. Shum, "Image hallucination with primal sketch priors," in Proc. IEEE Conf. Computer Vision and Pattern Recognition, 2003, pp. 729-736.