Automatic Eyeglasses Removal from Face Images

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 26, Issue 3, 2004, Pages 322-336

  Wu, Chenyu ^a   Liu, Ce ^b   Shum, Heung Yueng ^c   Xu, Ying Qing ^c   Zhang, Zhengyou ^d  

^a CARNEGIE MELLON UNIVERSITY   (United States)

^b USA   (United States)

^c MICROSOFT RESEARCH ASIA   (China)

^d MICROSOFT   (United States)

Author keywords

Eye region detection; Eyeglasses localization; Eyeglasses removal; Find and replace; Intelligent image editing

Indexed keywords

EYE REGION DETECTION; EYEGLASSES LOCALIZATION; EYEGLASSES REMOVAL; FIND-AND-REPLACE; INTELLIGENT IMAGE EDITING;

DATABASE SYSTEMS; FACE RECOGNITION; IMAGE ANALYSIS; LEARNING SYSTEMS; MARKOV PROCESSES; MONTE CARLO METHODS; STATISTICAL METHODS;

EYEGLASSES;

ALGORITHM; ARTICLE; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; COMPARATIVE STUDY; COMPUTER ASSISTED DIAGNOSIS; COMPUTER INTERFACE; EVALUATION; FACE; FEMALE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; INFORMATION RETRIEVAL; MALE; METHODOLOGY; PHOTOGRAPHY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING; SPECTACLES; VALIDATION STUDY;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; EYEGLASSES; FACE; FEMALE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; INFORMATION STORAGE AND RETRIEVAL; MALE; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SIGNAL PROCESSING, COMPUTER-ASSISTED; SUBTRACTION TECHNIQUE; USER-COMPUTER INTERFACE;

EID: 1342345776     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2004.1262319     Document Type: Article

References (31)

1. S. Baker and T. Kanade, "Hallucinating Faces," Proc. Fourth Int'l Conf. Autoamtic Face and Gesture Recognition, Mar. 2000.
2. M. Bertalmio, G. Sapiro, V. Caselles, and C. Ballsester, "Image Inpainting," Proc. SIGGRAPH 2000 Conf., pp. 417-424, 2000.
3. F.L. Bookstein, "Principle Warps: Thin-Plate Splines and the Decomposition of Deformations," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 11, no. 6, pp. 567-585, June 1989.
4. H. Chen, Y.Q. Xu, H.Y. Shum, S.C. Zhu, and N.N. Zheng, "Example-Based Facial Sketch Generation with Non-Parametric Sampling, " Proc. Eighth IEEE Int'l Conf. Computer Vision, July 2001.
5. T. Cootes and C. Taylor, "Statistical Models of Appearance for Computer Vision," technical report, Univ. of Manchester, 2000.
6. E. Mortensen and W. Barrett, "Intelligent Scissor for Image Composition," Proc. SIGGRAPH 1995 Conf., pp. 191-198, 1995.
7. D.A. Forsyth, J. Haddon, and S. Ioffe, "The Joy of Sampling," Int'l J. Computer Vision, vol. 41, nos. 1/2, pp. 109-134, 2001.
8. W.T. Freeman and E.G. Pasztor, "Learning Low-Level Vision," Proc. Seventh IEEE Int'l Conf. Computer Vision, pp. 1182-1189, 1999.
9. S. Geman and D. Geman, "Stochastic Relaxation, Gibbs Distribution and the Bayesian Restoration of Images," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 6, no. 6, pp. 721-741, June 1984.
10. A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin, "Image Analogies," Proc. SIGGRAPH '01 Conf., Aug. 2001.
11. X. Jiang, M. Binkert, B. Achermann, and H. Bunke, "Towards Detection of Glasses in Facial Images," Proc. Int'l Conf. Pattern Recognition, pp. 1071-1973, 1998.
12. Z. Jing and R. Mariani, "Glasses Detection and Extraction by Deformable Contour," Proc. Int'l Conf. Pattern Recognition, 2000.
13. T.K. Leung, M.C. Burl, and P. Perona, "Finding Faces in Cluttered Scenes Using Random Labeled Graph Matching," Proc. Fifth IEEE Int'l Conf. Computer Vision, pp. 637-644, 1995.
14. C. Liu and H.Y. Shum, "Kullback-Leibler Boosting and Its Applications in Face Detection," Proc. Computer Vision and Pattern Recognition Conf., 2003.
15. C. Liu, H.Y. Shum, and C.S. Zhang, "A Two-Step Approach to Hallucinating Faces: Global Parametric Model and Local Non-parametric Model," Proc. IEEE Conf. Computer Vision and Pattern Recogntion, Dec. 2001.
16. C. Liu, S.C. Zhu, and H.Y. Shum, "Learning Inhomogeneous Gibbs Model for Faces by Minimax Entropy," Proc. Eighth IEEE Int'l Conf. Computer Vision, July 2001.
17. Z.C. Liu, Y. Shan, and Z. Zhang, "Expressive Expression Mapping with Ratio Images," Proc. SIGGRAPH '01 Conf., Aug. 2001.
18. N. Metropolis, A.W. Rosenbluth, M.N. Rosenbluth, A.H. Teller, and E. Teller, "Equations of State Calculations by Fast Computing Machines," J. Chemical Physics, vol. 21, pp. 1087-1091, 1953.
19. E. Osuna, R. Freund, and F. Girosi, "Training Support Vector Machines: An Application To Face Detection," Proc. IEEE Conf. Computer Vision and Pattern Recognition, pp. 130-136, 1997.
20. P. Pérez, A. Blake, and M. Gangnet, "JetStream: Probabilistic Contour Extraction with Particles," Proc. Int'l Conf. Computer Vision (ICCV), vol. 2, pp. 524-531, 2001.
21. P. Philips, H. Moon, P. Rauss, and S. Rizvi, "The FERET Evaluation Methodology for Face-Recognition Algorithms," Proc. Computer Vision and Pattern Recognition Conf., pp. 137-143, 1997.
22. H.A. Rowley, S. Baluja, and T. Kanade, "Neural Network-Based Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, Jan. 1998.
23. Y. Saito, Y. Kenmochi, and K. Kotani, "Esitmation of Eyeglassless Facial Images Using Principal Component Analysis," Proc. IEEE Int'l Conf. Image Processing, pp. 197-201, 1999.
24. H. Schneiderman and T. Kanade, "A Statistical Method for 3D Object Detection Applied to Faces and Cars," Proc. Seventh IEEE Int'l Conf. Computer Vision, May 2000.
25. K.K. Sung and T. Poggio, "Example-Based Learning for View-Based Human Face Detection," IEEE Trans. Pattern Analysis and Machine Intelligence, vol. 20, no. 1, pp. 39-51, Jan. 1998.
26. Z.W. Tu and S.C. Zhu, "Image Segmentation by Data Driven Markov Chain Monte Carlo," Proc. Eighth Int'l Conf. Computer Vision, July 2001.
27. P. Viola and M. Jones, "Robust Real-Time Face Detection," Proc. Eighth IEEE Int'l Conf. Computer Vision, July 2001.
28. Z. Wen, T. Huang, and Z. Liu, "Face Relighting with Radiance Environment Maps," Proc. Computer Vision and Pattern Recognition Conf., 2003.
29. C.Y. Wu, C. Liu, and J. Zhou, "Eyeglass Existence Verification by Support Vector Machine," Proc. Second IEEE Pacific-Rim Conf. Multimedia, Oct. 2001.
30. A.L. Yuille, D.S. Cohen, and P. Hallinan, "Feature Extraction from Faces Using Deformable Templates," Int'l J. Computer Vision, vol. 8, no. 2, pp. 99-112, 1992.
31. S.C. Zhu, Y.N. Wu, and D. Mumford, "Filter, Random Field and Maximum Entropy," Neural Computation, vol. 9, no. 7, Nov. 1997.