A pose-wise linear illumination manifold model for face recognition using video

Computer Vision and Image Understanding

Volumn 113, Issue 1, 2009, Pages 113-125

  Arandjelović, Ognjen ^a   Cipolla, Roberto ^b  

^a TRINITY COLLEGE   (United Kingdom)

^b UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Face recognition; Illumination; Invariance; Manifolds; Pose; Robustness; Video

Indexed keywords

INFORMATION THEORY; PATTERN RECOGNITION SYSTEMS; PHOTOGRAPHY; VIDEO RECORDING;

ILLUMINATION; MANIFOLDS; POSE; ROBUSTNESS; VIDEO;

FACE RECOGNITION;

EID: 56449085393     PISSN: 10773142     EISSN: 1090235X     Source Type: Journal    
DOI: 10.1016/j.cviu.2008.07.010     Document Type: Article

References (45)

1. Zhao W., Chellappa R., Phillips P.J., and Rosenfeld A. Face recognition: a literature survey. ACM Computing Surveys 35 4 (2004) 399-458
2. British Broadcasting Corporation, Doubts over passport face scans, BBC News Online, UK Edition, October 21, 2004. Available from: .
3. Boston Globe, Face recognition fails in Boston airport, July 2002.
4. Barrett W.A. A survey of face recognition algorithms and testing results. Systems and Computers 1 (1998) 301-305
5. T. Fromherz, P. Stucki, M. Bichsel, A survey of face recognition, MML Technical Report, (97.01), 1997.
6. K. Lee, D. Kriegman, Online learning of probabilistic appearance manifolds for video-based recognition and tracking, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2005, pp. 852-859.
7. K. Lee, M. Ho, J. Yang, D. Kriegman, Video-based face recognition using probabilistic appearance manifolds, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2003, pp. 313-320.
8. Zhou S., Krueger V., and Chellappa R. Probabilistic recognition of human faces from video. Computer Vision and Image Understanding 91 1 (2003) 214-245
9. O. Arandjelović, G. Shakhnarovich, J. Fisher, R. Cipolla, T. Darrell, Face recognition with image sets using manifold density divergence, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2005, 581-588.
10. G. Shakhnarovich, J.W. Fisher, T. Darrel, Face recognition from long-term observations, in: Proc. European Conference on Computer Vision (ECCV), vol. 3, 2002, pp. 851-868.
11. K. Fukui, O. Yamaguchi, Face recognition using multi-viewpoint patterns for robot vision, International Symposium of Robotics Research, 2003.
12. Wolf L., and Shashua A. Learning over sets using kernel principal angles. Journal of Machine Learning Research (JMLR) 4 10 (2003) 913-931
13. T. Kim, O. Arandjelović, R. Cipolla, Learning over sets using boosted manifold principal angles (BoMPA), in: Proc. IAPR British Machine Vision Conference (BMVC), vol. 2, September 2005, pp. 779-788.
14. Y. Li, S. Gong, H. Liddell, Modelling faces dynamically across views and over time, in: Proc. IEEE International Conference on Computer Vision (ICCV), vol. 1, 2001, pp. 554-559.
15. Palanivel S., Venkatesh B.S., and Yegnanarayana B. Real time face recognition system using autoassociative neural network models. Acoustics, Speech and Signal Processing 2 (2003) 833-836
16. Adini Y., Moses Y., and Ullman S. Face recognition: the problem of compensating for changes in illumination direction. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 19 7 (1997) 721-732
17. O. Arandjelović, A. Zisserman, Automatic face recognition for film character retrieval in feature-length films, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, June 2005, pp. 860-867.
18. M. Everingham, A. Zisserman, Automated person identification in video, in: Proc. IEEE International Conference on Image and Video Retrieval (CIVR), 2004, pp. 289-298.
19. J. Sivic, M. Everingham, A. Zisserman, Person spotting: video shot retrieval for face sets, in: Proc. IEEE International Conference on Image and Video Retrieval (CIVR), 2005, pp. 226-236.
20. Belhumeur P.N., and Kriegman D.J. What is the set of images of an object under all possible illumination conditions?. International Journal of Computer Vision (IJCV) 28 3 (1998) 245-260
21. A.S. Georghiades, D.J. Kriegman, P.N. Belhumeur, Illumination cones for recognition under variable lighting: faces, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1998, pp. 52-58.
22. Blanz V., and Vetter T. Face recognition based on fitting a 3D morphable model. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 25 9 (2003) 1063-1074
23. L. Zhang, S. Wang, D. Samaras, Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 2005, pp. 206-216.
24. Riklin-Raviv T., and Shashua A. The quotient image: class based re-rendering and recognition with varying illuminations. IEEE Transactions on Pattern Analysis and Machine Intelligence (PAMI) 23 2 (2001) 139-219
25. B. Kepenekci, Face Recognition Using Gabor Wavelet Transform, PhD Thesis, The Middle East Technical University, 2001.
26. Murase H., and Nayar S. Visual learning and recognition of 3-D objects from appearance. International Journal of Computer Vision (IJCV) 14 1 (1995) 5-24
27. X. Liu, T. Chen, Video-based face recognition using adaptive hidden Markov models, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2003, pp. 340-345.
28. A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1994, pp. 84-91.
29. Bichsel M., and Pentland A.P. Human face recognition and the face image set's topology. Computer Vision, Graphics and Image Processing: Image Understanding 59 2 (1994) 254-261
30. T.L. Berg, A.C. Berg, J. Edwards, M. Maire, R. White, Y.W. Teh, E. Learned-Miller, D.A. Forsyth, Names and faces in the news, in: Proc. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 2004, pp. 848-854.
31. Fukui K., and Yamaguchi O. Facial feature point extraction method based on combination of shape extraction and pattern matching. Systems and Computers in Japan 29 6 (1998) 2170-2177
32. Duda R.O., Hart P.E., and Stork D.G. Pattern Classification. 2nd ed. (2000), John Wily & Sons, Inc., New York
33. Gray H. Anatomy of the Human Body. 20th ed. (1918), Lea & Febiger, Philadelphia
34. Gonzalez R., and Woods R. Digital Image Processing (1992), Addison-Wesley Publishing Company
35. Press W.H., Teukolsky S.A., Vetterling W.T., and Flannery B.P. Numerical Recipes in C: The Art of Scientific Computing. 2nd ed. (1992), Cambridge University Press
36. S. Shan, W. Gao, B. Cao, D. Zhao, Illumination normalization for robust face recognition against varying lighting conditions, in: Proc. IEEE International Workshop on Analysis and Modeling of Faces and Gestures, 2003, pp. 157-164.
37. Tipping M.E., and Bishop C.M. Probabilistic principal component analysis. Journal of the Royal Statistical Society 3 61 (1999) 611-622
38. Baglama J., Calvetti D., and Reichel L. Iterative methods for the computation of a few eigenvalues of a large symmetric matrix. BIT 36 3 (1996) 400-440
39. D.H. Johnson, S. Sinanović, Symmetrizing the Kullback-Leibler distance, Technical Report, Rice University, 2001.
40. T. Sim, S. Zhang, Exploring face space, in: Proc. IEEE Workshop on Face Processing in Video, 2004, p. 84.
41. Toshiba, Facepass. Available from: .
42. Turk M., and Pentland A. Eigenfaces for recognition. Journal of Cognitive Neuroscience 3 1 (1991) 71-86
43. A. Fitzgibbon, A. Zisserman, On affine invariant clustering and automatic cast listing in movies, in: Proc. European Conference on Computer Vision (ECCV), 2002, pp. 304-320.
44. H. Wang, S.Z. Li, Y. Wang, Face recognition under varying lighting conditions using self quotient image, in: Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FGR), 2004, pp. 819-824.
45. O. Arandjelović, R. Cipolla, A new look at filtering techniques for illumination invariance in automatic face recognition, in: Proc. IEEE International Conference on Automatic Face and Gesture Recognition (FGR), April 2006, pp. 449-454.