Achieving robust face recognition from video by combining a weak photometric model and a learnt generic face invariant

Pattern Recognition

Volumn 46, Issue 1, 2013, Pages 9-23

  Arandjelović, Ognjen ^a   Cipolla, Roberto ^a  

^a UNIVERSITY OF CAMBRIDGE   (United Kingdom)

Author keywords

Generic; Illumination; Invariance; Manifold; Motion; Pose

Indexed keywords

AUTOMATIC RECOGNITION SYSTEM; FACE IMAGES; GENERIC; HEAD MOTION; HEAD POSE; ILLUMINATION CHANGES; ILLUMINATION INVARIANT; LOW RESOLUTION; MANIFOLD; MANIFOLD STRUCTURES; MOTION; POSE; POSE INVARIANCE; RECOGNITION RATES; REILLUMINATION; STATISTICAL MODELS; USER MOTION; VIDEO SEQUENCES;

INVARIANCE; LIGHTING; PHOTOMETRY; VIDEO RECORDING;

FACE RECOGNITION;

EID: 84866022782     PISSN: 00313203     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.patcog.2012.06.024     Document Type: Article

References (65)

1. W. Zhao, R. Chellappa, P.J. Phillips, and A. Rosenfeld Face recognition: a literature survey ACM Computing Surveys 35 4 2004 399 458
2. P.J. Phillips, K.W. Bowyer, P.J. Flynn, A.J. OToole, W.T. Scruggs, C.L. Schott, M. Sharpe, Face Recognition Vendor Test 2006 and Iris Challenge Evaluation 2006 Large-Scale Results, DIANE Publishing Company, March 2007.
3. K. Lee, D. Kriegman. Online learning of probabilistic appearance manifolds for videobased recognition and tracking, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2005, pp. 852-859.
4. K. Lee, M. Ho, J. Yang, D. Kriegman. Video-based face recognition using probabilistic appearance manifolds, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, June 2003, pp. 313-320.
5. S. Zhou, V. Krueger, and R. Chellappa Probabilistic recognition of human faces from video Computer Vision and Image Understanding 91 1 2003 214 245
6. O. Arandjelović, G. Shakhnarovich, J. Fisher, R. Cipolla, T. Darrell. Face recognition with image sets using manifold density divergence, in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, June 2005, pp. 581-588.
7. G. Shakhnarovich, J.W. Fisher, and T. Darrel. Face recognition from long-term observations, in: Proceedings of the European Conference on Computer Vision (ECCV), vol. 3, May-June 2002, pp. 851-868.
8. K. Fukui, O. Yamaguchi, Face recognition using multi-viewpoint patterns for robot vision, International Symposium of Robotics Research, 2003.
9. O. Arandjelović, Recognition from appearance subspaces across image sets of variable scale, in: Proceedings of the IAPR British Machine Vision Conference (BMVC), September (2010).
10. L. Wolf, and A. Shashua Learning over sets using kernel principal angles Journal of Machine Learning Research (JMLR) 4 10 2003 913 931
11. T-K. Kim, O. Arandjelović, and R. Cipolla Boosted manifold principal angles for image set-based recognition Pattern Recognition 40 September(9) 2007 2475 2484
12. Y. Li, S. Gong, H. Liddell, Modelling faces dynamically across views and over time, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), vol. 1, 2001, pp. 554-559.
13. S. Palanivel, B.S. Venkatesh, and B. Yegnanarayana Real time face recognition system using autoassociative neural network models Acoustics, Speech and Signal Processing 2 2003 833 836
14. Y. Adini, Y. Moses, and S. Ullman Face recognition: the problem of compensating for changes in illumination direction IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 19 7 1997 721 732
15. O. Arandjelović and R. Cipolla. Automatic cast listing in feature-length films with anisotropic manifold space, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, June 2006, pp. 1513-1520.
16. M. Everingham, A. Zisserman, Automated person identification in video, in: Proceedings of the IEEE International Conference on Image and Video Retrieval CIVR, 2004, pp. 289-298.
17. J. Sivic, M. Everingham, A. Zisserman, Person spotting: video shot retrieval for face sets, in: Proceedings of the IEEE International Conference on Image and Video Retrieval (CIVR), 2005, pp. 226-236.
18. P.N. Belhumeur, and D.J. Kriegman What is the set of images of an object under all possible illumination conditions? International Journal of Computer Vision (IJCV) 28 July/August(3) 1998 245 260
19. A.S. Georghiades, D.J. Kriegman, P.N Belhumeur, Illumination cones for recognition under variable lighting: Faces, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition CVPR, 1998, pp. 52-58.
20. V. Blanz, and T. Vetter Face recognition based on fitting a 3D morphable model IEEE Transactions on Pattern Analysis and Machine Intelligence TPAMI 25 September(9) 2003 1063 1074
21. L. Zhang, S. Wang, D. Samaras. Face synthesis and recognition from a single image under arbitrary unknown lighting using a spherical harmonic basis morphable model, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 2005, pp. 206-216.
22. L. Zhang, and D. Samaras Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 28 March(3) 2006 351 363
23. T. Riklin-Raviv, and A. Shashua The quotient image: class based re-rendering and recognition with varying illuminations IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 23 2 2001 219 239
24. B. Kepenekci, Face Recognition using Gabor Wavelet Transform, Ph.D. Thesis, The Middle East Technical University, 2001.
25. H. Murase, and S. Nayar Visual learning and recognition of 3-D objects from appearance International Journal of Computer Vision IJCV 14 1 1995 5 24
26. X. Liu, T. Chen. Video-based face recognition using adaptive hidden Markov models, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, 2003, pp. 340-345.
27. A. Pentland, B. Moghaddam, T. Starner, View-based and modular eigenspaces for face recognition, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition CVPR, 1994, pp. 84-91.
28. O. Arandjelović, R. Cipolla, An illumination invariant face recognition system for access control using video, in: Proceedings of the IAPR British Machine Vision Conference (BMVC), September 2004, pp. 537-546.
29. L. Zhang, S. Shan, X. Chen, and W. Gao Histogram of Gabor phase patterns (HGPP): a novel object representation approach for face recognition IEEE Transactions on Image Processing 16 1 2007 57 68
30. S. Yan, D. Xu, Q. Yang, L. Zhang, X. Tang, and H.-J. Zhang Multilinear discriminant analysis for face recognition IEEE Transactions on Image Processing 16 1 2007 212 220
31. X. Jiang, B. Mandal, and A. Kot Extending the feature vector for automatic face recognition IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 30 3 2008 383 394
32. M.D. Levine, and Y. Yu State-of-the-art of 3D facial reconstruction methods for face recognition based on a single 2D training image per person Journal of the Korea Information Science Society 30 10 2009 908 913
33. M.E. Tipping, and C.M. Bishop Mixtures of probabilistic principal component analyzers Neural Computation 11 2 1999 443 482
34. M. Bichsel, and A.P. Pentland Human face recognition and the face image sets topology Computer Vision, Graphics and Image Processing: Image Understanding 59 2 1994 254 261
35. O. Arandjelović, and R. Cipolla An information-theoretic approach to face recognition from face motion manifolds Image and Vision Computing (special issue on Face Processing in Video) 24 June(6) 2006 639 647
36. O. Arandjelović, A. Zisserman. Automatic face recognition for film character retrieval in feature-length films, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 1, June 2005, pp. 860-867.
37. T.L. Berg, A.C. Berg, J. Edwards, M. Maire, R. White, Y.W. Teh, E. Learned-Miller, D.A. Forsyth. Names and faces in the news, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), vol. 2, 2004, pp. 848-854.
38. D.M. Gavrila. Pedestrian detection from a moving vehicle, in: Proceedings of the European Conference on Computer Vision (ECCV), vol. 2, 2000, pp. 37-49.
39. B. Stenger, A. Thayananthan, P.H.S. Torr, R. Cipolla. Filtering using a tree-based estimator, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), vol. 2, 2003, pp. 1063-1070.
40. R.O. Duda, P.E. Hart, and D.G. Stork Pattern Classification 2000 John Wily & Sons Inc. New York, 2nd edition
41. T.H. Cormen, C.E. Leiserson, R.L. Rivest, Introduction to Algorithms, MIT Press, June 1990.
42. J.B. Tenenbaum, V. de Silva, and J.C. Langford A global geometric framework for nonlinear dimensionality reduction Science 290 5500 2000 2319 2323
43. R. Kimmel, M. Elad, D. Shaked, R. Keshet, and I. Sobel A variational framework for retinex International Journal of Computer Vision (IJCV) 52 1 2003 7 23
44. I. Craw, N.P. Costen, T. Kato, and S. Akamatsu How should we represent faces for automatic recognition? IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 21 1999 725 736
45. R. Gross, I. Matthews, S.Baker, Generic vs. person specific active appearance models, in: Proceedings of the IAPR British Machine Vision Conference (BMVC), 2004, pp. 457-466.
46. R. Gross, J. Yang, A. Waibel. Growing Gaussian mixture models for pose invariant face recognition, in: Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), vol. 1, September 2000, pp. 1088-1091.
47. X. Wang, X. Tang. Bayesian face recognition based on Gaussian mixture models, in: Proceedings of the IEEE International Conference on Pattern Recognition (ICPR), vol. 4, 2004, pp. 142-145.
48. O. Arandjelović, and R. Cipolla A pose-wise linear illumination manifold model for face recognition using video Computer Vision and Image Understanding (CVIU) 113 January(1) 2009 113 125
49. O. Arandjelović, R. Cipolla. Incremental learning of temporally-coherent Gaussian mixture models, in: Proceedings of the IAPR British Machine Vision Conference (BMVC), vol. 2, September 2005, pp. 759-768.
50. P. Hall, D. Marshall, and R. Martin Merging and splitting eigenspace models IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI) 22 September(9) 2000 1042 1048
51. P. Grünwald,The Minimum Description Length Principle, MIT Press, June 2007.
52. O. Arandjelović Computationally efficient application of the generic shape-illumination invariant to face recognition from video Pattern Recognition 45 January(1) 2012 92 103
53. D.O. Gorodnichy, Associative neural networks as means for low-resolution video-based recognition, in: Proceedings of the International Joint Conference on Neural Networks, 2005.
54. P. Viola, and M. Jones Robust real-time face detection International Journal of Computer Vision (IJCV) 57 May(2) 2004 137 154
55. Identix Ltd. Faceit, 〈 http://www.FaceIt.com/ 〉.
56. P.J. Phillips, P. Grother, R.J. Micheals, D.M. Blackburn, E. Tabassi, J.M. Bone, FRVT 2002: Overview and summary, Technical Report, National Institute of Justice, March (2003).
57. J. Heo, B. Abidi, J. Paik, M. A. Abidi. Face recognition: evaluation report for FaceItr, in: Proceedings of the International Conference on Quality Control by Artificial Vision, 5132:551-558, 2003.
58. K. Maeda, O. Yamaguchi, and K. Fukui Towards 3-dimensional pattern recognition Statistical Pattern Recognition August 3138 2004 1061 1068
59. Toshiba, Facepass, 〈 www.toshiba.co.jp/mmlab/tech/w31e.htm 〉.
60. O. Arandjelović, and R. Cipolla A methodology for rapid illumination-invariant face recognition using image processing filters Computer Vision and Image Understanding (CVIU) 113 February(2) 2009 159 171
61. A. Fitzgibbon and A. Zisserman, On affine invariant clustering and automatic cast listing in movies, in: Proceedings of the European Conference on Computer Vision ECCV, 2002, pp. 304-320.
62. H. Wang, S.Z. Li, Y. Wang, Face recognition under varying lighting conditions using self quotient image, in: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (FGR), May 2004, pp. 819-824.
63. M. Nishiyama, O. Yamaguchi, Face recognition using the classified appearance-based quotient image, in: Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (FGR), 2006, pp. 49-54.
64. X. Wang, X. Tang. Unified subspace analysis for face recognition, in: Proceedings of the IEEE International Conference on Computer Vision (ICCV), vol. 1, 2003, pp. 679-686.
65. T. Sim, S. Zhang, Exploring face space, in: Proceedings of the IEEE Workshop on Face Processing in Video, 2004, p. 84.