Robust face recognition from multi-view videos

IEEE Transactions on Image Processing

Volumn 23, Issue 3, 2014, Pages 1105-1117

  Du, Ming ^a   Sankaranarayanan, Aswin C ^b   Chellappa, Rama ^a  

^a UNIVERSITY OF MARYLAND   (United States)

^b CARNEGIE MELLON UNIVERSITY   (United States)

Author keywords

Face recognition; multi camera networks; pose variations; spherical harmonics

Indexed keywords

ALGORITHM; ARTICLE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; COMPUTER ASSISTED DIAGNOSIS; FACE; HISTOLOGY; HUMAN; IMAGE ENHANCEMENT; IMAGE SUBTRACTION; METHODOLOGY; PHOTOGRAPHY; REPRODUCIBILITY; SENSITIVITY AND SPECIFICITY; THREE DIMENSIONAL IMAGING; VIDEORECORDING;

ALGORITHMS; BIOMETRY; FACE; HUMANS; IMAGE ENHANCEMENT; IMAGE INTERPRETATION, COMPUTER-ASSISTED; IMAGING, THREE-DIMENSIONAL; PATTERN RECOGNITION, AUTOMATED; PHOTOGRAPHY; REPRODUCIBILITY OF RESULTS; SENSITIVITY AND SPECIFICITY; SUBTRACTION TECHNIQUE; VIDEO RECORDING;

EID: 84893949320     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2014.2300812     Document Type: Article

References (59)

1. S. Ba and J. M. Odobez, "Probabilistic head pose tracking evaluation in single and multiple camera setups," Multimodal Technol. Perception Humans, vol. 4625, pp. 276-286, Jun. 2008.
2. Q. Cai, A. C. Sankaranarayanan, Q. Zhang, Z. Zhang, and Z. Liu, "Real time head pose tracking from multiple cameras with a generic model," in Proc. CVPR Workshops, Jun. 2010, pp. 25-32.
3. D. Beymer and T. Poggio, "Face recognition from one example view," in Proc. IEEE Int. Conf. Comput. Vis., Jun. 1995, pp. 500-507.
4. X. Chai, S. Shan, X. Chen, and W. Gao, "Locally linear regression for pose-invariant face recognition," IEEE Trans. Image Process., vol. 16, no. 7, pp. 1716-1725, Jul. 2007. (Pubitemid 47018870)
5. H. S. Lee and D. Kim, "Generating frontal view face image for pose invariant face recognition," Pattern Recognit. Lett., vol. 27, pp. 747-754, May 2006. (Pubitemid 43374857)
6. V. Blanz, T. Grother, P. J. Phillips, and T. Vetter, "Face recognition based on frontal views generated from non-frontal images," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2005, pp. 454-461.
7. S. Li, X. Liu, X. Chai, H. Zhang, S. Lao, and S. Shan, "Morphable displacement field based image matching for face recognition across pose," in Proc. Eur. Conf. Comput. Vis., Oct. 2012, pp. 102-115.
8. V. Blanz and T. Vetter, "A morphable model for the synthesis of 3D faces," in Proc. 26th Annu. Conf. Comput. Graph. Interact. Tech., 1999, pp. 187-194.
9. V. Blanz and T. Vetter, "Face recognition based on fitting a 3D morphable model," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 9, pp. 1063-1074, Sep. 2003.
10. P. Breuer, K.-I. Kim, W. Kienzle, B. Scholkopf, and V. Blanz, "Automatic 3D face reconstruction from single images or video," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Sep. 2008, pp. 1-8.
11. A. Pentland, B. Moghaddam, and T. Starner, "View-based and modular eigenspaces for face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 1994, pp. 84-91.
12. A. Pentland, B. Moghaddam, and T. Starner, "Multi-view face recognition by nonlinear tensor," in Proc. Int. Conf. Pattern Recognit., Dec. 2008, pp. 1-4.
13. M. Kan, S. Shan, H. Zhang, S. Lao, and X. Chen, "Multi-view discriminant analysis," in Proc. Eur. Conf. Comput. Vis., Oct. 2012, pp. 808-821.
14. A. Li, S. Shan, and W. Gao, "Coupled bias-variance tradeoff for crosspose face recognition," IEEE Trans. Image Process., vol. 21, no. 1, pp. 305-315, Jan. 2012.
15. C. D. Castillo and D. W. Jacobs, "Using stereo matching for 2-D face recognition across pose," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
16. C. D. Castillo and D. W. Jacobs, "Wide-baseline stereo for face recognition with large pose variation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 537-544.
17. T. Kanade and A. Yamada, "Multi-subregion based probabilistic approach towards pose-invariant face recognition," in Proc. IEEE Int. Symp. Comput. Intell. Robot. Autom., vol. 2. Jul. 2003, pp. 954-959.
18. S. Lucey and T. Chen, "Learning patch dependencies for improved pose mismatched face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2006, pp. 909-915. (Pubitemid 44931420)
19. J. J. Yokono and T. Poggio, "A multiview face identification model with no geometric constraints," in Proc. IEEE Int. Conf. Autom. Face Gesture Recognit., Apr. 2006, pp. 493-498. (Pubitemid 44711397)
20. A. B. Ashraf, S. Lucey, and T. Chen, "Learning patch correspondences for improved viewpoint invariant face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2008, pp. 1-8.
21. S. J. D. Prince, J. H. Elder, J. Warrell, and F. M. Felisberti, "Tied factor analysis for face recognition across large pose differences," IEEE Trans. Pattern Anal. Mach. Intell., vol. 30, no. 6, pp. 970-984, Jun. 2008. (Pubitemid 351650102)
22. Z. Cao, Q. Yin, X. Tang, and J. Sun, "Face recognition with learningbased descriptor," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2010, pp. 2707-2714.
23. Q. Yin, X. Tang, and J. Sun, "An associate-predict model for face recognition," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2011, pp. 497-504.
24. F. Schroff, T. Treibitz, D. Kriegman, and S. Belongie, "Pose, illumination and expression invariant pairwise face-similarity measure via Doppelgänger list comparison," in Proc. IEEE Int. Conf. Comput. Vis., Nov. 2011, pp. 2494-2501.
25. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic matching for pose variant face verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2013, pp. 1-8.
26. Y. Li, S. Gong, J. Sherrah, and H. Liddell, "Support vector machine based multi-view face detection and recognition," Image Vis. Comput., vol. 22, no. 5, pp. 413-427, 2004.
27. I. Kotsia, N. Nikolaidis, and I. Pitas, "Frontal view recognition in multiview video sequences," in Proc. Int. Conf. Multimedia Exposit., Jun. 2009, pp. 702-705.
28. K. C. Lee, J. Ho, M. H. Yang, and D. Kriegman, "Video-based face recognition using probabilistic appearance manifolds," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2003, pp. 313-320.
29. O. Arandjelovic and R. Cipolla, "A pose-wise linear illumination manifold model for face recognition using video," Comput. Vis. Image Understand., vol. 113, no. 1, pp. 113-125, 2009.
30. R. Wang, S. Shan, X. Chen, and G. Wen, "Manifold-manifold distance with application to face recognition based on image set," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
31. O. Arandjelovic, G. Shakhnarovich, J. Fisher, R. Cipolla, and T. Darrell, "Face recognition with image sets using manifold density divergence," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2005, pp. 581-588.
32. X. Liu and T. Chen, "Video-based face recognition using adaptive hidden Markov models," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1. Jun. 2003, pp. 340-345.
33. G. Aggarwal, A. K. Roy-Chowdhury, and R. Chellappa, "A system identification approach for video-based face recognition," in Proc. Int. Conf. Pattern Recognit., Aug. 2004, pp. 175-178.
34. A. K. Roy-Chowdhury and R. Chellappa, "Face reconstruction from monocular video using uncertainty analysis and a generic model," Comput. Vis. Image Understand., vol. 91, nos. 1-2, pp. 188-213, 2003.
35. Z. Zhang, Z. Liu, D. Adler, M. F. Cohen, E. Hanson, and Y. Shan, "Robust and rapid generation of animated faces from video images: A model-based modeling approach," Int. J. Comput. Vis., vol. 58, no. 2, pp. 93-119, 2004.
36. D. Jiang, Y. Hu, S. Yan, L. Zhang, H. Zhang, and W. Gao, "Efficient 3D reconstruction for face recognition," Pattern Recognit., vol. 38, pp. 787-798, Jun. 2005. (Pubitemid 40308630)
37. A. Pnevmatikakis and L. Polymenakos, Far-field, Multi-Camera, Videoto-Video Face Recognition. Chennai, India: InTech, 2007, pp. 468-486.
38. M. Nishiyama, M. Yuasa, T. Shibata, T. Wakasugi, T. Kawahara, and O. Yamaguchi, "Recognizing faces of moving people by hierarchical image-set matching," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2007, pp. 1-8.
39. K. Ramnath, S. Koterba, J. Xiao, C. Hu, I. Matthews, S. Baker, et al., "Multi-view AAM fitting and construction," Int. J. Comput. Vis., vol. 76, pp. 183-204, Feb. 2008.
40. X. Liu and T. Chen, "Pose-robust face recognition using geometry assisted probabilistic modeling," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., vol. 1, Jun. 2005, pp. 502-509.
41. X. Liu and T. Chen, "Face mosaicing for pose robust video-based recognition," in Proc. Asian Conf. Comput. Vis., vol. 2. Nov. 2007, pp. 662-671.
42. A. C. Sankaranarayanan, A. Veeraraghavan, and R. Chellappa, "Object detection, tracking and recognition for multiple smart cameras," Proc. IEEE, vol. 96, no. 10, pp. 1606-1624, Oct. 2008.
43. J. Yoder, H. Medeiros, J. Park, and A. C. Kak, "Cluster-based distributed face tracking in camera networks," IEEE Trans. Image Process., vol. 19, no. 10, pp. 2551-2563, Oct. 2010.
44. B. Song and A. K. Roy-Chowdhury, "Robust tracking in a camera network: A multi-objective optimization framework," IEEE J. Sel. Topics Signal Process., vol. 2, no. 4, pp. 582-596, Aug. 2008.
45. B. Song, A. T. Kamal, C. Soto, C. Ding, J. A. Farrell, and A. K. Roy-Chowdhury, "Tracking and activity recognition through consensus in distributed camera networks," IEEE Trans. Image Process., vol. 19, no. 10, pp. 2564-2579, Oct. 2010.
46. A. K. Roy-Chowdhury and B. Song, Camera Networks: The Acquisition and Analysis of Videos over Wide Areas (ser. Synthesis Lectures on Computer Vision). San Mateo, CA, USA: Morgan, 2012.
47. R. Basri and D. W. Jacobs, "Lambertian reflectance and linear subspaces," IEEE Trans. Pattern Anal. Mach. Intell., vol. 25, no. 2, pp. 218-233, Feb. 2003.
48. R. Ramamoorthi, "Analytic PCA construction for theoretical analysis of lighting variability in images of a convex lambertian object," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 10, pp. 1322-1333, Oct. 2002. (Pubitemid 35337908)
49. L. Zhang and D. Samaras, "Face recognition from a single training image under arbitrary unknown lighting using spherical harmonics," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 3, pp. 351-363, Mar. 2006. (Pubitemid 43159632)
50. Z. Yue, W. Zhao, and R. Chellappa, "Pose-encoded spherical harmonics for face recognition and synthesis using a single image," EURASIP J. Adv. Signal Process., vol. 2008, pp. 1-18, Jan. 2008.
51. T. Brocker and T. Dieck, Representations of Compact Lie Groups. New York, NY, USA: Springer-Verlag, 2003.
52. M. Kazhdan, T. Funkhouser, and S. Rusinkiewicz, "Rotation invariant spherical harmonic representation of 3D shape descriptors," in Proc. Eurograph./ACM SIGGRAPH Symp. Geometry Process., Jun. 2003, pp. 156-164.
53. M. S. Arulampalam, S. Maskell, N. Gordon, and T. Clapp, "A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking," IEEE Trans. Signal Process., vol. 50, no. 2, pp. 174-188, Feb. 2002. (Pubitemid 34291500)
54. P. Viola and M. J. Jones, "Robust real-time face detection," Int. J. Comput. Vis., vol. 57, pp. 137-154, May 2004.
55. S. Birchfield, "Elliptical head tracking using intensity gradients and color histograms," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 1998, pp. 232-237.
56. P. Felzenszwalb, D. McAllester, and D. Ramaman, "A discriminatively trained, multiscale, deformable part model," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Jun. 2008, pp. 1-8.
57. S. K. Zhou and R. Chellappa, "From sample similarity to ensemble similarity: Probabilistic distance measures in reproducing kernel Hilbert space," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 6, pp. 917-929, Jun. 2006.
58. M. Du, A. C. Sankaranarayanan, and R. Chellappa, "Face tracking and recognition in a camera network," in Multibiometrics Human Identification, B. Bhanu and V. Govindaraju, Eds. Cambridge, U.K.: Cambridge Univ. Press, 2011, pp. 235-257.
59. R. Chellappa, M. Du, P. K. Turaga, and S. K. Zhou, "Face tracking and recognition in video," in Handbook of Face Recognition, S. Z. Li and A. K. Jain, Eds., 2nd ed. New York, NY, USA: Springer-Verlag, 2011, pp. 323-351.