Manifold-manifold distance and its application to face recognition with image sets

IEEE Transactions on Image Processing

Volumn 21, Issue 10, 2012, Pages 4466-4479

  Wang, Ruiping ^a,b   Shan, Shiguang ^a   Chen, Xilin ^a   Dai, Qionghai ^b   Gao, Wen ^c  

^a INSTITUTE OF COMPUTING TECHNOLOGY   (China)

^b TSINGHUA UNIVERSITY   (China)

^c Peking University   (China)

Author keywords

Face recognition with image sets; hierarchical divisive clustering; manifold manifold distance (MMD); principal angles; set similarity measure

Indexed keywords

DIVISIVE CLUSTERING; IMAGE SETS; MANIFOLD-MANIFOLD DISTANCE (MMD); PRINCIPAL ANGLES; SET SIMILARITY;

IMAGE PROCESSING; MATHEMATICAL MODELS;

FACE RECOGNITION;

ALGORITHM; ARTICLE; BIOMETRY; CLUSTER ANALYSIS; FACE; FACTUAL DATABASE; HISTOLOGY; HUMAN; IMAGE PROCESSING; METHODOLOGY;

ALGORITHMS; BIOMETRIC IDENTIFICATION; CLUSTER ANALYSIS; DATABASES, FACTUAL; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED;

EID: 84866609854     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2012.2206039     Document Type: Article

References (40)

1. O. Arandjelović, G. Shakhnarovich, J. Fisher, R. Cipolla, and T. Darrell, "Face recognition with image sets using manifold density divergence," in Proc. Comput. Vision Pattern Recog. Conf., Jun. 2005, pp. 581-588.
2. T-K. Kim, O. Arandjelović, and R. Cipolla, "Boosted manifold principal angles for image set-based recognition," Pattern Recog., vol. 40, no. 9, pp. 2475-2484, 2007. (Pubitemid 46669592)
3. T-K. Kim, J. Kittler, and R. Cipolla, "Discriminative learning and recognition of image set classes using canonical correlations," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1005-1018, Jun. 2007. (Pubitemid 46667413)
4. W. Fan and D.-Y. Yeung, "Locally linear models on face appearance manifolds with application to dual-subspace based classification," in Proc. IEEE Comput. Vision Pattern Recog. Conf., 2006, pp. 1384-1390. (Pubitemid 44931482)
5. K. Fukui and O. Yamaguchi, "Face recognition using multi-viewpoint patterns for robot vision," in Proc. Int. Symp. Robot. Res., 2003, pp. 192-201.
6. T-K. Kim, J. Kittler, and R. Cipolla, "On-line learning of mutually orthogonal subspaces for face recognition by image sets," IEEE Trans. Image Process., vol. 19, no. 4, pp. 1067-1074, Apr. 2010.
7. M. Kim, S. Kumar, V. Pavlovic, and H. Rowley, "Face tracking and recognition with visual constraints in real-world videos," in Proc. Comput. Vision Pattern Recog. Conf., Jun. 2008, pp. 1-8.
8. K. Lee, M. H. Yang, and D. Kriegman, "Video-based face recognition using probabilistic appearance manifolds," in Proc. Comput. Vision Pattern Recog. Conf., 2003, pp. 313-320.
9. X. Liu and T. Chen, "Video-based face recognition using adaptive hidden Markov models," in Proc. Comput. Vision Pattern Recog. Conf., 2003, pp. 340-345.
10. S. Satoh, "Comparative evaluation of face sequence matching for content-based video access," in Proc. Int. Conf. Autom. Face Gesture Recog., 2000, pp. 163-168.
11. G. Shakhnarovich, J. W. Fisher, and T. Darrell, "Face recognition from long-term observations," in Proc. Eur. Conf. Comput. Vision, 2002, pp. 851-868.
12. T. Wang and P. Shi, "Kernel grassmannian distances and discriminant analysis for face recognition from image sets," Pattern Recog. Lett., vol. 30, no. 13, pp. 1161-1165, 2009.
13. S. Zhou, V. Krüeger, and R. Chellappa, "Probabilistic recognition of human faces from video," Comput. Vision Image Underst., vol. 91, no. 1, pp. 214-245, 2003.
14. O. Yamaguchi, K. Fukui, and K. Maeda, "Face recognition using temporal image sequence," in Proc. Int. Conf. Autom. Face Gesture Recog., 1998, pp. 318-323.
15. J. Hamm and D. D. Lee, "Grassmann discriminant analysis: A unifying view on subspace-based learning," in Proc. Int. Conf. Mach. Learn., 2008, pp. 376-383.
16. L. Wolf and A. Shashua, "Learning over sets using kernel principal angles," J. Mach. Learn. Res., vol. 4, no. 10, pp. 913-931, 2003.
17. A. Hadid and M. Pietikäinen, "From still image to video-based face recognition: An experimental analysis," in Proc. IEEE 6th Int. Conf. Autom. Face Gesture Recog., May 2004, pp. 813-818.
18. Å. Björck and G. H. Golub, "Numerical methods for computing angles between linear subspaces," Math. Comput., vol. 27, no. 123, pp. 579-594, 1973.
19. H. Hotelling, "Relations between two sets of variates," Biometrika, vol. 28, no. 34, pp. 321-372, 1936.
20. A. Edelman, T. A. Arias, and S. T. Smith, "The geometry of algorithms with orthogonality constraints," SIAM J. Matrix Anal. Appl., vol. 20, no. 2, pp. 303-353, 1999. (Pubitemid 129333771)
21. P. Belhumeur and D. Kriegman, "What is the set of images of an object under all possible illumination conditions?" Int. J. Comput. Vision, vol. 28, no. 3, pp. 245-260, Jul. 1998. (Pubitemid 128522672)
22. R. Wang, S. Shan, X. Chen, and W. Gao, "Manifold-manifold distance with application to face recognition based on image set," in Proc. Comput. Vision Pattern Recog. Conf., 2008, pp. 2940-2947.
23. M. Turk and A. Pentland, "Face recognition using eigenfaces," in Proc. Comput. Vision Pattern Recog. Conf., 1991, pp. 586-591.
24. L. Wang, X. Wang, and J. Feng, "Subspace distance analysis with application to adaptive Bayesian algorithm for face recognition," Pattern Recog., vol. 39, no. 3, pp. 456-464, 2006. (Pubitemid 41808626)
25. S. T. Roweis and L. K. Saul, "Nonlinear dimensionality reduction by locally linear embedding," Science, vol. 290, no. 22, pp. 2323-2326, Dec. 2000. (Pubitemid 32041578)
26. R. Wang and X. Chen, "Manifold discriminant analysis," in Proc. Comput. Vision Pattern Recog. Conf., 2009, pp. 429-436.
27. R. Wang, S. Shan, X. Chen, J. Chen, and W. Gao, "Maximal linear embedding for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 9, pp. 1776-1792, Sep. 2011.
28. J. Tenenbaum, V. Silva, and J. Langford, "A global geometric framework for nonlinear dimensionality reduction," Science, vol. 290, no. 22, pp. 2319-2323, Dec. 2000. (Pubitemid 32041577)
29. Z. Zhang and H. Zha, "Principal manifolds and nonlinear dimension reduction via local tangent space alignment," SIAM J. Sci. Comput., vol. 26, no. 1, pp. 313-338, 2004.
30. A. M. Martínez, "Recognizing imprecisely localized, partially occluded, and expression variant faces from a single sample per class," IEEE Trans. Pattern Anal. Mach. Intell., vol. 24, no. 6, pp. 748-763, Jun. 2002. (Pubitemid 34669589)
31. Y. Rubner, C. Tomasi, and L. Guibas, "The earth Mover's distance as a metric for image retrieval," Int. J. Comput. Vision, vol. 40, no. 2, pp. 99-121, 2000. (Pubitemid 32136368)
32. M. P. Dubuisson and A. K. Jain, "A modified hausdorff distance for object matching," in Proc. 12th Int. Conf. Pattern Recog., vol. 1. Oct. 1994, pp. 566-568.
33. A. W. Fitzgibbon and A. Zisserman, "Joint manifold distance: A new approach to appearance based clustering," in Proc. Comput. Vision Pattern Recog. Conf., 2003, pp. 26-33.
34. O. Arandjelović and A. Zisserman, "Automatic face recognition for film character retrieval in feature-length films," in Proc. IEEE Comput. Vision Pattern Recog. Conf., Jun. 2005, pp. 860-867. (Pubitemid 43897283)
35. N. Vasconcelos and A. Lippman, "A multiresolution manifold distance for invariant image similarity," IEEE Trans. Multimedia, vol. 7, no. 1, pp. 127-142, Feb. 2005. (Pubitemid 40178376)
36. E. Kokiopoulou and P. Frossard, "Minimum distance between pattern transformation manifolds: Algorithm and applications," IEEE Trans. Pattern Anal. Mach. Intell., vol. 31, no. 7, pp. 1225-1238, Jul. 2009.
37. P. Simard, Y. L. Cun, J. Denker, and B. Victorri, "Transformation invariance in pattern recognition-tangent distance and tangent propagation," Neural Netw. Tricks Trade, LNCS 1524, pp. 239-274, 1998. (Pubitemid 128162419)
38. R. Gross and J. Shi, "The CMU motion of body (MoBo) database," Robotics Institute, Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-01-18, Jun. 2001.
39. P. Viola and M. Jones, "Robust real-time face detection," Int. J. Comput. Vision, vol. 57, no. 2, pp. 137-154, 2004.
40. H. Cevikalp and B. Triggs, "Face recognition based on image sets," in Proc. IEEE Comput. Vision Pattern Recog. Conf., Jun. 2010, pp. 2567-2573.