Localized multifeature metric learning for image-set-based face recognition

IEEE Transactions on Circuits and Systems for Video Technology

Volumn 26, Issue 3, 2016, Pages 529-540

  Lu, Jiwen ^a   Wang, Gang ^b,c   Moulin, Pierre ^c,d  

^a TSINGHUA UNIVERSITY   (China)

^b NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^c ADVANCED DIGITAL SCIENCES CENTER   (Singapore)

^d University of Illinois at Urbana Champaign   (United States)

Author keywords

Face recognition; image set classification; metric learning; multi kernel learning; multi metric learning

Indexed keywords

LEARNING ALGORITHMS;

FACE RECOGNITION METHODS; FEATURE REPRESENTATION; IMAGE SETS; METRIC LEARNING; MULTI-KERNEL LEARNING; STATE-OF-THE-ART PERFORMANCE; STATISTIC FEATURE; TRAINING AND TESTING;

FACE RECOGNITION;

EID: 84964391120     PISSN: 10518215     EISSN: None     Source Type: Journal    
DOI: 10.1109/TCSVT.2015.2412831     Document Type: Article

References (63)

1. O. Arandjelovic, G. Shakhnarovich, J. Fisher, R. Cipolla, and T. Darrell, "Face recognition with image sets using manifold density divergence, " in Proc. IEEE CVPR, Jun. 2005, pp. 581-588.
2. F. R. Bach, G. R. G. Lanckriet, and M. I. Jordan, "Multiple kernel learning, conic duality, and the SMO algorithm, " in Proc. 21st ICML, 2004, pp. 1-8.
3. H. Cevikalp and B. Triggs, "Face recognition based on image sets, " in Proc. IEEE CVPR, Jun. 2010, pp. 2567-2573.
4. Y.-C. Chen, V. M. Patel, P. J. Phillips, and R. Chellappa, "Dictionarybased face recognition from video, " in Proc. ECCV, 2012, pp. 766-779.
5. Z. Cui, W. Li, D. Xu, S. Shan, and X. Chen, "Fusing robust face region descriptors via multiple metric learning for face recognition in the wild, " in Proc. IEEE CVPR, Jun. 2013, pp. 3554-3561.
6. Z. Cui, S. Shan, H. Zhang, S. Lao, and X. Chen, "Image sets alignment for video-based face recognition, " in Proc. IEEE CVPR, Jun. 2012, pp. 2626-2633.
7. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon, "Informationtheoretic metric learning, " in Proc. 24th ICML, 2007, pp. 209-216.
8. L. Duan, I. W. Tsang, and D. Xu, "Domain transfer multiple kernel learning, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 3, pp. 465-479, Mar. 2012.
9. K. Fan, W. Liu, S. An, and X. Chen, "Margin preserving projection for image set based face recognition, " in Proc. ICNIP, 2011, pp. 681-689.
10. W. Fan and D.-Y. Yeung, "Locally linear models on face appearance manifolds with application to dual-subspace based classification, " in Proc. IEEE CVPR, Jun. 2006, pp. 1384-1390.
11. J. Goldberger, S. Roweis, G. Hinton, and R. Salakhutdinov, "Neighborhood component analysis, " in Proc. NIPS, 2004, pp. 2539-2544.
12. M. Gonen and E. Alpaydin, "Localized multiple kernel learning, " in Proc. 25th ICML, 2008, pp. 352-359.
13. R. Gross and J. Shi, "The CMU motion of body (MoBo) database, " Robot. Inst., Carnegie Mellon Univ., Pittsburgh, PA, USA, Tech. Rep. CMU-RI-TR-01-18, Jun. 2001.
14. M. Guillaumin, J. Verbeek, and C. Schmid, "Is that you? Metric learning approaches for face identification, " in Proc. IEEE ICCV, Sep./Oct. 2009, pp. 498-505.
15. A. Hadid and M. Pietikainen, "From still image to video-based face recognition: An experimental analysis, " in Proc. 6th IEEE Int. Conf. FG, May 2004, pp. 813-818.
16. M. T. Harandi, C. Sanderson, S. Shirazi, and B. C. Lovell, "Graph embedding discriminant analysis on Grassmannian manifolds for improved image set matching, " in Proc. IEEE CVPR, Jun. 2011, pp. 2705-2712.
17. J. Hu, J. Lu, and Y.-P. Tan, "Discriminative deep metric learning for face verification in the wild, " in Proc. IEEE CVPR, Jun. 2014, pp. 1875-1882.
18. J. Hu, J. Lu, J. Yuan, and Y.-P. Tan, "Large margin multi-metric learning for face and kinship verification in the wild, " in Proc. ACCV, 2014, pp. 1-14.
19. Y. Hu, A. S. Mian, and R. Owens, "Sparse approximated nearest points for image set classification, " in Proc. IEEE CVPR, Jun. 2011, pp. 121-128.
20. Y. Hu, A. S. Mian, and R. Owens, "Face recognition using sparse approximated nearest points between image sets, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 34, no. 10, pp. 1992-2004, Oct. 2012.
21. P. Jain, B. Kulis, and K. Grauman, "Fast image search for learned metrics, " in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
22. M. Kan, D. Xu, S. Shan, W. Li, and X. Chen, "Learning prototype hyperplanes for face verification in the wild, " IEEE Trans. Image Process., vol. 22, no. 8, pp. 3310-3316, Aug. 2013.
23. M. Kim, S. Kumar, V. Pavlovic, and H. Rowley, "Face tracking and recognition with visual constraints in real-world videos, " in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
24. T.-K. Kim, J. Kittler, and R. Cipolla, "Learning discriminative canonical correlations for object recognition with image sets, " in Proc. ECCV, 2006, pp. 251-262.
25. T.-K. Kim, J. Kittler, and R. Cipolla, "Discriminative learning and recognition of image set classes using canonical correlations, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 6, pp. 1005-1018, Jun. 2007.
26. T.-K. Kim, J. Kittler, and R. Cipolla, "On-line learning of mutually orthogonal subspaces for face recognition by image sets, " IEEE Trans. Image Process., vol. 19, no. 4, pp. 1067-1074, Apr. 2010.
27. B. Kulis and K. Grauman, "Kernelized locality-sensitive hashing for scalable image search, " in Proc. IEEE 12th ICCV, Sep./Oct. 2009, pp. 2130-2137.
28. K.-C. Lee, J. Ho, M.-H. Yang, and D. Kriegman, "Videobased face recognition using probabilistic appearance manifolds, " in Proc. IEEE CVPR, Jun. 2003, pp. I-313-I-320.
29. F. Li, Q. Dai, W. Xu, and G. Er, "Weighted subspace distance and its applications to object recognition and retrieval with image sets, " IEEE Signal Process. Lett., vol. 16, no. 3, pp. 227-230, Mar. 2009.
30. H. Li, G. Hua, Z. Lin, J. Brandt, and J. Yang, "Probabilistic elastic matching for pose variant face verification, " in Proc. IEEE CVPR, Jun. 2013, pp. 3499-3506.
31. H. Li, G. Hua, X. Shen, Z. Lin, and J. Brandt, "Eigen-pep for video face recognition, " in Proc. ACCV, 2014, pp. 1-14.
32. Y.-Y. Lin, T.-L. Liu, and C.-S. Fuh, "Multiple kernel learning for dimensionality reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 6, pp. 1147-1160, Jun. 2011.
33. J. Lu, J. Hu, X. Zhou, Y. Shang, Y.-P. Tan, and G. Wang, "Neighborhood repulsed metric learning for kinship verification, " in Proc. IEEE CVPR, Jun. 2012, pp. 2594-2601.
34. J. Lu, G. Wang, and P. Moulin, "Image set classification using holistic multiple order statistics features and localized multi-kernel metric learning, " in Proc. IEEE ICCV, Dec. 2013, pp. 329-336.
35. Y. M. Lui, J. R. Beveridge, B. A. Draper, and M. Kirby, "Image-set matching using a geodesic distance and cohort normalization, " in Proc. 8th IEEE Int. Conf. FG, Sep. 2008, pp. 1-6.
36. H. Mendez-Vazquez, Y. Martinez-Diaz, and Z. Chai, "Volume structured ordinal features with background similarity measure for video face recognition, " in Proc. ICB, Jun. 2013, pp. 1-6.
37. A. Mian, Y. Hu, R. Hartley, and R. Owens, "Image set based face recognition using self-regularized non-negative coding and adaptive distance metric learning, " IEEE Trans. Image Process., vol. 22, no. 12, pp. 5252-5262, Dec. 2013.
38. H. A. B. Nguyen and W. Li, "Pose-robust representation for face verification in unconstrained videos, " in Proc. 20th IEEE ICIP, Sep. 2013, pp. 3715-3719.
39. S. Parameswaran and K. Q. Weinberger, "Large margin multi-task metric learning, " in Proc. NIPS, 2010, pp. 1867-1875.
40. A. Rakotomamonjy, F. R. Bach, S. Canu, and Y. Grandvalet, "SimpleMKL, " J. Mach. Learn. Res., vol. 9, pp. 2491-2521, Nov. 2008.
41. G. Shakhnarovich, J. Fisher, and T. Darrell, "Face recognition from longterm observations, " in Proc. ECCV, 2006, pp. 361-375.
42. Y. Taigman, M. Yang, M. Ranzato, and L. Wolf, "DeepFace: Closing the gap to human-level performance in face verification, " in Proc. IEEE CVPR, Jun. 2014, pp. 1701-1708.
43. D. Tao, L. Jin, Y. Wang, Y. Yuan, and X. Li, "Person re-identification by regularized smoothing KISS metric learning, " IEEE Trans. Circuits Syst. Video Technol., vol. 23, no. 10, pp. 1675-1685, Oct. 2013.
44. D. Tran and A. Sorokin, "Human activity recognition with metric learning, " in Proc. ECCV, 2008, pp. 548-561.
45. G. Tsagkatakis and A. Savakis, "Online distance metric learning for object tracking, " IEEE Trans. Circuits Syst. Video Technol., vol. 21, no. 12, pp. 1810-1821, Dec. 2011.
46. P. Viola and M. J. Jones, "Robust real-time face detection, " Int. J. Comput. Vis., vol. 57, no. 2, pp. 137-154, 2004.
47. J. Wang, H. T. Do, A. Woznica, and A. Kalousis, "Metric learning with multiple kernels, " in Proc. NIPS, 2011, pp. 1-8.
48. R. Wang and X. Chen, "Manifold discriminant analysis, " in Proc. IEEE CVPR, Jun. 2009, pp. 429-436.
49. R. Wang, H. Guo, L. S. Davis, and Q. Dai, "Covariance discriminative learning: A natural and efficient approach to image set classification, " in Proc. IEEE CVPR, Jun. 2012, pp. 2496-2503.
50. R. Wang, S. Shan, X. Chen, and W. Gao, "Manifold-manifold distance with application to face recognition based on image set, " in Proc. IEEE CVPR, Jun. 2008, pp. 1-8.
51. S. Wang, S. Jiang, Q. Huang, and Q. Tian, "Multiple kernel learning with high order kernels, " in Proc. 20th ICPR, Aug. 2010, pp. 2138-2141.
52. X. Wang, G. Hua, and T. X. Han, "Discriminative tracking by metric learning, " in Proc. ECCV, 2010, pp. 200-214.
53. K. Q. Weinberger, J. Blitzer, and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification, " in Proc. NIPS, 2005, pp. 1473-1480.
54. L. Wolf, T. Hassner, and I. Maoz, "Face recognition in unconstrained videos with matched background similarity, " in Proc. IEEE CVPR, Jun. 2011, pp. 529-534.
55. L. Wolf and N. Levy, "The SVM-minus similarity score for video face recognition, " in Proc. IEEE CVPR, Jun. 2013, pp. 3523-3530.
56. Y. Wu, M. Minoh, M. Mukunoki, and S. Lao, "Set based discriminative ranking for recognition, " in Proc. ECCV, 2012, pp. 497-510.
57. O. Yamaguchi, K. Fukui, and K. Maeda, "Face recognition using temporal image sequence, " in Proc. 3rd IEEE Int. Conf. FG, Apr. 1998, pp. 318-323.
58. L. Yang, et al., "A boosting framework for visuality-preserving distance metric learning and its application to medical image retrieval, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 32, no. 1, pp. 30-44, Jan. 2010.
59. M. Yang, P. Zhu, L. Van Gool, and L. Zhang, "Face recognition based on regularized nearest points between image sets, " in Proc. 10th IEEE Int. Conf. FG, Apr. 2013, pp. 1-7.
60. B. Zhao, J. T. Kwok, and C. Zhang, "Multiple kernel clustering, " in Proc. SIAM ICDM, 2009, pp. 638-649.
61. Y. Zhao, S. Xu, and Y. Jia, "Discriminant clustering embedding for face recognition with image sets, " in Proc. ACCV, 2007, pp. 641-650.
62. W.-S. Zheng, S. Gong, and T. Xiang, "Person re-identification by probabilistic relative distance comparison, " in Proc. IEEE CVPR, Jun. 2011, pp. 649-656.
63. P. Zhu, W. Zuo, L. Zhang, S. C.-K. Shiu, and D. Zhang, "Image setbased collaborative representation for face recognition, " IEEE Trans. Inf. Forensics Security, vol. 9, no. 7, pp. 1120-1132, Jul. 2014.