Distance metric learning using privileged information for face verification and person re-identification

IEEE Transactions on Neural Networks and Learning Systems

Volumn 26, Issue 12, 2015, Pages 3150-3162

  Xu, Xinxing ^a   Li, Wen ^a   Xu, Dong ^b  

^a NANYANG TECHNOLOGICAL UNIVERSITY   (Singapore)

^b UNIVERSITY OF SYDNEY   (Australia)

Author keywords

Distance metric learning; Face verification; Learning using privileged information (LUPI); Person re identification

Indexed keywords

ALGORITHMS; INFORMATION THEORY;

DISTANCE METRIC LEARNING; DISTANCE METRICS; FACE VERIFICATION; INFORMATION THEORETIC METRIC LEARNING (ITML); NEW APPROACHES; PERSON RE IDENTIFICATIONS; PROJECTION METHOD; TRAINING PROCESS;

IMAGE PROCESSING;

ALGORITHM; ARTIFICIAL INTELLIGENCE; AUTOMATED PATTERN RECOGNITION; BIOMETRY; FACE; HUMAN; IMAGE PROCESSING; LEARNING; PROCEDURES;

ALGORITHMS; ARTIFICIAL INTELLIGENCE; BIOMETRIC IDENTIFICATION; FACE; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; LEARNING; PATTERN RECOGNITION, AUTOMATED;

EID: 84958117229     PISSN: 2162237X     EISSN: 21622388     Source Type: Journal    
DOI: 10.1109/TNNLS.2015.2405574     Document Type: Article

References (48)

1. S. Chopra, R. Hadsell, and Y. LeCun, "Learning a similarity metric discriminatively, with application to face verification," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., San Diego, CA, USA, Jun. 2005, pp. 539-546.
2. T. Ahonen, A. Hadid, and M. Pietikäinen, "Face description with local binary patterns: Application to face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 12, pp. 2037-2041, Dec. 2006.
3. M. Kan, D. Xu, S. Shan, W. Li, and X. Chen, "Learning prototype hyperplanes for face verification in the wild," IEEE Trans. Image Process., vol. 22, no. 8, pp. 3310-3316, Aug. 2013.
4. M. Guillaumin, J. Verbeek, and C. Schmid, "Is that you? Metric learning approaches for face identification," in Proc. IEEE 12th Int. Conf. Comput. Vis., Kyoto, Japan, Sep./Oct. 2009, pp. 498-505.
5. L. Wolf, T. Hassner, and Y. Taigman, "Similarity scores based on background samples," in Proc. 9th Asian Conf. Comput. Vis., Xi'an, China, Sep. 2009, pp. 88-97.
6. J. Han, L. Shao, D. Xu, and J. Shotton, "Enhanced computer vision with microsoft Kinect sensor: A review," IEEE Trans. Cybern., vol. 43, no. 5, pp. 1318-1334, Oct. 2013.
7. K. Lai, L. Bo, X. Ren, and D. Fox, "A large-scale hierarchical multiview RGB-D object dataset," in Proc. IEEE Int. Conf. Robot. Autom., Shanghai, China, May 2011, pp. 1817-1824.
8. B. Y. L. Li, A. S. Mian, W. Liu, and A. Krishna, "Using Kinect for face recognition under varying poses, expressions, illumination and disguise," in Proc. IEEE Workshop Appl. Comput. Vis., Clearwater, FL, USA, Jan. 2013, pp. 186-192.
9. T. Huynh, R. Min, and J.-L. Dugelay, "An efficient LBP-based descriptor for facial depth images applied to gender recognition using RGB-D face data," in Proc. Workshops 11th Asian Conf. Comput. Vis., Daejeon, Korea, Nov. 2012, pp. 133-145.
10. J. V. Davis, B. Kulis, P. Jain, S. Sra, and I. S. Dhillon, "Information theoretic metric learning," in Proc. 24th Annu. Int. Conf. Mach. Learn., Corvallis, OR, USA, Jun. 2007, pp. 209-216.
11. V. Vapnik and A. Vashist, "A new learning paradigm: Learning using privileged information," Neural Netw., vol. 22, nos. 5-6, pp. 544-557, 2009.
12. E. P. Xing, A. Y. Ng, M. I. Jordan, and S. J. Russell, "Distance metric learning with application to clustering with side-information," in Proc. Adv. Neural Inf. Process. Syst., Lake Tahoe, NV, USA, Dec. 2002, pp. 505-512.
13. K. Q. Weinberger and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," J. Mach. Learn. Res., vol. 10, pp. 207-244, Feb. 2009.
14. J. Wang, A. Kalousis, and A. Woznica, "Parametric local metric learning for nearest neighbor classification," in Proc. Adv. Neural Inf. Process. Syst., Lake Tahoe, NV, USA, Dec. 2012, pp. 1610-1618.
15. Y.-K. Noh, B.-T. Zhang, and D. D. Lee, "Generative local metric learning for nearest neighbor classification," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2010, pp. 1822-1830.
16. L. Yang, "Distance metric learning: A comprehensive survey," Dept. Comput. Sci. Eng., Michigan State Univ., East Lansing, MI, USA, Tech. Rep., May 2006.
17. B. Kulis, "Metric learning: A survey," Found. Trends Mach. Learn., vol. 5, no. 4, pp. 287-364, 2013.
18. G. Lebanon, "Metric learning for text documents," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 4, pp. 497-508, Apr. 2006.
19. P. Xie and E. P. Xing, "Multi-modal distance metric learning," in Proc. 23rd Int. Joint Conf. Artif. Intell., Beijing, China, Aug. 2013, pp. 1806-1812.
20. Z. Cui, W. Li, D. Xu, S. Shan, and X. Chen, "Fusing robust face region descriptors via multiple metric learning for face recognition in the wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 3554-3561.
21. B. McFee and G. Lanckriet, "Learning multi-modal similarity," J. Mach. Learn. Res., vol. 12, pp. 491-523, Feb. 2011.
22. D. Pechyony and V. Vapnik, "On the theory of learnining with privileged information," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2010, pp. 1894-1902.
23. W. Li, L. Duan, I. W.-H. Tsang, and D. Xu, "Co-labeling: A new multiview learning approach for ambiguous problems," in Proc. IEEE 12th Int. Conf. Data Mining, Dec. 2012, pp. 419-428.
24. W. Li, L. Niu, and D. Xu, "Exploiting privileged information from web data for image categorization," in Proc. 13th Eur. Conf. Comput. Vis., Zürich, Switzerland, Sep. 2014, pp. 437-452.
25. L. Chen, W. Li, and D. Xu, "Recognizing RGB images by learning from RGB-D data," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Columbus, OH, USA, Jun. 2014, pp. 1418-1425.
26. S. Fouad, P. Tino, S. Raychaudhury, and P. Schneider, "Incorporating privileged information through metric learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 7, pp. 1086-1098, Jul. 2013.
27. L. Wolf, T. Hassner, and Y. Taigman, "Descriptor based methods in the wild," in Proc. Faces Real-Life Images Workshop Eur. Conf. Comput. Vis., Marseille, France, Oct. 2008, pp. 1-14.
28. N. Kumar, A. C. Berg, P. N. Belhumeur, and S. K. Nayar, "Attribute and simile classifiers for face verification," in Proc. IEEE 12th Int. Conf. Comput. Vis., Kyoto, Japan, Sep./Oct. 2009, pp. 365-372.
29. D. G. Lowe, "Distinctive image features from scale-invariant keypoints," Int. J. Comput. Vis., vol. 60, no. 2, pp. 91-110, 2004.
30. N. Dalal and B. Triggs, "Histograms of oriented gradients for human detection," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., San Diego, CA, USA, Jun. 2005, pp. 886-893.
31. G. B. Huang, M. Ramesh, T. Berg, and E. Learned-Miller, "Labeled faces in the wild: A database for studying face recognition in unconstrained environments," Dept. Comput. Sci., Univ. Massachusetts Amherst, Amherst, MA, USA, Tech. Rep. 07-49, Oct. 2007.
32. D. S. Cheng, M. Cristani, M. Stoppa, L. Bazzani, and V. Murino, "Custom pictorial structures for re-identification," in Proc. Brit. Mach. Vis. Conf., Dundee, U.K., Sep. 2011, pp. 68.1-68.11.
33. R. Layne, T. M. Hospedales, and S. Gong, "Person re-identification by attributes," in Proc. Brit. Mach. Vis. Conf., Surrey, U.K., Sep. 2012, pp. 1-11.
34. S. Bak, E. Corvée, F. Brémond, and M. Thonnat, "Person re-identification using spatial covariance regions of human body parts," in Proc. 7th IEEE Int. Conf. Adv. Video Signal-Based Surveill., Boston, MA, USA, Aug./Sep. 2010, pp. 435-440.
35. R. Zhao, W. Ouyang, and X. Wang, "Unsupervised salience learning for person re-identification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Portland, OR, USA, Jun. 2013, pp. 3586-3593.
36. N. Gheissari, T. B. Sebastian, and R. Hartley, "Person reidentification using spatiotemporal appearance," in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., New York, NY, USA, Jun. 2006, pp. 1528-1535.
37. W.-S. Zheng, S. Gong, and T. Xiang, "Reidentification by relative distance comparison," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 653-668, Mar. 2013.
38. B. Prosser, W.-S. Zheng, S. Gong, and T. Xiang, "Person re-identification by support vector ranking," in Proc. Brit. Mach. Vis. Conf., Aberystwyth, U.K., Sep. 2010, pp. 21.1-21.11.
39. M. Köstinger, M. Hirzer, P. Wohlhart, P. M. Roth, and H. Bischof, "Large scale metric learning from equivalence constraints," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., Providence, RI, USA, Jun. 2012, pp. 2288-2295.
40. B. Kulis, M. Sustik, and I. Dhillon, "Learning low-rank kernel matrices," in Proc. 23rd Int. Conf. Mach. Learn., Pittsburgh, PA, USA, Jun. 2006, pp. 505-512.
41. Y. Censor and S. A. Zenios, Parallel Optimization: Theory, Algorithms and Applications. Oxford, U.K.: Oxford Univ. Press, 1997.
42. J. Sherman and W. J. Morrison, "Adjustment of an inverse matrix corresponding to a change in one element of a given matrix," Ann. Math. Statist., vol. 21, no. 1, pp. 124-127, 1950.
43. F. Deutsch and H. Hundal, "The rate of convergence for the cyclic projections algorithm I: Angles between convex sets," J. Approx. Theory, vol. 142, no. 1, pp. 36-55, 2006.
44. C. J. C. Burges, "A tutorial on support vector machines for pattern recognition," Data Mining Knowl. Discovery, vol. 2, no. 2, pp. 121-167, 1998.
45. P. Dago-Casas, D. Gonzalez-Jimenez, L. L. Yu, and J. AlbaCastro, "Single- and cross-database benchmarks for gender classification under unconstrained settings," in Proc. IEEE Int. Conf. Comput. Vis. Workshops, Barcelona, Spain, Nov. 2011, pp. 2152-2159.
46. M. Munaro, A. Basso, A. Fossati, L. Van Gool, and E. Menegatti, "3D reconstruction of freely moving persons for re-identification with a depth sensor," in Proc. IEEE Int. Conf. Robot. Autom., Hong Kong, May/Jun. 2014, pp. 4512-4519.
47. L. Bo, X. Ren, and D. Fox, "Kernel descriptors for visual recognition," in Proc. Adv. Neural Inf. Process. Syst., Vancouver, BC, Canada, Dec. 2010, pp. 244-252.
48. X. Xu, I. W. Tsang, and D. Xu, "Soft margin multiple kernel learning," IEEE Trans. Neural Netw. Learn. Syst., vol. 24, no. 5, pp. 749-761, May 2013.