Person Re-Identification by Camera Correlation Aware Feature Augmentation

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volumn 40, Issue 2, 2018, Pages 392-408

  Chen, Ying Cong ^a,b,c   Zhu, Xiatian ^a,d   Zheng, Wei Shi ^a   Lai, Jian Huang ^a,e  

^a SUN YAT SEN UNIVERSITY   (China)

^b NATIONAL UNIVERSITY OF DEFENSE TECHNOLOGY   (China)

^c CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

^d QUEEN MARY UNIVERSITY OF LONDON   (United Kingdom)

^e Guangdong Province Key Laboratory of Information Security   (China)

Author keywords

adaptive feature augmentation; Person re identification; view specific transformation

Indexed keywords

LEARNING ALGORITHMS;

ADAPTIVE FEATURES; COMPARATIVE EXPERIMENTS; DISCRIMINATION INFORMATIONS; FEATURE TRANSFORMATIONS; NON-OVERLAPPING CAMERA VIEWS; PERSON RE IDENTIFICATIONS; VIEW TRANSFORMATIONS; VIEW-SPECIFIC TRANSFORMATION;

CAMERAS;

EID: 85040644409     PISSN: 01628828     EISSN: None     Source Type: Journal    
DOI: 10.1109/TPAMI.2017.2666805     Document Type: Article

References (93)

1. S. Gong, M. Cristani, S. Yan, C. C. Loy, Person Re-Identification, vol. 1. Berlin, Germany: Springer, 2014.
2. R. Zhao, W. Ouyang, X. Wang, "Learning mid-level filters for person re-identfiation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 144-151.
3. Y. Yang, J. Yang, J. Yan, S. Liao, D. Yi, S. Z. Li, "Salient color names for person re-identification, " in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 536-551.
4. I. Kviatkovsky, A. Adam, E. Rivlin, "Color invariants for person reidentification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 7, pp. 1622-1634, Jul. 2013.
5. K. Weinberger, J. Blitzer, L. Saul, "Distance metric learning for large margin nearest neighbor classification, " in Proc. Advances Neural Inf. Process. Syst., 2006, pp. 1473-1480.
6. A. Mignon and F. Jurie, "PCCA: A new approach for distance learning from sparse pairwise constraints, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2666-2672.
7. J. V. Davis, B. Kulis, P. Jain, S. Sra, I. S. Dhillon, "Informationtheoretic metric learning, " in Proc. 24th Int. Conf. Mach. Learn., 2007, pp. 209-216.
8. W.-S. Zheng, S. Gong, T. Xiang, "Re-identification by relative distance comparison, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 653-668, Mar. 2013.
9. Z. Li, S. Chang, F. Liang, T. S. Huang, L. Cao, J. R. Smith, "Learning locally-adaptive decision functions for person verification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3610-3617.
10. S. Pedagadi, J. Orwell, S. Velastin, B. Boghossian, "Local Fisher discriminant analysis for pedestrian re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3318-3325.
11. F. Xiong, M. Gou, O. Camps, M. Sznaier, "Person re-identification using kernel-based metric learning methods, " in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 1-16.
12. S. Liao, Y. Hu, X. Zhu, S. Z. Li, "Person re-identification by local maximal occurrence representation and metric learning, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 2197-2206.
13. M. Kostinger, M. Hirzer, P. Wohlhart, P. M. Roth, H. Bischof, "Large scale metric learning from equivalence constraints, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2012, pp. 2288-2295.
14. S. Paisitkriangkrai, C. Shen, A. van den Hengel, "Learning to rank in person re-identification with metric ensembles, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 1846-1855.
15. S. Liao and S. Z. Li, "Efficient PSD constrained asymmetric metric learning for person re-identification, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 3685-3693.
16. L. An, S. Yang, B. Bhanu, "Person re-identification by robust canonical correlation analysis, " IEEE Signal Process. Lett., vol. 22, no. 8, pp. 1103-1107, Aug. 2015.
17. L. An, M. Kafai, S. Yang, B. Bhanu, "Person re-identification with reference descriptor, " IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 4, pp. 776-787, Apr. 2016.
18. G. Lisanti, I. Masi, A. Del Bimbo, "Matching people across camera views using kernel canonical correlation analysis, " in Proc. Int. Conf. Distrib. Smart Cameras, 2014, Art. no. 10.
19. Y.-C. Chen, W.-S. Zheng, P. C. Yuen, J. Lai, "An asymmetric distance model for cross-view feature mapping in person reidentification, " IEEE Trans. Circuits Syst. Video Technol., 2017, Doi: 10.1109/TCSVT.2016.2515309.
20. W.-S. Zheng, S. Gong, T. Xiang, "Towards open-world person re-identification by one-shot group-based verification, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 3, pp. 591-606, Mar. 2016.
21. X. Wang, W.-S. Zheng, X. Li, J. Zhang, "Cross-scenario transfer person re-identification, " IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 8, pp. 1447-1460, Aug. 2016.
22. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no 1, pp. 40-51, Jan. 2007.
23. A. Krizhevsky, I. Sutskever, G. E. Hinton, "ImageNet classification with deep convolutional neural networks, " in Proc. Advances Neural Inf. Process. Syst., 2012, pp. 1097-1105.
24. J. Donahue, et al., "DeCAF: A deep convolutional activation feature for generic visual recognition, " in Proc. Int. Conf. Mach. Learn., 2014, pp. 647-655.
25. R. Girshick, J. Donahue, T. Darrell, J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 580-587.
26. W. Li, R. Zhao, T. Xiao, X. Wang, "DeepReID: Deep filter pairing neural network for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2014, pp. 152-159.
27. E. Ahmed, M. Jones, T. K. Marks, "An improved deep learning architecture for person re-identification, " Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 3908-3916.
28. J. Hu, J. Lu, Y.-P. Tan, "Deep transfer metric learning, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 325-333.
29. T. Xiao, H. Li, W. Ouyang, X. Wang, "Learning deep feature representations with domain guided dropout for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1249-1258.
30. D. Gray, S. Brennan, H. Tao, "Evaluating appearance models for recognition, reacquisition, tracking, " in Proc. 10th IEEE Int. Workshop Performance Eval. Tracking Surveillance, 2007.
31. W. Li, R. Zhao, X. Wang, "Human reidentification with transferred metric learning, " in Proc. 11th Asian Conf. Comput. Vis., 2012, pp. 31-44.
32. C. C. Loy, T. Xiang, S. Gong, "Multi-camera activity correlation analysis, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2009, pp. 1988-1995.
33. L. Zheng, L. Shen, L. Tian, S. Wang, J. Wang, Q. Tian, "Scalable person re-identification: A benchmark, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 1116-1124.
34. B. Prosser, W.-S. Zheng, S. Gong, T. Xiang, "Person re-identification by support vector ranking, " in Proc. British Mach. Vis. Conf., 2010, pp. 21.1-21.11.
35. W.-S. Zheng, S. Gong, T. Xiang, "Person re-identification by probabilistic relative distance comparison, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2011, pp. 649-656.
36. T. Wang, S. Gong, X. Zhu, S. Wang, "Person re-identification by video ranking, " in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 688-703.
37. W.-S. Zheng, X. Li, T. Xiang, S. Liao, J. Lai, S. Gong, "Partial person re-identification, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 4678-4686.
38. X. Li, W.-S. Zheng, X. Wang, T. Xiang, S. Gong, "Multi-scale learning for low-resolution person re-identification, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 3765-3773.
39. L. Zhang, T. Xiang, S. Gong, "Learning a discriminative null space for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1239-1248.
40. D. Chen, Z. Yuan, B. Chen, N. Zheng, "Similarity learning with spatial constraints for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1268-1277.
41. J. You, A. Wu, X. Li, W.-S. Zheng, "Top-push video-based person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1345-1353.
42. T. Wang, S. Gong, X. Zhu, S. Wang, "Person re-identification by discriminative selection in video ranking, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 12, pp. 2501-2514, Dec. 2016.
43. H. Wang, S. Gong, X. Zhu, T. Xiang, "Human-in-the-loop person re-identification, " in Proc. 14th Eur. Conf. Comput. Vis., 2016, pp. 405-422.
44. M. Farenzena, L. Bazzani, A. Perina, V. Murino, M. Cristani, "Person re-identification by symmetry-driven accumulation of local features, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2010, pp. 2360-2367.
45. R. Zhao, W. Ouyang, X. Wang, "Unsupervised salience learning for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2013, pp. 3586-3593.
46. G. Lisanti, I. Masi, A. Bagdanov, A. Del Bimbo, "Person reidentification by iterative re-weighted sparse ranking, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 8, pp. 1629-1642, Aug. 2015.
47. E. Kodirov, T. Xiang, S. Gong, "Dictionary learning with iterative Laplacian regularisation for unsupervised dictionary learning, " in Proc. British Mach. Vis. Conf., 2015, pp. 44.1-44.12.
48. H. Wang, X. Zhu, T. Xiang, S. Gong, "Towards unsupervised open-set person re-identification, " in Proc. IEEE Int. Conf. Image Process., 2016, pp. 769-773.
49. X. Ma, et al., "Person re-identification by unsupervised video matching, " Pattern Recognit., vol. 65, pp. 197-210, 2017.
50. X. Wang, G. Doretto, T. Sebastian, J. Rittscher, P. Tu, "Shape and appearance context modeling, " in Proc. IEEE 11th Int. Conf. Comput. Vis., 2007, pp. 1-8.
51. D. Gray and H. Tao, "Viewpoint invariant pedestrian recognition with an ensemble of localized features, " in Proc. 10th Eur. Conf. Comput. Vis., 2008, pp. 262-275.
52. D. S. Cheng, M. Cristani, M. Stoppa, L. Bazzani, V. Murino, "Custom pictorial structures for re-identification, " in Proc. British Mach. Vis. Conf., 2011, pp. 68.1-68.11.
53. S. Bak, E. Corvee, F. Bremond, M. Thonnat, "Person reidentification using spatial covariance regions of human body parts, " in Proc. 7th IEEE Int. Conf. Adv. Video Signal-Based Surveillance, 2010, pp. 435-440.
54. M. Hirzer, P. M. Roth, M. Kostinger, H. Bischof, "Relaxed pairwise learned metric for person re-identification, " in Proc. 12th Eur. Conf. Comput. Vis., 2012, pp. 780-793.
55. T. Matsukawa, T. Okabe, E. Suzuki, Y. Sato, "Hierarchical Gaussian descriptor for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1363-1372.
56. D. Yi, Z. Lei, S. Z. Li, "Deep metric learning for practical person re-identification, " arXiv e-prints, 2014.
57. S. Wu, Y.-C. Chen, X. Li, A.-C. Wu, J.-J. You, W.-S. Zheng, "An enhanced deep feature representation for person re-identification, " in Proc. IEEE Winter Conf. Appl. Comput. Vis., 2016, pp. 1-8.
58. S.-Z. Chen, C.-C. Guo, J.-H. Lai, "Deep ranking for person reidentification via joint representation learning, " IEEE Trans. Image Process., vol. 25, no. 5, pp. 2353-2367, May 2016.
59. F. Wang, W. Zuo, L. Lin, D. Zhang, L. Zhang, "Joint learning of single-image and cross-image representations for person reidentification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1288-1296.
60. D. Cheng, Y. Gong, S. Zhou, J. Wang, N. Zheng, "Person reidentification by multi-channel parts-based CNN with improved triplet loss function, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1335-1344.
61. R. R. Varior, M. Haloi, G. Wang, "Gated siamese convolutional neural network architecture for human re-identification, " in Proc. 14th Eur. Conf. Comput. Vis., 2016, pp. 791-808.
62. R. R. Varior, B. Shuai, J. Lu, D. Xu, G. Wang, "A siamese long short-term memory architecture for human re-identification, " in Proc. 14th Eur. Conf. Comput. Vis., 2016, pp. 135-153.
63. S. J. Pan, I. W. Tsang, J. T. Kwok, Q. Yang, "Domain adaptation via transfer component analysis, " IEEE Trans. Neural Netw., vol. 22, no. 2, pp. 199-210, Feb. 2011.
64. S. Si, D. Tao, B. Geng, "Bregman divergence-based regularization for transfer subspace learning, " IEEE Trans. Knowl. Data Eng., vol. 22, no. 7, pp. 929-942, Jul. 2010.
65. B. Geng, D. Tao, C. Xu, "DAML: Domain adaptation metric learning, " IEEE Trans. Image Process., vol. 20, no. 10, pp. 2980-2989, Oct. 2011.
66. M. Xiao and Y. Guo, "Feature space independent semi-supervised domain adaptation via kernel matching, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 1, pp. 54-66, Jan. 2015.
67. W. Li, L. Duan, D. Xu, I. W. Tsang, "Learning with augmented features for supervised and semi-supervised heterogeneous domain adaptation, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, no. 6, pp. 1134-1148, Jun. 2014.
68. R. Gopalan, R. Li, R. Chellappa, "Unsupervised adaptation across domain shifts by generating intermediate data representations, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 36, pp. 2288-2302, Nov. 2014.
69. H. Daume III, "Frustratingly easy domain adaptation, " in Proc. Annu. Meeting Assoc. Comput. Linguistics, Jun. 2007.
70. P. Peng, et al., "Unsupervised cross-dataset transfer learning for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1306-1315.
71. B. Muquet, Z. Wang, G. B. Giannakis, M. De Courville, P. Duhamel, "Cyclic prefixing or zero padding for wireless multicarrier transmissions" IEEE Trans. Commun., vol. 50, no. 12, pp. 2136-2148, Dec. 2002.
72. D. Wang, N. Canagarajah, D. Redmill, D. Bull, "Multiple description video coding based on zero padding, " in Proc. Int. Symp. Circuits Syst., 2004, vol. 2, pp. II-205.
73. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks, " in Proc. 13th Eur. Conf. Comput. Vis., 2014, pp. 818-833.
74. S. Ding, L. Lin, G. Wang, H. Chao, "Deep feature learning with relative distance comparison for person re-identification, " Pattern Recognit., vol. 48, no. 10, pp. 2993-3003, 2015.
75. K. Simonyan and A. Zisserman, "Very deep convolutional networks for large-scale image recognition, " arXiv e-prints, 2014.
76. C. Szegedy, et al., "Going deeper with convolutions, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 1-9.
77. Z. Sun, T. Tan, Y. Wang, S. Z. Li, "Ordinal palmprint represention for personal identification, " in Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2005, pp. 279-284.
78. P. Sinha, "Perceiving and recognizing three-dimensional forms, " Ph.D. dissertation, Dept. Elect. Eng. Comput. Sci., Massachusetts Inst. Technol., Cambridge, MA, USA, 1995.
79. G. H. Golub and C. F. Van Loan, Matrix Computations, vol. 3. Baltimore, MD, USA: JHU Press, 2012.
80. Y.-C. Wong, "Differential geometry of Grassmann manifolds, " Proc. Nat. Academy Sci. United States America, vol. 57, no. 3, 1967, Art. no. 589.
81. J. Hamm and D. D. Lee, "Grassmann discriminant analysis: A unifying view on subspace-based learning, " in Proc. 25th Int. Conf. Mach. Learn., 2008, pp. 376-383.
82. A. M. Martnez and A. C. Kak, "PCA versus LDA, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 2, pp. 228-233, Feb. 2001.
83. E. Choi and C. Lee, "Feature extraction based on the Bhattacharyya distance, " Pattern Recognit., vol. 36, no. 8, pp. 1703-1709, 2003.
84. A. Chakraborty, A. Das, A. Roy-Chowdhury, "Network consistent data association, " IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 9, pp. 1859-1871, Sep. 2016.
85. L. Ma, X. Yang, D. Tao, "Person re-identification over camera networks using multi-task distance metric learning, " IEEE Trans. Image Process., vol. 23, no. 8, pp. 3656-3670, Aug. 2014.
86. R. Zhao, W. Ouyang, X. Wang, "Person re-identification by salience matching, " in Proc. IEEE Int. Conf. Comput. Vis., 2013, pp. 2528-2535.
87. Y. Shen, W. Lin, J. Yan, M. Xu, J. Wu, J. Wang, "Person reidentification with correspondence structure learning, " in Proc. IEEE Int. Conf. Comput. Vis., 2015, pp. 3200-3208.
88. D. Chen, Z. Yuan, G. Hua, N. Zheng, J. Wang, "Similarity learning on an explicit polynomial kernel feature map for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 1565-1573.
89. N. Martinel, C. Micheloni, G. L. Foresti, "Kernelized saliency-based person re-identification through multiple metric learning, " IEEE Trans. Image Process., vol. 24, no. 12, pp. 5645-5658, Dec. 2015.
90. Y. Zhang, B. Li, H. Lu, A. Irie, X. Ruan, "Sample-specific SVM learning for person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2016, pp. 1278-1287.
91. J. Chen, Z. Zhang, Y. Wang, "Relevance metric learning for person re-identification by exploiting global similarities, " in Proc. 22nd Int. Conf. Pattern Recognit., 2014, pp. 1657-1662.
92. C. C. Loy, C. Liu, S. Gong, "Person re-identification by manifold ranking, " in Proc. IEEE Int. Conf. Image Process., 2013, pp. 3567-3571.
93. L. Zheng, S. Wang, L. Tian, F. He, Z. Liu, Q. Tian, "Queryadaptive late fusion for image search and person re-identification, " in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2015, pp. 1741-1750.