Deep Ranking for Person Re-Identification via Joint Representation Learning

IEEE Transactions on Image Processing

Volumn 25, Issue 5, 2016, Pages 2353-2367

  Chen, Shi Zhe ^a,b   Guo, Chun Chao ^a,b   Lai, Jian Huang ^a,b  

^a SUN YAT SEN UNIVERSITY   (China)

^b Laboratory of Quantum Information Technology of Guangdong Province   (China)

Author keywords

deep convolutional neural network; learning to rank; Person re identification

Indexed keywords

CONVOLUTION; IMAGE MATCHING; NEURAL NETWORKS; SECURITY SYSTEMS;

COMPARATIVE EVALUATIONS; CONVOLUTIONAL NEURAL NETWORK; FEATURE ENGINEERINGS; LEARNING TO RANK; MULTI-CAMERA SURVEILLANCE SYSTEMS; PERSON RE IDENTIFICATIONS; STATE-OF-THE-ART APPROACH; WITHOUT FINE-TUNING;

LEARNING ALGORITHMS;

ALGORITHM; ARTIFICIAL NEURAL NETWORK; BIOMETRY; FACTUAL DATABASE; HUMAN; MACHINE LEARNING; PROCEDURES;

ALGORITHMS; BIOMETRIC IDENTIFICATION; DATABASES, FACTUAL; HUMANS; MACHINE LEARNING; NEURAL NETWORKS (COMPUTER);

EID: 84964389123     PISSN: 10577149     EISSN: None     Source Type: Journal    
DOI: 10.1109/TIP.2016.2545929     Document Type: Article

References (53)

1. B. Song, A. T. Kamal, C. Soto, C. Ding, J. A. Farrell, A. K. Roy-Chowdhury, "Tracking and activity recognition through consensus in distributed camera networks," IEEE Trans. Image Process., vol. 19, no. 10, pp. 2564-2579, Oct. 2010.
2. R. Vezzani, D. Baltieri, R. Cucchiara, "People reidentification in surveillance and forensics: A survey," ACM Comput. Surv., vol. 46, no. 2, pp. 29:1-29:37, Nov. 2013.
3. S. Gong, M. Cristani, C. C. Loy, T. M. Hospedales, "The reidentification challenge," in Person Re-Identification. Heidelberg, Germany: Springer, 2014, pp. 1-20.
4. A. Mignon and F. Jurie, "PCCA: A new approach for distance learning from sparse pairwise constraints," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Providence, RI, USA, Jun. 2012, pp. 2666-2672.
5. F. Xiong, M. Gou, O. Camps, M. Sznaier, "Person re-identification using kernel-based metric learning methods," in Proc. Eur. Conf. Comput. Vis. (ECCV), Zürich, Switzerland, Sep. 2014, pp. 1-16.
6. W.-S. Zheng, S. Gong, T. Xiang, "Reidentification by relative distance comparison," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 3, pp. 653-668, Mar. 2013.
7. L. Ma, X. Yang, D. Tao, "Person re-identification over camera networks using multi-task distance metric learning," IEEE Trans. Image Process., vol. 23, no. 8, pp. 3656-3670, Aug. 2014.
8. W. Li and X. Wang, "Locally aligned feature transforms across views," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Portland, OR, USA, Jun. 2013, pp. 3594-3601.
9. D. Gray and H. Tao, "Viewpoint invariant pedestrian recognition with an ensemble of localized features," in Proc. Eur. Conf. Comput. Vis. (ECCV), Marseille, France, Oct. 2008, pp. 262-275.
10. M. Farenzena, L. Bazzani, A. Perina, V. Murino, M. Cristani, "Person re-identification by symmetry-driven accumulation of local features," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), San Francisco, CA, USA, Jun. 2010, pp. 2360-2367.
11. C. Liu, S. Gong, C. C. Loy, X. Lin, "Person re-identification: What features are important?" in Proc. ECCV Workshops Demonstrations, 2012, pp. 391-401.
12. C.-C. Guo, S.-Z. Chen, J.-H. Lai, X.-J. Hu, S.-C. Shi, "Multishot person re-identification with automatic ambiguity inference and removal," in Proc. Int. Conf. Pattern Recognit. (ICPR), Stockholm, Sweden, Aug. 2014, pp. 3540-3545.
13. R. Zhao, W. Ouyang, X. Wang, "Unsupervised salience learning for person re-identification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Portland, OR, USA, Jun. 2013, pp. 3586-3593.
14. R. Zhao, W. Ouyang, X. Wang, "Person re-identification by salience matching," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Sydney, NSW, Australia, Dec. 2013, pp. 2528-2535.
15. M. Dikmen, E. Akbas, T. S. Huang, N. Ahuja, "Pedestrian recognition with a learned metric," in Proc. Asian Conf. Comput. Vis. (ACCV), Queenstown, New Zealand, Nov. 2010, pp. 501-512.
16. M. Köstinger, M. Hirzer, P. Wohlhart, P. M. Roth, H. Bischof, "Large scale metric learning from equivalence constraints," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Providence, RI, USA, Jun. 2012, pp. 2288-2295.
17. W. Li, R. Zhao, X. Wang, "Human reidentification with transferred metric learning," in Proc. Asian Conf. Comput. Vis. (ACCV), Daejeon, South Korea, Nov. 2012, pp. 31-44.
18. Z. Li, S. Chang, F. Liang, T. S. Huang, L. Cao, J. R. Smith, "Learning locally-adaptive decision functions for person verification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Portland, OR, USA, Jun. 2013, pp. 3610-3617.
19. S. Pedagadi, J. Orwell, S. Velastin, B. Boghossian, "Local Fisher discriminant analysis for pedestrian re-identification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Portland, OR, USA, Jun. 2013, pp. 3318-3325.
20. H. Yun, P. Raman, S. Vishwanathan, "Ranking via robust binary classification," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), Montreal, QC, Canada, Dec. 2014, pp. 2582-2590.
21. Y. LeCun et al., "Handwritten digit recognition with a back-propagation network," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), 1990, pp. 396-404.
22. A. Krizhevsky, I. Sutskever, G. E. Hinton, "ImageNet classification with deep convolutional neural networks," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), Lake Tahoe, NV, USA, Dec. 2012, pp. 1097-1105.
23. K. Chatfield, K. Simonyan, A. Vedaldi, A. Zisserman, "Return of the devil in the details: Delving deep into convolutional nets," in Proc. Brit. Mach. Vis. Conf. (BMVC), Nottingham, U.K., Sep. 2014.
24. M. D. Zeiler and R. Fergus, "Visualizing and understanding convolutional networks," in Proc. Eur. Conf. Comput. Vis. (ECCV), Zürich, Switzerland, Sep. 2014, pp. 818-833.
25. R. Girshick, J. Donahue, T. Darrell, J. Malik, "Rich feature hierarchies for accurate object detection and semantic segmentation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Columbus, OH, USA, Jun. 2014, pp. 580-587.
26. Y. Sun, Y. Chen, X. Wang, X. Tang, "Deep learning face representation by joint identification-verification," in Proc. Adv. Neural Inf. Process. Syst. (NIPS), Montreal, QC, Canada, Dec. 2014, pp. 1988-1996.
27. T. Chen, L. Lin, L. Liu, X. Luo, X. Li, "DISC: Deep image saliency computing via progressive representation learning," IEEE Trans. Neural Netw. Learn. Syst., doi: 10.1109/TNNLS.2015.2506664.
28. A. Toshev and C. Szegedy, "DeepPose: Human pose estimation via deep neural networks," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Columbus, OH, USA, Jun. 2014, pp. 1653-1660.
29. D. Yi, Z. Lei, S. Liao, S. Z. Li, "Deep metric learning for person reidentification," in Proc. Int. Conf. Pattern Recognit. (ICPR), Stockholm, Sweden, Aug. 2014, pp. 34-39.
30. W. Li, R. Zhao, T. Xiao, X. Wang, "DeepReID: Deep filter pairing neural network for person re-identification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Columbus, OH, USA, Jun. 2014, pp. 152-159.
31. S. F. Tahir and A. Cavallaro, "Cost-effective features for reidentification in camera networks," IEEE Trans. Circuits Syst. Video Technol., vol. 24, no. 8, pp. 1362-1374, Aug. 2014.
32. D. S. Cheng, M. Cristani, M. Stoppa, L. Bazzani, V. Murino, "Custom pictorial structures for re-identification," in Proc. Brit. Mach. Vis. Conf. (BMVC), Dundee, U.K., Aug. 2011, pp. 1-11.
33. B. Ma, Y. Su, F. Jurie, "BiCov: A novel image representation for person re-identification and face verification," in Proc. Brit. Mach. Vis. Conf. (BMVC), Surrey, U.K., Sep. 2012, pp. 57.1-57.11.
34. I. Kviatkovsky, A. Adam, E. Rivlin, "Color invariants for person reidentification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 7, pp. 1622-1634, Jul. 2013.
35. Y. Yang, J. Yang, J. Yan, S. Liao, D. Yi, S. Z. Li, "Salient color names for person re-identification," in Proc. Eur. Conf. Comput. Vis. (ECCV), Zürich, Switzerland, Sep. 2014, pp. 536-551.
36. B. Prosser, W.-S. Zheng, S. Gong, T. Xiang, "Person re-identification by support vector ranking," in Proc. Brit. Mach. Vis. Conf. (BMVC), Aberystwyth, U.K., Aug. 2010, pp. 21.1-21.11.
37. M. Sugiyama, "Dimensionality reduction of multimodal labeled data by local Fisher discriminant analysis," J. Mach. Learn. Res., vol. 8, pp. 1027-1061, May 2007.
38. S. Yan, D. Xu, B. Zhang, H.-J. Zhang, Q. Yang, S. Lin, "Graph embedding and extensions: A general framework for dimensionality reduction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 29, no. 1, pp. 40-51, Jan. 2007.
39. R. Zhao, W. Ouyang, X. Wang, "Learning mid-level filters for person re-identification," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Columbus, OH, USA, Jun. 2014, pp. 144-151.
40. J. Hu, J. Lu, Y.-P. Tan, "Discriminative deep metric learning for face verification in the wild," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Columbus, OH, USA, Jun. 2014, pp. 1875-1882.
41. P. Wu, S. C. H. Hoi, H. Xia, P. Zhao, D. Wang, C. Miao, "Online multimodal deep similarity learning with application to image retrieval," in Proc. ACM Int. Conf. Multimedia, Barcelona, Spain, Oct. 2013, pp. 153-162.
42. J. Wang et al., "Learning fine-grained image similarity with deep ranking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Columbus, OH, USA, Jun. 2014, pp. 1386-1393.
43. H. He and E. A. Garcia, "Learning from imbalanced data," IEEE Trans. Knowl. Data Eng., vol. 21, no. 9, pp. 1263-1284, Sep. 2009.
44. Y.-L. Boureau, J. Ponce, Y. LeCun, "A theoretical analysis of feature pooling in visual recognition," in Proc. ACM Int. Conf. Mach. Learn. (ICML), Haifa, Israel, Jun. 2010, pp. 111-118.
45. Y. Jia et al., "Caffe: Convolutional architecture for fast feature embedding," in Proc. ACM Int. Conf. Multimedia, Orlando, FL, USA, Nov. 2014, pp. 675-678.
46. K. Q. Weinberger and L. K. Saul, "Distance metric learning for large margin nearest neighbor classification," J. Mach. Learn. Res., vol. 10, pp. 207-244, Feb. 2009.
47. J. V. Davis, B. Kulis, P. Jain, S. Sra, I. S. Dhillon, "Information-theoretic metric learning," in Proc. ACM Int. Conf. Mach. Learn. (ICML), Corvallis, OR, USA, Jun. 2007, pp. 209-216.
48. T. Avraham, I. Gurvich, M. Lindenbaum, S. Markovitch, "Learning implicit transfer for person re-identification," in Proc. ECCV Workshops Demonstrations, 2012, pp. 381-390.
49. N. Martinel, A. Das, C. Micheloni, A. K. Roy-Chowdhury, "Reidentification in the function space of feature warps," IEEE Trans. Pattern Anal. Mach. Intell., vol. 37, no. 8, pp. 1656-1669, Aug. 2015.
50. Y. Wei et al. (2014). "CNN: Single-label to multi-label." [Online]. Available: http://arxiv.org/abs/1406.5726
51. W.-S. Zheng, S. Gong, T. Xiang, "Towards open-world person reidentification by one-shot group-based verification," IEEE Trans. Pattern Anal. Mach. Intell., vol. 38, no. 3, pp. 591-606, Mar. 2015.
52. A. J. Ma, P. C. Yuen, J. Li, "Domain transfer support vector ranking for person re-identification without target camera label information," in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Sydney, NSW, Australia, Dec. 2013, pp. 3567-3574.
53. F. Schroff, D. Kalenichenko, J. Philbin, "FaceNet: A unified embedding for face recognition and clustering," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Boston, MA, USA, Jun. 2015, pp. 815-823.