Recent advances and trends in visual tracking: A review

Neurocomputing

Volumn 74, Issue 18, 2011, Pages 3823-3831

  Yang, Hanxuan ^a,c   Shao, Ling ^a,b   Zheng, Feng ^a   Wang, Liang ^d   Song, Zhan ^a,e  

^a SHENZHEN INSTITUTES OF ADVANCED TECHNOLOGY   (China)

^b UNIVERSITY OF SHEFFIELD   (United Kingdom)

^c SOUTH CHINA AGRICULTURAL UNIVERSITY   (China)

^d INSTITUTE OF AUTOMATION   (China)

^e CHINESE UNIVERSITY OF HONG KONG   (Hong Kong)

Author keywords

Contextural information; Feature descriptor; Monte Carlo sampling; Online learning; Visual tracking

Indexed keywords

MONTE CARLO METHODS;

CONTEXTURAL INFORMATION; FEATURE DESCRIPTORS; MONTE CARLO SAMPLING; ONLINE LEARNING; VISUAL TRACKING;

RIGID STRUCTURES;

ARTICLE; CAMERA; COMPUTER ANALYSIS; COMPUTER VISION; COMPUTER VISUAL TRACKING; INFORMATION PROCESSING; MACHINE LEARNING; MONTE CARLO METHOD; MOTION; ONLINE SYSTEM; PATTERN RECOGNITION; PRIORITY JOURNAL; PROBABILITY;

EID: 80053330652     PISSN: 09252312     EISSN: 18728286     Source Type: Journal    
DOI: 10.1016/j.neucom.2011.07.024     Document Type: Article

References (131)

1. B. Lucas, T. Kanade, An iterative image registration technique with an application to stereo vision, in: IJCAI, 1981.
2. J. Shi, C. Tomasi, Good features to track, in: CVPR, 1994.
3. M. Isard, A. Blake, A smoothing filter for condensation, in: ECCV, 1998.
4. D. Comaniciu, V. Ramesh, P. Meer, Real-time tracking of non-rigid objects using mean shift, in: CVPR, 2000.
5. A. Adam, E. Rivlin, I. Shimshoni, Robust fragments-based tracking using the integral histogram, in: CVPR, 2006.
6. Avidan S. Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. 2007, 29(2):261-271.
7. Li Yuan, Ai Haizhou, Yamashita T., Lao Shihong, Kawade M. Tracking in low frame rate video: a cascade particle filter with discriminative observers of different life spans. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30(10):1728-1740.
8. Ozuysal M., Calonder M., Lepetit V., Fua P. Fast keypoint recognition using random ferns. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(3):448-461.
9. Matthews L., Ishikawa T., Baker S. The template update problem. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 26(6):810-815.
10. Torralba Antonio Contextual priming for object detection. Int. J. Comput. Vision 2003, 53(2):169-191.
11. C. Desai, D. Ramanan, C. Fowlkes, Discriminative models for multi-class object layout, in: ICCV, 2009.
12. S. Maskell, N. Gordon, A Tutorial on Particle Filters for On-line Nonlinear/Non-Gaussian Bayesian Tracking, Target Tracking: Algorithms and Applications IEE, Workshop, 2001.
13. A. Yilmaz, O. Javed, M. Shah. Object tracking: A survey, in: IPCV, 2006.
14. N. Dalal, B. Trigges, Histograms of oriented gradients for human detection, in: CVPR, 2005.
15. P. Sabzmeydani, G. Mori. Detecting pedestrians by learning shapelet features, in: CVPR, 2007.
16. D. Gavrila, Pedestrian detection from a moving vehicle, in: ECCV, 2000.
17. Z. Lin, L.S. Davis, D. Doermann, D. DeMenthon, Hierarchical part-template matching for human detection and segmentation, in: ICCV, 2007.
18. V. Ferrari, T. Tuytelaars, L. Van, Gool, Object detection by contour segment networks, in: ECCV, 2006.
19. B. Wu, R. Nevatia, Detection of multiple, partially occluded humans in a single image by Bayesian combination of edgelet part detectors, in: ICCV, 2005.
20. D.G. Lowe, Object recognition from local scale-invariant features, in: ICCV, 1999.
21. H. Bay, T. Tuytelaars, L. Van Gool, SURF: Speeded up robust features, in: ECCV, 2006.
22. Q. Zhu, S. Avidan, M. Yeh, K. Cheng, Fast human detection using a cascade of histograms of oriented gradients, in: CVPR, 2006.
23. S. Maji, A. Berg, J. Malik, Classification using intersection kernel support vector machines is efficient, in: CVPR, 2008.
24. P. Felzenszwalb, D. McAllester, D. Ramanan, A discriminatively trained, multiscale, deformable part model, in: CVPR, 2008.
25. W. Gao, H. Ai, S. Lao, Adaptive contour features in oriented granular space for human detection and segmentation, in: CVPR, 2009.
26. Y. Liu, S. Shan, W. Zhang, X. Chen, W. Gao, Granularity-tunable gradients partition (GGP) descriptors for human detection, in: CVPR, 2009.
27. K. Mikolajczyk, C. Schmid, A. Zisserman, Human detection based on a probabilistic assembly of robust part detectors, in: ECCV, 2004.
28. B. Leibe, E. Seemann, B. Schiele, Pedestrian detection in crowded scenes, in: CVPR, 2005.
29. J. Gall, V. Lempitsky, Class-specific hough forests for object detection, in: CVPR, 2009.
30. Van de Weijer J., Gevers T., Bagdanov A.D. Boosting color saliency in image feature detection. IEEE Trans. Pattern Anal. Mach. Intell. 2006, 28(1):150-156.
31. Gevers T., van de Weijer J., Stokman H. Color Image Processing: Methods and Applications: Color Feature Detection: An Overview 2006, CRC Press.
32. A. Abdel-Hakim, A. Farag, CSIFT: A SIFT descriptor with color invariant characteristics, in: CVPR, 2006.
33. Burghouts G.J., Geusebroek J.M. Performance evaluation of local color invariants. Comput. Vision Image Understanding 2009, 113(1):48-62.
34. R. Fergus, P. Perona, A. Zisserman, Object class recognition by unsupervised scale-invariant learning, in: CVPR, 2003.
35. Shotton J., Winn J., Rother C., Criminisi A. TextonBoost for image understanding: multi-class object recognition and segmentation by jointly modeling texture, layout, and context. Int. J. Comput. Vision 2008, 81(1):2-23.
36. J. Winn, A. Criminisi, T. Minka, Categorization by learned universal visual dictionary, in: ICCV, 2005.
37. Manjunath B., Ma W. Texture features for browsing and retrieval of image data. IEEE Trans. Pattern Anal. Mach. Intell. 1996, 18(8):837-842.
38. Ojala T., Pietikainen M., Maenpaa T. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 2002, 24(7):972-987.
39. X. Tan, B. Triggs, Enhanced local texture feature sets for face recognition under difficult lighting conditions, AMFG, 2007.
40. S. Liao, S. Li, Learning multi-scale block local binary patterns for face recognition, in: ICB, 2007.
41. W. Zhang, S. Shan, W. Gao, X. Chen, H. Zhang, Local gabor binary pattern histogram sequence (LGBPHS): a novel non-statistical model for face representation and recognition, in: CVPR, 2005.
42. Y. Mu, S. Yan, Y. Liu, T. Huang, B. Zhou, Discriminative local binary patterns for human detection in personal album, in: CVPR, 2008.
43. Chen Jie, Shan Shiguang, He Chu, Zhao Guoying, Pietikainen M., Chen Xilin, Gao Wen WLD: a robust local image descriptor. IEEE Trans. Pattern Anal. Mach. Intell. 2010, 32(9):1705-1720.
44. H. Wang, M. Ullah, A. Klaser, I. Laptev, C. Schmid, Evaluation of local spatio-temporal features for action recognition, in: BMVC, 2009.
45. Y. Ke, R. Sukthankar, M. Hebert, Efficient visual event detection using volumetric features, in: ICCV, 2005.
46. P. Viola, M. Jones, Rapid object detection using a boosted cascade of simple features, in: CVPR, 2001.
47. Liu Yazhou, Chen Xilin Contour-motion feature (CMF): a space-time approach for robust pedestrian detection. Pattern Recognition Lett. 2009, 30(2):148-156.
48. G. Willems, T. Tuytelaars, L. Van Gool, An efficient dense and scale-invariant spatio-temporal interest point detector, in: ECCV, 2008.
49. Lindeberg T. Feature detection with automatic scale selection. Int. J. Comput. Vision 1998, 30(2):77-116.
50. I. Laptev, M. Marszalek, C. Schmid, B. Rozenfeld, Learning realistic human actions from movies, in: CVPR, 2008.
51. P. Scovanner, S. Ali, M. Shah, A 3-Dimensional SIFT descriptor and its application to action recognition, ACM Multimedia, 2007.
52. A. Kläser, M. Marszalek, C. Schmid, A spatio-temporal descriptor based on 3D gradients, in: BMVC, 2008.
53. Shao L., Gao R., Liu Y., Zhang H. Transform based spatio-temporal descriptors for human action recognition. Neurocomputing 2011, 74(6):962-973.
54. Zhao Guoying, Pietikainen M. Dynamic texture recognition using local binary patterns with an application to facial expressions. IEEE Trans Pattern Anal. Mach. Intell. 2007, 29(6):915-928.
55. O. Tuzel, F. Porikli, P. Meer, Human detection via classification on Riemannian mani-folds, in: CVPR, 2007.
56. X. Hong, H. Chang, S. Shan, X. Chen, W. Gao, Sigma set: a small second order statistical region descriptor, in: CVPR, 2009.
57. B. Wu, R. Nevatia, Optimizing discrimination-efficiency tradeoff in integrating heterogeneous local features for object detection, in: CVPR, 2008.
58. F. Han, Y. Shan, H.S. Sawhney, R. Kumar, Discovering class specific composite features through discriminative sampling with Swendsen-Wang cut, in: CVPR, 2008.
59. L. Shao, L. Ji, A descriptor combining MHI and PCOG for human motion classification, in: CIVR, Xi'an, China, July 2010.
60. X. Wang, T. Han, S. Yan, A HOG-LBP human detector with partial occlusion handling, in: ICCV, 2009.
61. J. Shotton, A. Blake, R. Cipolla, Efficiently combining contour and texture cues for object recognition, in: BMVC, 2008.
62. W. Schwartz, A. Kembhavi, D. Harwood, L. Davis, Human detection using partial least squares analysis, in: ICCV, 2009.
63. B. Alexe, T. Deselaers, V. Ferrari, What is an object? in: CVPR, 2010.
64. A. Kembhavi, B. Siddiquie, R. Miezianko, S. McCloskey, L. Davis, Scene it or not? Incremental Multiple Kernel Learning for Object Detection, in: ICCV, 2009.
65. A. Bosch, A. Zisserman, X. Munoz, Representing shape with a spatial pyramid kernel, in: CIVR, 2007.
66. A. Berg, J. Malik, Geometric blur for template matching, in: CVPR, 2001.
67. L. Shao, R. Mattivi, Feature detector and descriptor evaluation in human action recognition, in: CIVR, Xi'an, China, July 2010.
68. Y. Huang, K. Huang, L. Wang, D. Tao, X. Li, T. Tan, Enhanced biologically inspired model, in: CVPR, 2008.
69. J. Fan, Y. Wu, S. Dai, Discriminative spatial attention for robust tracking, in: ECCV, 2010.
70. A.D. Jepson, D.J. Fleet, T.F. El-Maraghi. Robust online appearance models for visual tracking, in: CVPR, 2001.
71. Zhou Shaohua Kevin, Chellappa R., Moghaddam B. Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Trans. Image Process. 2004, 13(11):1491-1506.
72. K. Lee, D. Kriegman, Online learning of probabilistic appearance manifolds for video-based recognition and tracking, in: CVPR, 2005.
73. Ross David A., Lim Jongwoo, Lin Ruei-Sung, Yang Ming-Hsuan Incremental learning for robust visual tracking. Int. J. Comput. Vision 2008, 77(3):125-141.
74. X. Li, W.M. Hu, Z.F. Zhang, Robust visual tracking based on incremental tensor subspace learning, in: ICCV, 2007.
75. J. Wen, X. Gao, Incremental learning of weighted tensor subspace for visual tracking, in: SMC, 2009.
76. H. Yang, Z. Song, R. Chen, An incremental PCA-HOG descriptor for robust visual hand tracking, in: ISVC, 2010.
77. Arsigny V., Fillard P., Pennec X., Ayache N. Geometric means in a novel vector space structure on symmetric positive definite matrices. SIAM J. Matrix Anal. Appl. 2006, 29:328-347.
78. X. Li, W. Hu, Z. Zhang, X. Zhang, G. Luo, Visual tracking via incremental log-Euclidean Riemannian subspace learning, in: CVPR, 2008.
79. Y. Wu, J. Cheng, J. Wang, H. Lu, Real-time visual tracking via incremental covariance tensor learning, in: ICCV, 2009.
80. Collins R.T., Liu Yanxi, Leordeanu M. Online selection of discriminative tracking features. IEEE Trans. Pattern Anal. Mach. Intell. 2004, 27(10):1631-1643.
81. S. Avidan, Ensemble tracking, in: CVPR, 2005.
82. J. Wang, X. Chen, W. Gao, Online selecting discriminative tracking features using particle filter, in: CVPR, 2005.
83. G. Li, D. Liang, Q. Huang, S. Jiang, W. Gao, Object tracking using incremental 2d-lda learning and Bayes inference, in: ICIP, 2008.
84. X. Zhang, W. Hu, S. Maybank, X. Li, Graph based discriminative learning for robust and efficient object tracking, in: ICCV, 2007.
85. M. Tian, W. Zhang, F. Liu, On-line ensemble SVM for robust object tracking, in: ACCV, 2007.
86. M. Yang, J. Yuan, Y. Wu, Spatial selection for attentional visual tracking, in: CVPR, 2007.
87. H. Grabner, H. Bischof, On-line boosting and vision, in: CVPR, 2006.
88. H. Grabner, H. Bischof, Real-time tracking via on-line boosting, in: BMVC, 2006.
89. A. Saffari, C. Leistner, J. Santner, M. Godec, H. Bischof, On-line random forests, in: OLCV, 2009.
90. Wang M., Hua X.-S., Tang J., Hong R. Beyond distance measurement: constructing neighborhood similarity for video annotation. IEEE Trans. Multimedia 2009, 11(3).
91. Wang M., Hua X.-S., Hong R., Tang J., Qi G.-J., Song Y. Unified video annotation via multi-graph learning. IEEE Trans. Circuits Syst. Video Technol. 2009, 19(5).
92. H. Grabner, C. Leistner, H. Bischof, Semi-supervised on-line boosting for robust tracking, in: ECCV, 2008.
93. B. Babenko, M.-H. Yang, S. Belongie, Visual tracking with online multiple instance learning, in: CVPR, 2009.
94. B. Zeisl, C. Leistner, A. Saffari, H. Bischof, On-line semi-supervised multiple-instance boosting, in: CVPR, 2010.
95. J. Santner, C. Leistner, A. Saffari, T. Pock, H. Bischof, PROST Parallel Robust Online Simple Tracking, in: CVPR, 2010.
96. M. Werlberger, W. Trobin, T. Pock, A. Wedel, D. Cremers, H. Bischof, Anisotropic huber-l1 optical flow, in: BMVC, 2009.
97. Li Yuan, Ai Haizhou, Yamashita T., Lao Shihong, Kawade M. Tracking in low frame rate video: a cascade particle filter with discriminative observers of different life spans. IEEE Trans. Pattern Anal. Mach. Intell. 2008, 30(10):1728-1740.
98. M. Breitenstein, F. Reichlin, B. Leibe, E. Koller-Meier, L. Gool, Robust tracking-by-detection using a detector confidence particle filter, in: ICCV, 2009.
99. C. Aeschliman, J. Park, A. Kak, A probabilistic framework for joint segmentation and tracking, in: CVPR, 2010.
100. Y. Zhao, R.T. Collins, Shape constrained figure-ground segmentation and tracking, in: CVPR, 2009.
101. L. Zhang, Y. Li, R. Nevatia, Global data association for multi-object tracking using network flows, in: CVPR, 2008.
102. Y. Li, C. Huang, R. Nevatia, Learning to associate: hybridboosted multi-target tracker for crowded scene, in: CVPR, 2009.
103. C. Huang, B. Wu, R. Nevatia, Robust object tracking by hierarchical association of detection responses, in: ECCV, 2008.
104. T. Woodley, B. Stenger, R. Cipolla, Tracking using online feature selection and a local generative model, in: BMVC, 2007.
105. H. Grabner, P. Roth, H. Bischof, Eigenboosting: combining discriminative and generative information, in: CVPR, 2007.
106. M. Yang, Y. Wu, S. Lao, Intelligent collaborative tracking by mining auxiliary objects, in: CVPR, 2006.
107. Y. Li, R. Nevatia, Key object driven multi-category object recognition, localization and tracking using spatio-temporal context, in: ECCV, 2008.
108. S. Stalder. H. Grabner, L. Gool, Cascaded confidence filtering for improved tracking-by-detection, in: ECCV, 2010.
109. P. Roth, S. Sternig, H. Grabner, H. Bischof, Classifier grids for robust adaptive object detection, in: CVPR, 2009.
110. H. Grabner, J. Matas, L. Gool, P. Cattin, Tracking the invisible: learning where the object might be, in: CVPR, 2010.
111. Z. Kalal, J. Matas, K. Mikolajczyk, Online learning of robust object detectors during unstable tracking, in: OLCV, 2009.
112. Z. Kalal, K. Mikolajczyk, J. Matas, Forward-backward error: automatic detection of tracking failures, in: ICPR, 2010.
113. S. Divvala, D. Hoiem, J. Hays, A. Efros, M. Hebert, An empirical study of context in object detection, in: CVPR, 2009.
114. Bar-Shalon Y., Fortmann T. Tracking and Data Association 1988, Academic Press.
115. Li Peihua, Zhang Tianwen, Ma Bo Unscented Kalman filter for visual curve tracking. Image and Vision Computing 2004, 22(2):157-164.
116. K. Smith, D.G. Perez, J. Odobez, Using particles to track varying numbers of interacting people, in: CVPR, 2005.
117. Khan Zia, Balch T., Dellaert F. MCMC-based particle filtering for tracking a variable number of interacting targets. IEEE Trans. Pattern Anal. Mach. Intell. 2005, 27(11):1805-1819.
118. X. Zhang, W. Hu, Z. Zhao, Y. Wang, X. Li, Q. Wei, SVD based kalman particle filter for robust visual tracking, in: ICPR, 2008.
119. S. McKenna, H. Nait-Charif, Tracking human motion using auxiliary particle filters and iterated likelihood weighting, IVC, 2007.
120. X. Zhang, W. Hu, S. Maybank, A smarter particle filter, in: ACCV, 2009.
121. J. Kwon, K.M. Lee, F.C. Park, Visual tracking via geometric particle filtering on the affine group with optimal importance functions, in: CVPR, 2009.
122. G. Schindler, F. Dellaert, A rao-blackwellized partsconstellation tracker, in: ICCV workshop, 2005.
123. J. Kwon, K. Lee, Tracking of abrupt motion using Wang-Landau Monte Carlo estimation, in: ECCV, 2008.
124. J. Kwon, K. Lee, Tracking of a non-rigid object via patch-based dynamic appearance modeling and adaptive basin hopping Monte Carlo sampling, in: CVPR, 2009.
125. J. Kwon, K. Lee, Visual tracking decomposition, in: CVPR, 2010.
126. Liu J. Monte Carlo Strategies in Scientific Computing 2001, Springer.
127. P. Viola, M. Jones, Robust real-time object detection, in: CVPR, 2001.
128. A. Vedaldi, V. Gulshan, M. Varma, A. Zisserman, Multiple kernels for object detection, in: ICCV, 2009.
129. Lampert C.H., Blaschko M.B., Hofmann T. Efficient subwindow search: a branch and bound framework for object localization. IEEE Trans. Pattern Anal. Mach. Intell. 2009, 31(12):2129-2142.
130. Jialin Pan Sinno, Yang Qiang A survey on transfer learning. IEEE Trans. Knowl. Data Eng. 2010, 22(10):1345-1359.
131. Koller D., Friedman N. Probabilistic Graphical Models: Principles and Techniques 2009, MIT Press.