Survey of visual tracking

Zidonghua Xuebao/Acta Automatica Sinica

Volumn 32, Issue 4, 2006, Pages 603-617

  Hou, Zhi Qiang ^a,b   Han, Chong Zhao ^a  

^a XI'AN JIAOTONG UNIVERSITY   (China)

^b AIR FORCE ENGINEERING UNIVERSITY   (China)

Author keywords

3D reconstruction; Computer vision; Image sequence; MPEG 4; Surveillance system; Visual tracking

Indexed keywords

CONTROL THEORY; IMAGE COMPRESSION; ROBUSTNESS (CONTROL SYSTEMS); TRACKING (POSITION);

3D RECONSTRUCTION; AREA BASED METHODS; FEATURE BASED METHODS; IMAGE SEQUENCE; MPEG-4; SURVEILLANCE SYSTEM; VISUAL TRACKING;

COMPUTER VISION;

EID: 33748462883     PISSN: 02544156     EISSN: None     Source Type: Journal    
DOI: None     Document Type: Review

References (131)

1. Haritaoglu I, Harwood D, Davis L. W4: Real-time surveillance of people and their activities. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8): 809-830
2. Pavlidis I, Morellas V, Tsiamyrtzis P, Harp S. Urban surveillance system: From the laboratory to the commercial world. Proceedings of the IEEE, 2001, 89(10): 1478-1497
3. Collins R, Lipton A, Kanade T, Fujiyoshi H, Duggins D, Tsin Y, Tolliver D, Enomoto N, Hasegawa O, Burt P, Wixson L. A system for video surveillance and monitoring, VSAM final report, Carnegie Mellon University: Technical Report CMU-RI-TR-00-12, 2000
4. Collins R, Lipton A, Fujiyoshi H, Kanade T. Algorithms for cooperative multisensor surveillance. Proceedings of the IEEE, 2001, 89(10): 1456-1477
5. Bogaert M, Chleq N, Cornez P, Regazzoni C S, Teschioni A, Thonnat M. The PASSWORDS project. In: Proceedings of IEEE International Conference on Image Processing. Switzerland: Lansanne, 1996, 3: 675-678
6. Wren C R, Azarbayejani A, Darrell T, Pentland A P. Pfinder: Real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7): 780-785
7. Coifman B, Beymer D, Mclauchlan P, Malik J. A real-time computer vision system for vehicle tracking and traffic surveillance. Transportation Research Part C, 1998, 6(4): 271-288
8. Magee D. Tracking multiple vehicles using foreground, background and motion models. Image and Vision Computing, 2004, 22(2): 143-155
9. Koller D, Daniilidis K, Nagel H. Model-based object tracking in monocular image sequences of road traffic scene. International Journal of Computer Vision, 1993, 10(3): 257-281
10. Dubuisson-Jolly M, Lakshmanan S, Jain A K. Vehicle segmentation and classification using deformable templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1996, 18(3): 293-308
11. Tai J, Tsang S, Lin C, Song K. Real-time image tracking for automatic traffic monitoring and enforcement application. Image and Vision Computing, 2004, 22(6): 485-501
12. Zhu Z, Xu G, Yang B, Shi D, Lin X. VISATRAM: A real-time vision system for automatic traffic monitoring. Image and Vision Computing, 2000, 18(10): 781-794
13. Haag M, Nagel H. Tracking of complex driving maneuvers in traffic image sequences. Image and Vision Computing, 1998, 16(8): 517-527
14. Pai C, Tyan H, Liang Y, Liao H M, Chen S. Pedestrian detection and tracking at crossroads. Pattern Recognition, 2004, 37(5): 1025-1034
15. Masoud O, Papanikolopoulos N P. A novel method for tracking and counting pedestrians in real-time using a single camera. IEEE Transactions on Vehicular Technology, 2001, 50(5): 1267-1278
16. Foresti G L, Murino V, Regazzoni C. Vehicle recognition and tracking from road image sequences. IEEE Transactions on Vehicular Technology, 1999, 48(1): 301-318
17. Betke M, Haritaoglu E, Davis L S. Real-time multiple vehicle detection and tracking from a moving vehicle. Machine Vision and Applications, 2000, 12(2): 69-83
18. Ferryman J M, Maybank S J, Worrall A D. Visual surveillance for moving vehicle. International Journal of Computer vision, 2000, 37(2): 187-197
19. Desouza G. N, Kak A. C, Vision for mobile robot navigation: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(2): 237-267
20. Boult T E, Micheals R J, Gao X, Eckmann M. Into the woods: Visual surveillance of noncooperative and camouflaged targets in complex outdoor settings. Proceedings of the IEEE, 2001, 89(10): 1382-1402
21. Kumar R, Sawhney H, Samarasekera S, Hsu S, Tao H, Guo Y, Hanna K, Pope A, Wildes R, Hirvonen D, Hansen M, Burt P. Aerial video surveillance and exploitation. Proceedings of the IEEE, 2001, 89(10): 1518-1539
22. Tao H, Sawhney H S, Kumar R. Object tracking with Bayesian estimation of dynamic layer representations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(1): 75-89
23. Tsao T, Wen Z. Image-based target tracking through rapid sensor orientation change, SPIE Optical Engineering, 2002, 41(3): 697-703
24. Sikora T. The MPEG-4 video standard verification model. IEEE Transactions on Circuits and Systems for Video Technology, 1997, 7(1): 19-31
25. Castagno R, Ebrahimi T, Kunt M. Video segmentation based on multiple features for interactive multimedia applications. IEEE Transactions on Circuits and Systems for Video Technology, 1998, 8(5): 562-571
26. Kim B, Park R. A fast automation VOP generation using boundary block segmentation. Real-time Imaging, 2004, 10(2): 117-125
27. Valente S, Dugelay J. A visual analysis/synthesis feedback loop for accurate face tracking. Signal Processing: Image Communication, 2001, 16(6): 585-608
28. Meier T, Ngan K N. Automatic segmentation of moving objects for video object plane generation. IEEE Transactions on Circuits and Systems for Video Technology, 1998, 8(5): 525-538
29. Wang D. Unsupervised video segmentation based on watersheds and temporal tracking. IEEE Transactions on Circuits and Systems for Video Technology, 1998, 8(5): 539-546
30. Mech R, Wollborn M. A noise robust method for 2D shape estimation of moving objects in video sequences considering a moving camera. Signal Processing, 1998, 66(2): 203-217
31. Zhu Z J, Jiang G Y, Yu M, Wang R D, Wu X W. New algorithm for extracting and tracking moving object in object-based video coding. Acta Electronica Sinica, 2003, 31(9): 1426-1428
32. Cohen L D, Cohen I. Finite-element methods for active contour models and balloons for 2-D and 3-D images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1993, 15(11): 1131-1147
33. Jaynes C, Riseman E, Hanson A. Recognition and reconstruction of buildings from multiple aerial images. Computer Vision and Image Understanding, 2003, 90(1): 68-98
34. Remondino F. 3-D reconstruction of static human body shape from image sequence. Computer Vision and Image Understanding, 2004, 93(1): 65-85
35. Park S, Subbarao M. Automatic 3D model reconstruction based on novel pose estimation and integration techniques. Image and Vision Computing, 2004, 22(8): 623-635
36. Zheng J Y. Acquiring a complete 3D model from specular motion under the illumination of circular-shape light sources. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8): 913-920
37. Pavlovie V I, Sharma R, Huang T S. Visual interpretation of hand gestures for human-computer interaction: A review. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1997, 19(7): 677-695
38. Lien C, Huang C. Model-based articulated hand motion tracking for gesture recognition. Image and Vision Computing, 1998, 16(2): 121-134
39. Choi H I, Rhee P K. Head gesture recognition using HMMs. Expert System with Applications, 1999, 17(3): 213-221
40. Viola P, Jones M. J, Robust real-time face detection. International Journal of Computer Vision, 2004, 57(2): 137-154
41. Gavrila D M. The visual analysis of human movement: A survey. Computer Vision and Image Understanding, 1999, 73(1): 82-98
42. Aggarwal J K, Cai Q. Human motion analysis: A review. Computer Vision and Image Understanding, 1999, 73(3): 428-440
43. Moeslund T B, Granum E. A survey of computer vision-based human motion capture. Computer Vision and Image Understanding, 2001, 81(3): 231-268
44. Wang L, Hu W M, Tan T N. A survey of visual analysis of human motion. Chinese Journal of Computers, 2002, 25(3): 225-237
45. Tieu K, Viola P. Boosting image retrieval. International Journal of Computer Vision, 2004, 56(1/2/3): 17-36
46. Fablet R, Bouthemy P. Non-parametric motion activity analysis for statistical retrieval with partial query. Journal of Mathematical Imaging and Vision, 2001, 14(3): 257-270
47. Chen Y, Wang J Z. A region-based fuzzy feature matching approach to content-based image retrieval. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(9): 1252-1267
48. Stricker D, Kettenbach T. Real-time and markerless vision-based tracking for outdoor augmented reality application. IEEE and ACM International Symposium on Augmented Reality, 2001, 189-190
49. You S, Neumann U, Azuma R. Hybrid inertial and vision tracking for augmented reality registration. Proceedings of IEEE Virtual Reality, 1999, 260-267
50. Kanbara M, Yokoya N, Takemura H. A stereo vision-based augmented reality system with marker and natural feature tracking. In: Proceedings of IEEE the 7th International Conference Virtual System and Multimedia, VSMM'01. Washington, DC, USA: IEEE Press, 2001. 455-462
51. Rosenfeld A. From image analysis to computer vision: An annotated bibliography. Computer Vision and Image Understanding, 2001, 84(2): 298-324
52. Ballard D H, Brown C M. Computer Vision, Prentice-Hall, Inc, 1982
53. Horn B K, Schunck B G. Determine Optical Flow. Artificial Intelligence, 1981, 17(1-3): 185-204
54. Lucas B D, Kanade T. An iterative image-registration technique with an application to stereo vision. In: Proceedings of the International Joint Conference on Artificial Intelligence. Vancouver, BC, Canada: William Kaufmann, 1981, 674-679
55. Beauchemin S S, Barron J L. The computation of optical flow. ACM Computing Surveys, 1995, 27(3): 433-467
56. Baker S, Matthews I. Lucas-Kanade 20 years on: A unifying framework. International Journal of Computer Vision, 2004, 56(3): 221-255
57. Matsuyama T, Ukita N. Real-time multitarget tracking by a cooperative distributed vision system. Proceedings of the IEEE, 2002, 90(7): 1136-1150
58. Wachter S, Nagel H. Tracking persons in monocular image sequences. Computer Vision and Image Understanding, 1999, 74(3): 174-192
59. Zhang W J, Qi F H, Jiang Z J. A practiceal method for detecting and tracking objects in image sequences in a real-time video surveillance and monitoring system. Chinese Journal of Shanghai Jiaotong University, 2002, 36(12): 1837-1840
60. Ma S D, Zhang Z Y. Computer Vision: Calculation Theory and Algorithm Foundation, Beijing: Science Press, 1998
61. Dockstader S L, Tekalp A M. Multiple camera tracking of interacting and occluded human motion. Proceedings of the IEEE, 2001, 89(10): 1441-1455
62. Ye Y, Tsotsos J K, Harley E, Bennet K. Tracking a person with pre-recorded image database and a pan, tilt, and zoom camera. Machine Vision and Application, 2000, 12(1): 32-43
63. Smith S M, Brady J M. ASSET-2: Real-time motion segmentation and shape tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 17(8): 814-820
64. Pless R, Brodsky T, Aloimonos Y. Detecting independent motion: The statistics of temporal continuity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8): 768-773
65. Hsieh J. Fast stitching algorithm for moving object detection and mosaic construction. Image and Vision Computing, 2004, 22(4): 291-306
66. Hsu C, Tsan Y. Mosaics of video sequences with moving objects. Signal Processing: Image Communication, 2004, 19(1): 81-98
67. Wang D S, Li Z M. The technology of real-time detection and tracking for spatiall video motion object. Chinese Journal of Signal Processing, 2005, 21(2): 195-198
68. Yang Y, Zhang T. Moving target tracking based on feature-optical-flow. Chinese Journal of Astron Autics, 2000, 21(2): 8-15
69. Soares L D, Pereira F. Spatial shape error concealment for object-based image and video coding. IEEE Transactions on Image Processing, 2004, 13(4): 586-599
70. Zhao T, Nevatia R. Tracking multiple humans in complex situations. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(9): 1208-1221
71. Yu T, Wu Y. Collaborative tracking of multiple targets. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, CVPR'04, Washington, DC, USA: IEEE Press, 2004. 1: 834-841
72. McKenna S, Jabri S, Duric Z, Rosenfeld A, Wechsler H. Tracking groups of people. Computer Vision and Image Understanding, 2000, 80(1): 42-56
73. Jurie F. Tracking objects with a recognition algorithm. Pattern Recognition Letters, 1998, 19(3-4): 331-340
74. Drummond T, Cipolla R. Real-time visual tracking of complex structures. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7): 932-946
75. Leymarie F, Levine M D. Tracking deformable objects in the plane using an active contour model. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1993, 15(6): 617-624
76. Jain A K, Zhong Y, Dubuisson-Jolly M. Deformable template models: A review. Signal Processing, 1998, 71(2): 109-129
77. Delamarre Q, Faugeras O. 3D articulated models and multiview tracking with physical forces. Computer Vision and Image Understanding, 2001, 81(3): 328-357
78. Plankers R, Fua P. Tracking and modeling people in video sequences. Computer Vision and Image Understanding, 2001, 81(3): 285-302
79. Comanniciu D, Ramesh V, Meer P. Kernel-based object tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(5): 564-577
80. Oliver N M, Rosario B, Pentland A P. A Bayesian computer vision system for modeling human interactions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(8): 831-843
81. Marr D. Vision: a computational investigation into the human representation and processing of visual information, Freeman W. H. and Company, San Francisco, 1982
82. Wang S, Ai H. Z, He K. Z, Difference-image-based multiple motion targets detection and tracking. Chinese Journal of Image and Graphics, 1999, 4A(6): 470-475
83. Hou Z Q, Han C Z. A background reconstruction algorithm based on pixel intensity classification. Chinese Journal of Software, 2005, 16(9): 1568-1576
84. Bar-Shalom Y, Fortmann T. Tracking and Data Association, Academic Press, 1988
85. Julier S, Fleet D, El-Maraghi T. A new extension of the Kalman filter to nonlinear system. Proceedings of SPIE, 1997, 3068: 182-193
86. Li P, Zhang T, Ma B. Unscented Kalman filter for visual curve tracking. Image and Vision Computing, 2004, 22(2): 157-164
87. Rabiner L. A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE, 1989, 77(2): 257-285
88. Salmond D, Gordon N, Smith A. A novel approach to nonlinear/non-Gaussian Bayesian state estimation. IEE Proceedings on Radar, Sonar and Navigation, 1993, 140(2): 107-113
89. Arulampalam M, Maskell S, Gordon N, Clapp T. A tutorial on particle filters for online nonlinear/nonGaussian Bayesian tracking. IEEE Transactions on Signal Processing, 2002, 50(2): 174-188
90. Isard M, Blake A. CONDENSATION-Conditional density propagation for visual tracking. International Journal of Computer Vision, 1998, 29(1): 5-28
91. Chen Y, Rui Y. Real-time speaker tracking using particle filter sensor fusion. Proceedings of the IEEE, 2004, 92(3): 485-494
92. Wu Y, Huang T. Robust visual tracking by integrating multiple cues based on co-inference learning. International Journal of Computer Vision, 2004, 58(1): 55-71
93. Perez P, Vermaak J, Blake A. Data fusion for visual tracking with particles. Proceedings of the IEEE, 2004, 92(3): 495-513
94. Zhou S K, Chellappa R, Moghaddan B. Visual tracking and recognition using appearance-adaptive models in particle filters. IEEE Transactions on Image Processing, 2004, 13(11): 1491-1506
95. Hue C, Cader J, Perez P. Tracking multiple objects with particle filtering. IEEE Transactions on Aerospace and Electronic Systems, 2002, 38(3): 791-812
96. Spengler M, Schiele B. Towards robust multi-cue integration for visual tracking. Machine Vision and Applications, 2003, 14(1): 50-58
97. Merwe R, Doucet A, Freitas N, Wan E. The unscented particle filter, technical report CUED/F-INFENG/TR380, Engineering Department, Cambridge University Aug. 2000
98. Aggarwal J K, Nandhakumar N. On the computation of motion from sequences of images-A review. Proceedings of the IEEE, 1988, 76(8): 917-935
99. Meyer F, Bouthemy P. Region-based tracking using affine motion models in long image sequences. CVGIP: Image understanding, 1994, 60(2): 119-140
100. Bascle B, Deriche R. Region tracking through image sequences. In: Proceedings of IEEE International Conference of Computer Vision, 1995, 302-307
101. Hager G, Belhumeur P. Efficient region tracking with parametric models of geometry and illumination. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1998, 20(10): 1025-1039
102. Jepson A, Fleet D, EI-Maraghi T. Robust online appearance models for visual tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(10): 1296-1311
103. Matthews I, Ishikawa T, Baker S. The template update problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(6): 810-815
104. Nguyen H, Smeulders A. Fast occluded object tracking by a robust appearance filter. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(8): 1099-1104
105. Avidan S. Support vector tracking. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2004, 26(8): 1064-1072
106. Blac M, Jepson A. Eigentracking: Robust matching and tracking of articulated objects using a view-based representation. In: Proceedings of European Conference of Computer Vision. Cambridge, UK: Springer Verlag, 1996, 329-342
107. Krishnan S, Raviv D. 2D feature tracking algorithm for motion analysis. Pattern Recognition, 1995, 28(8): 1103-1126
108. Kaneko T, Hori O. Feature selection for reliable tracking using template matching. In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR'03. Madison, Wisconsin, USA: IEEE Press, 2003. 1: 796-802
109. MItra P, Murthy C, Pal S. Unsupervised feature selection using feature similarity. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(3): 301-312
110. Canny J F. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1986, 8(6): 679-698
111. Smith S, Brady J. SUSUN-A new approach to low level image processing. International Journal of Computer Vision, 1997, 23(1): 45-78
112. Tissainayagam P, Suter D. Object tracking in image sequences using point feature. Pattern Recognition, 2005, 38(1): 105-113
113. Nickels K, Hutchinson S. Estimating uncertainty in SSD-based feature tracking. Image and Vision Computing, 2002, 20(1): 47-58
114. Jain A K, Zhong Y. Lakshmanan, Object matching using deformable templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1996, 18(3): 267-278
115. Yu Z, Jain A K, Dubuisson-Jolly M. Object tracking using deformable templates. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(5): 544-549
116. Kass M, Witkin A, Terzopoulos D. Snakes: Active contour models. International Journal of Computer Vision, 1988, 1(4): 321-331
117. Terzopoulos D, Szeliski R. Tracking with Kalman Snakes, in Active Vision, Blake A. and Yuille A, Eds. Cambridge, MA: MIT Press, 1992. 3-20
118. Vieren C, Cabestaing F, Postaire J. Catching moving objects with snakes for motion tracking. Pattern Recognition Letters, 1995, 16(7): 679-685
119. Osher S, Sethian J A. Fronts propagating with curvature dependent speed: algorithms based on Hamilton-Jacobi formulation. Journal of Computational Physics, 1988, 79(1): 12-49
120. Malladi R, Sethian J A, Vemuri B C. Shape modeling with front propagation: A level set approach. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1995, 17(2): 158-179
121. Caselles V, Kimmel R, Sapiro G. Geodesic active contours. International Journal of Computer Vision, 1997, 22(1): 61-79
122. Paragios N, Deriche R. Geodesic active contours and level set for the detection and tracking of moving objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2000, 22(3): 266-280
123. Dgoldenberg R, Kimmel R, Rivlin E, Rudzsky M. Fast geodesic active contours. IEEE Transactions on Image Processing, 2001, 10(10): 1467-1475
124. Mansouri A. Region tracking via level set PDEs without motion computation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2002, 24(7): 947-961
125. Freedman D, Zhang T. Active Contours for tracking distributions. IEEE Transactions on Image Processing, 2004, 13(4): 518-526
126. Gerard P, Gagalowicz A. Three dimensional model-based tracking using texture learning and matching. Pattern Recognition Letters, 2000, 21(13-14): 1095-1102
127. Jung S K, Wohn K Y. A model-based 3-D tracking of rigid objects from a sequence of multiple perspective views. Pattern Recognition Letters, 1998, 19(5-6): 499-512
128. Hu W M, Tan T N, Wang L, Maybank S. A survey on visual surveillance of object motion and behaviors. IEEE Transactions on Systems, Man, and Cybernetics-Part C: Applications and Reviews, 2004, 34(3): 334-352
129. Gentile C, Camps O, Sznaier M. Segmentation for robust tracking in the presence of severe occlusion. IEEE Transactions on Image Processing, 2004, 13(2): 166-178
130. Zhang Y J. Image Engineering: Image Processing and Analysis, Beijing: Tsinghua University Press, 1999
131. Gao W, Chen X L. Computer Vision: Algorithm and System Theory. Beijing: Tsinghua University Press, 1999