Video tracking: A concise survey

IEEE Journal of Oceanic Engineering

Volumn 31, Issue 2, 2006, Pages 520-529

  Trucco, Emanuele ^a   Plakas, Konstantinos ^a  

^a HERIOT WATT UNIVERSITY   (United Kingdom)

Author keywords

Imaga processing; Underwater vision; Video tracking

Indexed keywords

ALGORITHMS; COMPUTER VISION; TRACKING (POSITION); UNDERWATER IMAGING;

UNDERWATER VISION; VIDEO SEQUENCE; VIDEO TRACKING;

VIDEO SIGNAL PROCESSING;

EID: 33750114884     PISSN: 03649059     EISSN: None     Source Type: Journal    
DOI: 10.1109/JOE.2004.839933     Document Type: Review

References (112)

1. J.-F. Lots, D. M. Lane, E. Trucco, and F. Chaumette, "A 2-d visual servoing for underwater vehicle station keeping," in IEEE Conf. Robot. Automat., Seoul, Korea, May 2001, pp. 2767-2772.
2. F. Spindler and P. Bouthemy, "Real-time estimation of dominant motion in underwater video images for dynamic positioning," in Proc. IEEE Int. Conf. Robot. Automat., 1998, pp. 1063-1068.
3. A. J. Woods, J. D. Penrose, A. J. Duncan, R. Koch, and D. Clark, "Improving the operability of remotely operated vehicles," Australian Petroleum Production and Exploration Associated (APPEA) J., vol. 1, pp. 849-854, 1998.
4. R. Marks, H. Wang, M. Lee, and S. Rock, "Automatic visual station keeping of an underwater robot," in Proc. IEEE Int. Conf. Robot. Automat., vol. 2, 1994, pp. 137-142.
5. N. Gracias and J. Santos-Victor, "Underwater video mosaics as visual navigation maps," Comput. Vis. Image Understanding, vol. 79, no. 1, pp. 66-91, 2000.
6. M. Simo, A. Ortiz, and G. Oliver, "A vision system for an underwater cable tracker," Mach. Vis. Applications, vol. 13, pp. 129-140, 2002.
7. N. Stagg, "Better roving through advanced telerobotics," Underwater Mag., vol. Fall, 1995.
8. H. Singh, L. Whitcomb, D. Yoerger, and O. Pizarro, "Microbathymetric mapping from underwater vehicles in the deep ocean," Comput. Vis. Image Understanding, vol. 79, no. 1, pp. 143-161, 2000.
9. E. Trucco, Y. R. Petillot, I. Tena Ruiz, K. Plakas, and D. M. Lane, "Feature tracking in video and sonar subsea sequences with applications," Comput. Vis. Image Understanding, vol. 79, no. 1, pp. 92-122, 2000.
10. S. Negahdaripour and X. Xu, "Mosaic-based positioning and improved motion estimation methods for automatic navigation of submersible vehicles," IEEE J. Ocean. Eng., vol. 27, no. 1, pp. 79-99, Jan. 2002.
11. N. Gracias, S. Zwaan, A. Bernardino, and J. Santos-Victor, "Mosaic based navigation for autonomous underwater vehicles," IEEE J. Ocean. Eng., vol. 28, no. 4, pp. 609-624, Oct. 2003.
12. P. S. Maybeck, Stochastic Models, Estimation and Control. London, U.K.: Academic, 1979, vol. 1, 2.
13. G. S. Manku, P. Jain, A. Aggarwal, and L. Kumar, "Object tracking using affine structure for point correspondence," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1997, pp. 704-709.
14. L. Matthies, T. Kanade, and R. Szelisky, "Kalman filter based algorithms for estimating depth from image sequences," Int. J. Comput. Vis., vol. 3, pp. 209-236, 1989.
15. L. S. Shapiro, H. Wang, and J. M. Brady, "A matching and tracking strategy for independently moving objects," in Proc. British Machine Vision Conf., 1992, pp. 306-315.
16. Y. Yao and R. Chellappa, "Dynamic feature point tracking in an image sequence," in Proc. Int. Conf. Pattern Recog., vol. 1, 1994, pp. 654-657.
17. M. Zampato, R. Pistellato, D. Maddalena, and I. Bruno, "Visual motion estimation for tumbling satellite capture," in Proc. British Machine Vision Conf., vol. 2, 1996, pp. 565-574.
18. A. Baumberg and D. Hogg, "Learning flexible models from image sequences," in Proc. Eur. Conf. Comput. Vis., J.-O. Ekhlund, Ed., 1994, pp. 299-308.
19. O. Faugeras, Three-Dimensional Computer Vision: A Geometric Viewpoint. Cambridge, MA: The MIT Press, 1993.
20. D. Scharstein and R. Szeliski, "A taxomony and evaluation of dense two-frame stereo correspondence algorithms," Int. J. Comput. Vis., vol. 47, pp. 7-42, 2002.
21. E. Trucco and A. Verri, Introductory Techniques for 3-D Computer Vision. Englewood Cliffs, NJ: Prentice-Hall, 1998.
22. Y. Bar-Shalom and T. E. Fortmann, Tracking and Data Association. London, U.K.: Academic, 1988.
23. M. Isard and A. Blake, "Condensation - Conditional density propagation for visual tracking," Int. J. Comput. Vis., vol. 29, no. 1, pp. 5-28, 1998.
24. M. Isard. (1999) Condensation Home Page. [Online] www.dai.ed.ac.uk/ CVONLINE
25. C. Fuh and P. Maragos, "Motion displacement estimation using an affine model for matching," Opt. Eng., vol. 30, no. 7, pp. 881-887, 1991.
26. R. Manmatha and J. Oliensis, "Extracting affine deformations from image patches - I: Finding scale and rotation," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1993, pp. 754-755.
27. F. Isgrò, E. Trucco, and L.-Q. Xu, "Toward teleconferencing by view synthesis and large-baseline stereo," in Proc. Int. Conf. Image Anal. Process., 2001, pp. 198-203.
28. P. J. Narayanan, P. W. Rander, and T. Kanade, "Constructing virtual worlds using dense stereo," in Proc. IEEE Int. Conf. Comput. Vis., 1998, pp. 3-10.
29. T. Tommasini, A. Fusiello, V. Roberto, and E. Trucco, "Robust feature tracking in underwater video sequences," in Proc. OCEANS'98, vol. 1, Nice, France, Sep. 1998, pp. 46-50.
30. L. Bretzner and T. Lindeberg, "Feature tracking with automatic selection of spatial scale," Comput. Vis. Image Understanding, vol. 71, no. 3, pp. 385-391, 1998.
31. H. Gu, M. Asada, and Y. Shirai, "The optimal partition of moving edge segments," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1993, pp. 367-372.
32. E. Hayman, T. Thorhallsson, and D. Murray, "Zoom-invariant tracking using points and lines in affine views," in Proc. IEEE Int. Conf. Comput. Vis., 1999, pp. 269-277.
33. T. Vieville and O. Faugeras, "Robust and fast computation of edge characteristics in image sequences," Int. J. Comput. Vis., vol. 10, no. 2, pp. 153-179, 1994.
34. R. Deriche and O. Faugeras, "Tracking line segments," in Proc. Eur. Conf. Comput. Vis., O. Faugeras, Ed., 1990, pp. 259-268.
35. C. Harris, "Tracking with rigid models," in Active Vis., A. Blake and A. Yuille, Eds., 1992, pp. 59-73.
36. D. Lowe, "Robust model-based motion tracking through the integration of search and estimation," Int. J. Comput. Vis., vol. 8, pp. 113-122, 1992.
37. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. British Machine Vis. Conf., 1988, pp. 147-151.
38. R. Deriche and G. Giraudon, "A computational approach for corner and vertex detection," Int. J. Comput. Vis., vol. 10, no. 2, pp. 101-124, 1993.
39. H. Wang and M. Brady, "Real-time corner detection algorithm for motion estimation," Image Vis. Comput., vol. 13, no. 9, pp. 695-705, 1995.
40. J. Shi and C. Tomasi, "Good features to track," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1994, pp. 593-600.
41. S. Smith. (1999) Literature Review on Feature-based Tracking Approaches. [Online]. Available: http://www.dai.ed.ac.uk/CVonline/motion.htm
42. D. Forsyth and J. Ponce, Computer Vision: A Modern Approach. Englewood Cliffs, NJ: Prentice-Hall, 2002.
43. F. R. Hampel, P. J. Rousseeuw, E.M. Ronchetti, and W. A. Stahel, Robust Statistics: The Approach Based on Influence Functions, ser.Wiley Series in probability and mathematical statistics. New York: Wiley, 1986.
44. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, U.K.: Cambridge Univ. Press, 2002.
45. E. Trucco, A. Doull, F. Odone, A. Fusiello, and D. M. Lane, "Dynamic video mosaics and augmented reality for subsea inspection and monitoring," in Oceanol. Int. 2000, Brighton, U.K., Mar. 2000.
46. K. Plakas, "Video sequence analysis for subsea robotics," Ph.D. dissertation, Heriot-Watt Univ., Edinburgh, U.K., 2001.
47. S. Negahdaripour, "Revised definition of optical flow: Integration of radiometric and geometric cues for dynamic scene analysis," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 9, pp. 961-979, Sep. 1998.
48. B. D. Lucas and T. Kanade, "An iterative image registration technique with an application to stereo vision," in Proc. Int. Joint Conf. Artif. Intell., 1981, pp. 674-679.
49. B. K. P. Horn and B. G. Schunk, "Determining optical flow," Artif. Intell., vol. 17, pp. 185-203, 1981.
50. J. L. Barron, D. J. Fleet, and S. Beauchemin, "Performance of optical flow techniques," Int. J. Comput. Vis., vol. 12, no. 1, pp. 43-77, 1994.
51. A. Mitchie and P. Bouthemy, "Computation and analysis of image motion: A synopsis of current problems and methods," Int. J. Comput. Vis., vol. 19, no. 1, pp. 29-55, 1996.
52. D. Halevy and D. Weinshall, "Motion of disturbances: Detection and tracking of multi-body rigid motion," Mach. Vis. Applicat., vol. 11, pp. 122-137, 1999.
53. Q. Cai and J. K. Aggarwal, "Tracking human motion in structured environments using a distributed-camera system," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 12, pp. 1241-1247, Dec. 1999.
54. I. Haritaoglu, D. Harwood, and L. S. Davis, "W4: Real-time surveillance of people and their activities," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 809-830, Aug. 2000.
55. W. M. Lu and Y.-P. Tan, "A color histogram based people tracking system," in Proc. IEEE Int. Symp. Circuits Syst., Sydney, Australia, 2001, pp. 137-140.
56. B. Bascle and R. Deriche, "Region tracking through image sequences," in Proc. IEEE Int. Conf. Comput. Vis., 1995, pp. 302-307.
57. J. Crisman, "Color region tracking for vehicle guidance," in Active Vis., A. Blake and A. Yuille, Eds., 1992, pp. 107-120.
58. J. Orwell, P. Remagnino, and G. A. Jones, "Multi-camera color tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1999, pp. 117-123.
59. P. Kornprobst and G. Medioni, "Tracking segmented objects using tensor voting," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2000, pp. 118-125.
60. G. Hager and P. Belhumeur, "Real-time tracking of image regions with changes of geometry and illumination," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 1996, pp. 403-410.
61. K. Kanatani, Geometric Computation for Machine Vision. Oxford, U.K.: Oxford Univ. Press, 1993.
62. P. Wunsch and G. Hirzinger, "Real-time visual tracking of 3-d objects with dynamic handling of occlusions," in Proc. IEEE Int. Conf. Robot. Automat., 1997, pp. 2868-2873.
63. B. Espiau, F. Chaumette, and P. Rives, "A new approach to visual servoing in robotics," IEEE Trans. Robot. Automat., vol. 8, no. 3, pp. 313-325, Jun. 1992.
64. E. Marchand and G. D. Hager, "Dynamic sensor planning in visual servoing," in Proc. IEEE Int. Conf. Robot. Automat., vol. 1, 1998, pp. 1988-1993.
65. C. E. Smith and N. P. Papanikolopoulos, "Grasping of static and moving objects using a vision-based control approach," J. Intell. Robot. Syst., vol. 19, pp. 237-270, 1997.
66. P. Wunsch and G. Hirzinger, "Registration of cad models to images by iterative inverse perspective matching," in Proc. Int. Conf. Pattern Recognit., 1996, pp. 77-83.
67. A. Worrall, G. Sullivan, and K. Baker, "Pose refinement of active models using forces in 3d," in Proc. Eur. Conf. Comput. Vis., 1994, pp. 341-350.
68. P. Besl and N. McKay, "A method for registration of 3-d shapes," IEEE Trans. Pattern Anal. Mach. Intell., vol. 14, no. 2, pp. 239-256, Feb. 1992.
69. E. Trucco, A. Fusiello, and V. Roberto, "Robust motion and correspondences of 3-d point sets with missing data," Pattern Recognit. Lett., vol. 20, no. 9, pp. 889-898, 1999.
70. M. Kass, A. Witkin, and D. Terzopoulos, "Snakes: Active contour models," in Proc. IEEE Int. Conf. Comput. Vis., 1987, pp. 259-268.
71. D. Terzopoulos and R. Szeliski, "Tracking with kalman snakes," in Active Vis., A. Blake and A. Yuille, Eds., 1992, pp. 3-20.
72. L. D. Cohen, "On active contour models and balloons," Comput. Vis. Image Understanding, vol. 53, no. 2, pp. 211-218, 1991.
73. Y. Fu, A. Tanju Erdem, and A. Murat Tekalp, "Tracking visible boundaries of objects using occlusion adaptive motion snakes," IEEE Trans. Image Process., vol. 9, no. 12, pp. 2051-2060, Dec. 2000.
74. A. Giachetti and V. Torre, "Optical flow and deformable objects," in Proc. IEEE Int. Conf. Comput. Vis., 1995, pp. 706-711.
75. D. M. Kocak, N. da Vitoria Lobo, and E. A. Widder, "Computer vision techniques for quantifying, tracking, and identifying bioluminescent plankton," IEEE J. Ocean. Eng., vol. 24, no. 1, pp. 81-95, Jan. 1999.
76. S. Reed, Y. R. Petillot, and J. M. Bell, "An automatic approach to the detection and extraction of mine features in sidescan sonar," IEEE J. Ocean. Eng., vol. 28, no. 1, pp. 90-105, Jan. 2003.
77. R. Bartels, J. Beatty, and B. Barsky, An Introduction to Splines for Use in Computer Graphics and Geometric Modeling. San Mateo, CA: Morgan Kaufmann, 1997.
78. A. Blake and M. Isard, Active Contours. London, U.K.: Springer-Verlag, 1998.
79. Y. Ricquebourg and P. Bouthemy, "Real-time tracking of moving persons by exploiting spatio-temporal image slices," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 8, pp. 797-808, Aug. 2000.
80. Y. Zhong, A. Jain, and M.-P. Dubuisson-Jolly, "Object tracking using deformable templates," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 5, pp. 544-549, May 2000.
81. T. Cootes, A. Hill, C. Taylor, and J. Haslam, "The use of active shape models for locating structure in medical images," Int. J. Comput. Vis., vol. 12, no. 6, pp. 356-366, 1994.
82. A. Yuille and P. Hallinan, "Deformable templates," in Active Vision, A. Blake and A. Yuille, Eds., 1992, pp. 21-38.
83. R. Tillett, N. McFarlane, and J. Lines, "Estimating dimensions of freeswimming fish using 3-d point distribution models," Comput. Vis. Image Understanding, vol. 79, pp. 123-141, 2000.
84. M. Bertalmio, G. Sapiro, and G. Randall, "Morphing active contours," IEEE Trans. Pattern Anal. Mach. Intell., vol. 22, no. 7, pp. 733-737, Jul. 2000.
85. M. Black and A. Jepson, "Eigentracking: Robust matching and tracking of articulated objects using a view-based representation," in Proc. Eur. Conf. Comput. Vis., G. Sandini, Ed., 1996, pp. 328-342.
86. S. Nayar and T. Poggio, Early Visual Learning. Oxford, U.K.: Oxford Univ. Press, 1996.
87. M. Pontil and A. Verri, "Object recognition with support vector machines," IEEE Trans. Pattern Anal. Mach. Intell., vol. 20, no. 6, pp. 637-646, Jun. 1998.
88. S. Avidan, "Support vector tracking," in Proc. IEEE Conf. Comput. Vis. Pattern Recognit., 2001, pp. 283-310.
89. H. Murase and N. Nayar, "Visual learning and recognition of 3-d objects from appearance," Int. J. Comput. Vis., vol. 14, pp. 5-24, 1995.
90. T. Cootes, G. Edwards, and C. Taylor, "Active appearance models," IEEE Trans. Pattern Anal. Mach. Intell., vol. 23, no. 6, pp. 681-685, Jun. 2001.
91. J. S. Jaffe, "Computer modeling and the design of optimal underwater imaging systems," IEEE J. Ocean. Eng., vol. 15, no. 2, pp. 101-111, Apr. 2000.
92. N. Paragios and R. Deriche, "A pde-based level set approach for detection and tracking of moving objects," in Proc. IEEE Int. Conf. Comput. Vis., 1998, pp. 1139-1145.
93. Y. Rzhanov, L. M. Linnett, and R. Forbes, "Underwater video mosaicing for seabed mapping," Proc. Image Process., vol. 1, pp. 224-227, 2000.
94. Y. Rzhanov, L. Huff, and R. Cutter, "Improvement of image alignment using camera attitude information," in 6th Int. Symp. Image Process. Applicat., vol. 2, 2001, pp. 639-642.
95. J. Rife and S. Rock, "Visual tracking of jellyfish in situ," in Proc. Int. Conf. Image Process., vol. 1, 2001, pp. 289-292.
96. S. Fleischer, H. Wang, S. Rock, and M. Lee, "Video mosaicking along arbitrary vehicle paths," in Proc. Int. Symp. Autonomous Underwater Vehicle Technol., 1996, pp. 293-299.
97. S. Fleischer, S. Rock, and R. Burton, "Global position determination and vehicle path estimation from a vision sensor for real-time video mosaicking and navigation," in Proc. OCEANS Conf., vol. 1, 1997, pp. 641-647.
98. A. Balasuriya and T. Ura, "Autonomous underwater vehicle navigation scheme for cable following," in Proc. Int Conf. Intell. Transport. Syst., 2001, pp. 519-524.
99. R. Li, H. Li, W. Zou, R. Smith, and T. Curan, "Quantitative photogrammetric analysis of digital underwater video imagery," IEEE J. Ocean. Eng., vol. 22, no. 2, pp. 364-375, Apr. 1997.
100. R. Eustice, H. Singh, and J. Howland, "Image registration underwater for fluid flow measurements and mosaicking," in Proc. OCEANS Conf., vol. 3, 2000, pp. 1529-1534.
101. F.-X. Espiau and P. Rives, "Extracting robust features and 3d reconstruction in underwater images," in Proc. OCEANS Conf., vol. 4, 2001, pp. 2564-2569.
102. M. Simo, A. Ortiz, and G. Oliver, "Optimized image sequence analysis for real-time underwater cable tracking," in Proc. OCEANS Conf., vol. 1, 2000, pp. 497-504.
103. D. Wettergreen, C. Gaskett, and A. Zelinsky, "Development of a visually-guided autonomous underwater vehicle," in Proc. OCEANS Conf., vol. 2, 1998, pp. 1200-1204.
104. K. Nishihara, "Practical real-time imaging stereo matcher," Opt. Eng., vol. 23, pp. 536-545, 1984.
105. C. Silpa-Anan, T. Brinsmead, S. Abdallah, and A. Zelinsky, "Preliminary experiments in visual servo control for autonomous underwater vehicle," in Proc. Int Conf. Intell. Robots and Syst., 2001, pp. 1824-1829.
106. S. Negahdaripour and P. Firoozfam, "Positioning and photo-mosaicking with long image sequences: Comparison of selected methods," in Proc. OCEANS Conf., Nice, France, 2001, pp. 2584-2592.
107. P. Firoozfam and S. Negahdaripour, "Reliability analysis of parameter estimation in linear models with applications to mensuration problems in computer vision," in Proc. OCEANS Conf., vol. 3, 2002, pp. 1595-1602.
108. M. Minami, J. Agbanhan, and T. Asakura, "Manipulator visual servoing and tracking of fish using genetic algorithms," Indust. Robot, vol. 26, no. 4, pp. 278-289, 1999.
109. P. Lagstad, "Detecting linear motion of an object in a sequence of monocular underwater images," in Proc. Int. Symp. Autonomous Underwater Vehicle Technol., 1996, pp. 343-347.
110. G. Conte, S. Zanoli, A. Perdon, G. Tascini, and P. Zingaretti, "Automatic analysis of visual data in submarine pipeline inspection," in Proc. OCEANS Conf., vol. 3, Sep. 1996, pp. 1213-1219.
111. K. Plakas, E. Trucco, and A. Fusiello, "Uncalibrated vision for 3-D underwater applications," in Proc. OCEANS Conf., Nice, France, Sep. 1998, pp. 272-276.
112. V. D. Gesú, F. Isgró, D. Tegolo, and E. Trucco, "Finding essential features for tracking starfish in a video sequence," in Proc. IAPR Int. Conf. Image Anal. Process., Mantova, Italy, Sep. 2003, pp. 504-509.