Automatic indexing of underwater survey video: Algorithm and benchmarking method

IEEE Journal of Oceanic Engineering

Volumn 28, Issue 4, 2003, Pages 673-686

  Lebart, Katia ^a   Smith, Chris ^b   Trucco, Emanuele ^a   Lane, David M ^a  

^a HERIOT WATT UNIVERSITY   (United Kingdom)

^b INSTITUTE OF OCEANOGRAPHY   (Greece)

Author keywords

Change detection; Image analysis; Indexing; Light compensation; Online image processing; Underwater; Unsupervised clustering; Video

Indexed keywords

ALGORITHMS; AUTOMATIC INDEXING; BENCHMARKING; IMAGE ANALYSIS; ONLINE SYSTEMS; REAL TIME SYSTEMS; REMOTELY OPERATED VEHICLES; SURVEYS; UNDERWATER CAMERAS; UNDERWATER IMAGING; VIDEO CAMERAS;

LIGHT COMPENSATION; UNDERWATER SCIENTIFIC MISSION; UNDERWATER SURVEY VIDEO; UNSUPERVISED CLUSTERING; VIDEO IMAGES;

OCEAN ENGINEERING;

EID: 0346009249     PISSN: 03649059     EISSN: None     Source Type: Journal    
DOI: 10.1109/JOE.2003.819314     Document Type: Article

References (55)

1. K. Lebart, E. Trucco, and D. M. Lane, "Real-time automatic sea-floor change detection from video," in Proc. MTS/IEEE OCEANS '00, Providence, RI, Sept. 2000, pp. 337-343.
2. I. R. MacDonald and S. K. Juniper, "Sipping form the firehose: How to tame the data flow from ROV operations," MTS J., vol. 31, no. 3, pp. 61-67, 1997.
3. R. L. Marks, H. H. Wang, M. J. Lee, and S. M. Rock, "Automatic visual station keeping of an underwater robot," in Proc. MTS/IEEE OCEANS '94, vol. 2, Brest, France, 1994, pp. 137-142.
4. L. Jin, X. Xu, S. Negahdaripour, C. Tsukamoto, and J. Yuh, "A real-time vision-based stationkeeping system for underwater robotics applications," in Proc. MTS/IEEE OCEANS '96, vol. 3, Ft. Lauderdale, FL, 1996, pp. 1076-1081.
5. K. N. Leabourne, S. M. Rock, S. D. Fleischer, and R. Burton, "Station keeping of an ROV using vision technology," in Proc. MTS/IEEE OCEANS '97, vol. 1, Halifax, NS, Canada, 1997, pp. 634-640.
6. X. Xu and S. Negahdaripour, "Automatic optical station keeping and navigation of an R.O.V.; sea trial experiments," in Proc. MTS/IEEE OCEANS '99, vol. 1, Seattle, WA, 1999, pp. 71-76.
7. J. O. Hallset, "Simple vision tracking of pipelines for an autonomous underwater vehicle," in IEEE Int. Conf. Robotics and Automation, vol. 3, Sacramento, CA, 1991, pp. 2767-2772.
8. P. Rives and J. J. Borrelly, "Underwater pipe inspection task using visual serving techniques," in IEEE Int. Conf. Intelligent Robots and Systems vol. 1, Grenoble, France, 1997, pp. 63-68.
9. B. A. A. P. Balasuriya, M. Takai, W. C. Lam, T. Ura, and Y. Kuroda, "Vision based autonomous underwater vehicle navigation: Underwater cable tracking," in IEEE Oceans Conf. Rec., vol. 2, 1997, pp. 1418-1424.
10. J. Kojima, Y. Kato, K. Asakawa, and N. Kato, "Experimental results of autonomous underwater vehicle "aqua explorer 2" for inspection of underwater cables," in IEEE Oceans Conf. Rec., vol. 1, 1998, pp. 113-117.
11. J.-F. Lots, D. M. Lane, and E. Trucco, "Application of 2 1/2 d visual servoing to underwater vehicle station-keeping," in MTS/IEEE OCEANS '00, Providence, RI, Sept. 2000, pp. 1257-1264.
12. R. L. Marks, S. M. Rock, and M. J. Lee, "Real-time video mosaicking of the ocean floor," in Proc. 1994 Symp. Autonomous Underwater Vehicle Technology, Cambridge, MA, 1994, pp. 21-27.
13. S. D. Fleisher, R. L. Marks, S. M. Rock, and M. J. Lee, "Improved real-time video mosaicking of the ocean floor," in Proc. MTS/IEEE OCEANS '95, vol. 1, San Diego, CA, 1995.
14. S. D. Fleischer, H. H. Wang, S. M. Rock, and M. J. Lee, "Video mosaicking along arbitrary vehicle paths," in Proc. 1996 Symp. Autonomous Underwater Vehicle Technology, Monterey, CA, 1996, pp. 293-299.
15. N. Gracias and J. Santos-Victor, "Automatic mosaic creation of the ocean floor," in IEEE Oceans Conf. Rec., vol. 1, 1998, pp. 257-262.
16. J. Guo, S. W. Cheng, and J. Y. Yinn, "Underwater image mosaicking using maximum a posteriori image registration," in Proc. 2000 Int. Symp. Underwater Technology, Tokyo, Japan, May 23-26, 2000, pp. 393-398.
17. A. Khamene and S. Negahdaripour, "Building 3-d elevation maps of sea-floor scenes from underwater stereo images," in Proc. MTS/IEEE OCEANS '99, vol. 1, Seattle, WA, 1999, pp. 64-70.
18. H. Singh, J. Howland, and D. Yoerger, "Quantitative photomosaicking of underwater imagery," in Proc. MTS/IEEE OCEANS '98, vol. 1, Nice, France, 1998.
19. D. Wettergreen, C. Gaskett, and A. Zelinsky, "Development of a visually-guided autonomous underwater vehicle," in Proc. MTS/IEEE OCEANS '98, vol. 1, Nice, France, 1998.
20. S. Negadaripour, X. Xu, A. Khamene, and Z. Awan, "3-D motion and depth estimation from sea-floor images for mosaic-based station-keeping and navigation of rovs/auvs and high-resolution sea-floor mapping," in Proc. 1998 Workshop on Autonomous Underwater Vehicles, Cambridge, MA, 1998, pp. 191-200.
21. A. Huster, S. D. Fleischer, and S. M. Rock, "Demonstration of a vision-based dead-reckoning system for navigation of an underwater vehicle," in Proc. IEEE Symp. Autonomous Underwater Vehicle Technology, Cambridge, MA, 1998, pp. 185-189.
22. S. D. Fleischer, S. M. Rock, and R. Burton, "Global position determination and vehicle path estimation from a vision sensor for real-time video mosaicking and navigation," in IEEE Oceans Conf. Rec., vol. 1, Halifax, NS, Canada, 1997, pp. 641-647.
23. R. Garcia, J. Batlle, X. Cufi, and J. Amat, "Positioning an underwater vehicle through image mosaicking," in IEEE Int. Conf. Robotics and Automation, vol. 3, Seoul, Korea, 2001, pp. 2779-2784.
24. X. Xu and S. Negahdaripour, "Application of extended covariance intersection principle for mosaic-based optical positioning and navigation of underwater vehicles," in IEEE Int. Conf. Robotics and Automation, vol. 3, Seoul, Korea, 2001, pp. 2759-2766.
25. S. Negahdaripour, X. Xu, and L. Jin, "Direct estimation of motion from sea floor images for automatic station-keeping of submersible platforms," IEEE J. Oceanic Eng., vol. 24, pp. 370-382, July 1999.
26. S. Negahdaripour, C. H. Yu, and A. H. Shokrollahi, "Recovering shape and motion from undersea images," IEEE J. Oceanic Eng., vol. 15, pp. 189-198, July 1990.
27. S. Negahdaripour, "Revised definition of optical flow: Integration of radiometric and geometric cues for dynamic scene analysis," IEEE Trans. Pattern Anal. Machine Intell., vol. 20, pp. 961-979, Sept. 1998.
28. F. Spindler and P. Bouthemy, "Real-time estimation of dominant motion," in IEEE Int. Conf. Robotics and Automation, Leuven, Belgium, 1998, pp. 1063-1068.
29. C. Plakas and E. Trucco, "Developing a real-time, robust, video, tracker," in MTS/IEEE OCEANS '00, Providence, RI, 2000, pp. 1345-1352.
30. A. Branca, E. Stella, and A. Distante, "Autonomous navigation of underwater vehicles," in Proc. MTS/IEEE OCEANS '98, Nice, France, 1998.
31. T. Tommasini, A. Fusiello, V. Roberto, and E. Trucco, "Robust feature tracking in underwater video sequences," in Proc. MTS/IEEE OCEANS '98, Nice, France, 1998.
32. F. Aguirre, J. M. Boucher, and J. J. Jacq, "Underwater navigation by video sequence analysis," in Proc. 10th Int. Conf. Pattern Recognition, vol. ii, Atlantic City, NJ, 1990, pp. 537-539.
33. S. M. Zanoli and P. Zingaretti, "Underwater imaging system to support ROV guidance," in IEEE Oceans Conf. Rec., vol. 11, 1998, pp. 257-268.
34. P. Zingaretti and S. M. Zanoli, "Robust real-time detection of an underwater pipeline," Eng. Applicat. Artificial Intell., vol. 11, no. 2, pp. 257-268, 1998.
35. A. Grau, J. Climent, and J. Aranda, "Real-time architecture for cable tracking using texture descriptors," in IEEE Oceans Conf. Rec., vol. 3, Nice, France, 1998.
36. A. J. R. Fairweather, A. R. Greig, and M. Hodgetts, "Robust scene interpretation of underwater image sequences," in Proc. 1997 6th Int. Conf. Image Processing and Its Applications., vol. 442/443, Dublin, Ireland, 1997, pp. 660-664.
37. S. Matsumoto and Y. Ito, "Real-time vision-based tracking of submarine cables for AUV/ROV," in Proc. MTS/IEEE OCEANS '95 Conf., vol. 3, San Diego, CA, 1995, pp. 1997-2002.
38. A. Ortiz, G. Olivier, and J. Frau, "A vision system for underwater real-time control tasks," Proc. MTS/IEEE OCEANS '97 Conf., vol. 2, pp. 1425-1430, Oct. 6-9, 1997.
39. G. L. Foresti, S. Gentili, and M. Zampato, "Vision-based system for autonomous underwater vehicle navigation," in IEEE Oceans Conf. Rec., vol. 1, 1998, pp. 195-199.
40. J. Kojima, Y. Kato, and K. Asakawa, "Autonomous underwater vehicle for inspection of submarine cables," in Proc. Int. Offshore and Polar Engineering Conf., vol. 2, Brest, France, 1999, pp. 458-462.
41. Y. Petillot, K. Lebart, A. Cormack, and D. Lane, "Seetrack, a system for post mission analysis of AUVdata products," in Proc. GOATS '00 Conf. La Spezia, Italy, 2001.
42. D. M. Kocak, N. da Vitoria Lobo, and E. Widder, "Computer vision techniques for quantifying, tracking, and identifying bioluminescent plankton," IEEE J. Oceanic Eng., vol. 24, pp. 81-95, Jan. 1999.
43. R. Li, H. Li, W. Zou, R. G. Smith, and T. A. Curran, "Quantitative photogrammetric analysis of digital underwater video imagery," IEEE J. Oceanic Eng., vol. 22, pp. 364-375, Apr. 1997.
44. C.-Y. Park, S.-H. Park, C.-W. Kim, J.-K. Kang, and K.-H. Kim, "Image analysis technique for exploration of manganese nodules," Marine Georesources and Geotechnology, vol. 17, pp. 371-386, 1999.
45. J. Rife and S. M. Rock, "Visual tracking of jellyfish in situ," in Proc. Int. Conf. Image Processing, vol. 1, Thessaloniki, Greece, 2001, pp. 289-292.
46. A. Olmos, E. Trucco, K. Lebart, and D. M. Lane, "Detecting ripple patterns in mission videos," in Proc. MTS/IEEE OCEANS '00, Providence, RI, Sept. 2000, pp. 331-335.
47. N. Pican, E. Trucco, M. Ross, D. M. Lane, Y. Petillot, and I. Tena Ruiz, "Texture analysis for seabed classification: Co-occurrence matrices vs. self-organizing map," in IEEE/OES OCEANS '98 Conf., Nice, France, Sept. 1998.
48. M. Soriano, S. Marcos, C. Salorna, M. Quibilan, and P. Alino, "Image classification of coral reef components from underwater color video," in Proc. MTS/IEEE OCEANS '01 Conf., vol. 2, 2001, pp. 1008-1013.
49. R. Brunelli, O. Mich, and C. M. Modena, "A survey on the automatic indexing of video data," J. Visual Commun. Image Representat., vol. 10, pp. 78-112, 1999.
50. J. S. Boreczky and L. A. Rowe, "Comparison of video shot boundary detection techniques," in Proc. SPIE, Storage and Retrieval for Still Image and Video Databases IV, vol. 2670, San Jose, CA, 1996, pp. 170-179.
51. H. H. Yu and W. Wolf, "A hierarchical multiresolution video shot transition detection scheme," Comput. Vision Image Understanding, vol. 75, no. 1/2, pp. 196-213, 1999.
52. B. Gunsel, A. M. Ferman, and A. M. Tekalp, "Temporal video segmentation using unsupervised clustering and semantic object tracking," J. Electron. Imaging, vol. 7, no. 3, pp. 592-604, 1998.
53. F. Bremond and M. Thonnat, "Issues of representing context illustrated by video-surveillance applications," Int. J. Human-Computer Stud., vol. 48, pp. 375-391, 1998.
54. A. K. Jain, R. P. W. Duin, and J. Ma, "Statistical pattern recognition: A review," IEEE Trans. Pattern Anal. Machine Intell., vol. 22, 2000.
55. S. Theodoridis and K. Koutroumbas, Pattern Recognition. New York: Academic, 1998.