Stereovision imaging on submersible platforms for 3-D mapping of benthic habitats and sea-floor structures

IEEE Journal of Oceanic Engineering

Volumn 28, Issue 4, 2003, Pages 625-650

  Negahdaripour, Shahriar ^a   Madjidi, Hossein ^a  

^a UNIVERSITY OF MIAMI   (United States)

Author keywords

Automated ROV visual navigation; Stereovision; Underwater 3 D mapping

Indexed keywords

COMPUTER SIMULATION; DATA ACQUISITION; IMAGE RECONSTRUCTION; KALMAN FILTERING; OCEAN HABITATS; REMOTELY OPERATED VEHICLES; STEREO VISION; SUBMERSIBLES; THREE DIMENSIONAL;

AUTOMATED REMOTELY OPERATED VEHICLES VISUAL NAVIGATION; BENTHIC HABITATS; SEA-FLOOR STRUCTURES; STEREOVISION IMAGING; UNDERWATER THREE DIMENSIONAL MAPPING;

UNDERWATER IMAGING;

EID: 0346640448     PISSN: 03649059     EISSN: None     Source Type: Journal    
DOI: 10.1109/JOE.2003.819313     Document Type: Article

References (76)

1. G. Adiv, "Inherent ambiguities in recovering 3-D motion and structure from a noisy flow field," IEEE Trans. Pattern Anal. Machine Intell., vol. PAMI-11, pp. 477-489, May 1986.
2. A. A. Argyros and F. Bergholm, "Combining central and peripheral vision for reactive robot navigation," Proc. IEEE Computer Vision Pattern Recognition, pp. 646-651, June 1999.
3. K. B. Atkinson, Close Range Photogrammetry and Machine Vision. Caithness, U.K.: Whittles, 1996.
4. D. H. Ballard and O. A. Kimball, "Rigid body motion from depth and optical flow," Comp. Vision, Graphics, Image Process., vol. 22, no. 1, pp. 95-115, 1983.
5. B. A. J. Barker, D. L. Davis, and G. P. Smith, "The calibration of laser-referenced underwater cameras For quantitative assessment of marine resources," in Proc. OCEANS'01, Honolulu, HI, Nov. 2001, pp. 1854-1859.
6. S. Baten, M. Ltzeler, E. D. Dickmanns, R. Mandelbaum, and P. J. Burt, "Techniques for autonomous, off-road navigation," IEEE Intell. Syst., vol. 13, pp. 57-65, Nov. 1998.
7. M. Bernsten, "Principles and practice of acoustic systems," Int. Underwater Syst. Design, vol. 14, no. 1, 1992.
8. H. V. Calcar, "What you need to know to improve LBL submersible tracking and performance," in Proc. ROV'85, 1985, pp. 43-51.
9. R. N. Carpenter, "Concurrent mapping and localization with FLS," in Proc. Workshop Autonomous Underwater Vehicles, Cambridge, MA, 1998, pp. 133-148.
10. D. J. Chen and E. Alvardo, "Ultrashort baseline navigation for the sea squirt AUV," in Proc. UUST Symp., Durham, NH, 1991, pp. 644-649.
11. M. Chen, T. Jochem, and D. Pomerleau, "AURORA: A vision-based roadway departure warning system," Carnegie Mellon Univ., Robotics Inst., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-97-21, 1997.
12. I. Davis and A. Stentz, "Sensor fusion for autonomous outdoor navigation using neural networks," Proc. IEEE/RSJ Int. Conf. Intelligent Robotic Syst. (IROS'95), vol. 3, pp. 338-343, Aug. 1995.
13. D. L. Davis and R. F. Tusting, "Quantitative benthic photography using laser calibrations," in Proc. UnderSea World, San Diego, CA, 1991.
14. G. Dudek, M. Jenkin, and E. Milios, Robotic and Manufacturing Systems - Recent Results in Research, Development and Applications in Topological Exploration of Unknown Environments with Multiple Robots, M. Jamshidi, F. Pierrot, and M. Kamel, Eds. Albuquerque, NM: TSI, 1996.
15. S. English, C. Wilkinson, and V. Baker, Survey Manual for Tropical Marine Resources, 2 ed. Townsville, Australia: Australia Inst. Marine Sci., 1996, p. 402.
16. R. Eustice, H. Singh, and J. Howland, "Image registration underwater for fluid flow measurements and photomosaicking," in MTS/IEEE Oceans Conf., Providence, RI, 2000.
17. S. D. Fleischer, H. W. Wang, S. M. Rock, and M. J. Lee, "Video mosaicking along arbitrary vehicle paths," in Proc. Symp. AUV Technol., Monterey, CA, June 1996, pp. 293-299.
18. S. D. Fleischer and S. M. Rock, "Global position determination and vehicle path estimation from a vision sensor for real-time mosaiking and navigation," in Proc. Oceans, Halifax, NS, Canada, Oct. 1997, pp. 641-647.
19. R. Gershon, M. Benady, and T. Shalom, "3D reconstruction from multiple 2D views using tri-linear tensor technology," in SPIE Photonics West Conf., San Jose, CA, Jan. 2001, pp. 32-39.
20. E. M. Geyer, P. M. Creamer, J. A. D'Appolito, and R. G. Gains, "Characteristics and capabilities of navigation systems for unmanned untethered submersibles," in Proc. UUST Symp., Durham, NH, 1987, pp. 320-347.
21. N. Gracias and J. Santos-Victor, "Underwater video mosaics as visual navigation maps," Comput. Vision Image Understanding, vol. 79, pp. 66-91, July 2000.
22. N. Gracias and J. Santos-Victor, "Underwater mosaicking and trajectory reconstruction using global alignment," in Proc. OCEANS'01, Honolulu, HI, Nov. 2001, pp. 2557-2563.
23. R. Hartley and A. Zisserman, Multiple View Geometry. Cambridge, U.K.: Cambridge Univ. Press, 2000.
24. T. Heimonen, J. Hannuksela, J. Heikkil, J. Leinonen, and M. Manninen, "Experiments in 3D measurements by using single camera and accurate motion," Proc. IEEE Int. Symp. Assembly Task Planning (ISATP'01), pp. 356-361, May 2001.
25. R. A. Hirvonen, "Adjustment by least squares in geodesy and photogrammetry,". New York: Frederick Ungar, 1971.
26. A. Howard and H. Seraji, "An intelligent terrain-based navigation system for planetary rovers," IEEE Robot. Automat. Mag., pp. 9-17, Dec. 2001.
27. J. S. Jaffe and K. D. Moore, "Development and testing of a new underwater three dimensional imaging system: 3D sea scan," in Proc. Mine Countermeasures Symp., Monterey, CA, Feb. 2000.
28. A. Khamene, "Motion and Structure from Multiple Cues; Optical Flow, Shading Flow, and Stereo Disparity," Ph.D. Dissertation, Univ. Miami, ECE Dept., Coral Gables, FL, 2000.
29. A. Khamene, H. Madjidi, and S. Negahdaripour, "3-D mapping of sea floor scenes by stereo imaging," in Proc. Oceans'01, Honolulu, HI, Nov. 2001, pp. 2577-2583.
30. K. N. Leabourne, S. M. Rock, S. D. Fleischer, and R. L. Burton, "Station keeping of an ROV using vision technology," in Proc. Oceans'97, Halifax, NS, Canada, Oct. 1997, pp. 634-640.
31. E. A. LeMaster, M. Matsuoka, and S. M. Rock, "Field demonstration of a Mars navigation system utilizing GPS pseudolite transceivers," in Proc. IEEE Position, Location, Navigation Symp., Palm Springs, CA, Apr. 2002, pp. 150-155.
32. H. C. Longuet-Higgins and K. Prazdny, "The interpretation of a moving retinal image," in Proc. Royal Society of London, vol. B-208, 1980, pp. 385-397.
33. H. C. Longuet-Higgins, "The visual ambiguity of a moving plane," in Proc. R. Soc. London, Series B, vol. 223, 1984, pp. 165-175.
34. J.-F. Lots, D. M. Lane, E. Trucco, and F. Chaumette, "A 2-D visual servoing for underwater vehicle station keeping," Proc. IEEE Conf. Robotics Automat., pp. 2767-2772, May 2001.
35. H. Madjidi and S. Negahdaripour, "Global alignment of sensor positions with noisy motion measurements," in Proc. IEEE Int. Conf. Robotics and Automation (submitted for publication), to be held in New Orleans, LA, Apr. 26-May 1, 2004.
36. R. Marks, S. M. Rock, and M. J. Lee, "Real-time video mosaicking of the ocean floor," IEEE J. Oceanic Eng., vol. 20, pp. 229-241, July 1995.
37. R. Marks, H. H. Wang, M. Lee, and S. Rock, "Automatic visual station keeping of an underwater robot," in Proc. OCEANS'94, Brest, France, Sept. 1994.
38. L. Matthies, E. Gat, R. Harrison, B. Wilcox, R. Volpe, and T. Litwin, "Mars microrover navigation: Performance evaluation and enhancement," Autonomous Robots J., vol. 2, no. 4, pp. 291-311, 1995.
39. E. M. Mikhail, Observations and Least Squares. New York: IEP, 1976.
40. E. M. Mikhail, J. S. Bethel, J. C. McGlone, and C. McGlone, Introduction to Modern Photogrammetry. New York: Wiley, 2001.
41. S. Negahdaripour, C. H. Yu, and A. Shokrollahi, "Recovering shape and motion from undersea images," IEEE J. Oceanic Eng., vol. 15, pp. 189-198, July 1990.
42. S. Negahdaripour and J. Fox, "Underwater optical stationkeeping: Improved methods," J. Robot. Syst., pp. 319-338, Mar. 1991.
43. S. Negahdaripour, L. Jin, X. Xun, C. Tsukamoto, and J. Yuh, "A real-time visionbased 3-D motion estimation system for positioning and trajectory following," Proc. Third IEEE Workshop Applications Comp. Vision, pp. 264-271, Dec. 1996.
44. S. Negahdaripour, S. Zhang, X. Xun, and A. Khamene, "On shape and motion recovery from underwater imagery for 3D mapping and motion-based video compression," in Proc. OCEANS'98, Nice, France, Sept. 1998.
45. S. Negahdaripour, X. Xun, A. Khamene, and Z. Awan, "3-D motion and depth estimation from sea-floor images for mosaic-based station-keeping and navigation of ROVs/AUV's and high-resolution sea-floor mapping," in Proc. Workshop AUV Navigation, Cambridge, MA, Aug. 1998, pp. 191-200.
46. S. Negahdaripour, X. Xu, and L. Jin, "Direct estimation of motion from sea floor images for automatic station-keeping of submersible platforms," IEEE J. Oceanic Eng., vol. 24, pp. 370-382, July 1999.
47. S. Negahdaripour and P. Firoozfam, "Positioning and photo-mosaicking with long image sequences; comparison of selected methods," in Proc. OCEANS'01, Honolulu, HI, Nov. 2001, pp. 2584-2592.
48. S. Negahdaripour and X. Xu, "Mosaic-based positioning and improved motion estimation methods for autonomous navigation," IEEE J. Oceanic Eng., vol. 27, pp. 79-99, Jan. 2002.
49. M. Ollis, H. Herman, and S. Singh, "Analysis and Design of Panoramic Stereo Vision Using Equi-Angular Pixel Cameras," Carnegie Mellon Univ., Robotics Inst., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-99-04, 1999.
50. C. F. Olson, L. H. Matthies, M. Schoppers, and M. W. Maimone, "Stereo ego-motion improvements for robust rover navigation," Proc. IEEE Int. Conf. Robotics Automation, pp. 1099-1104, 2001.
51. S. Peleg, M. Ben-Ezra, and Y. Pritch, "Omnistereo: Panoramic stereo imaging," IEEE Trans. Pattern Anal. Machine Intell., vol. 23, no. 3, pp. 279-290, March 2001.
52. C. Roman and H. Singh, "Estimation of error in large area underwater photomosaics using vehicle navigation data," in Proc. OCEANS'01, Honolulu, HI, Nov. 2001, pp. 1849-1853.
53. C. S. Rogers, G. Garrison, R. Grober, Z.-M. Hillis, and M. A. Franke, Coral Reef Monitoring Manual for the Caribbean and Western Atlantic. Virgin Islands National Park: St. John, USVI, 2001.
54. H. S. Sawhney, S. Hsu, and R. Kumar, "Robust video mosaicking through topology inference and local to global alignment," in Proc. Eur. Conf. Comp. Vision, Berlin, Germany, June 1998, pp. 103-119.
55. N. Schlegel, "Autonomous vehicle control using image processing," MSc. Thesis, Virginia Polytechnic Inst. State Univ., Blacksburg, VA, 1997.
56. H. Singh, D. R. Yoerger, R. Bachmayer, A. M. Bradley, and W. K., Stewart, "Sonar mapping with the autonomous benthic explorer (ABE)," in Proc. 9th Int. Symp. Unmanned Untethered Submersible Technology, Durham, NH, 1995.
57. R. Smith and P. Cheeseman, "On the representation and estimation of spatial uncertainty," Int. J. Robot. Res., vol. 5, no. 4, pp. 56-58, 1987.
58. C. M. Smith, J. J. Leonard, A. A. Bennett, and C. Shaw, "Feature-based concurrent mapping and localization of autonomous underwater vehicles," in Proc. OCEANS'97, Halifax, NS, Canada, 1997, pp. 896-901.
59. M. Snorrason, J. Norris, and P. Backes, "Vision based obstacle detection and path planning for planetary rovers," in Proc. SPIE 13th Annu. AeroSense Conf., vol. 3693, Orlando, FL, Apr. 1999, pp. 44-54.
60. B. Southall, T. Hague, J. A. Marchant, and B. F. Buxton, "Vision-aided outdoor navigation of an autonomous horticultural vehicle," in Proc. 1st Int. Conf. Vision Systems (ICVS), Las Palmas de Gran Canaria, Spain, 1999, pp. 37-50.
61. W. K. Stewart, "Remote-sensing issues for intelligent underwater systems," in Proc. Conf. Computer Vision and Pattern Recognition, Maui, HI, 1991, pp. 230-235.
62. A. Stentz, "Robotic technologies for outdoor industrial vehicles," in Proc. SPIE, Unmanned Ground Vehicle Technology III, vol. 4364, G. R. G. and C. M. Shoemaker, Eds., 2001, pp. 192-199.
63. C. R. Stoker, D. R. Barch, B. P. Hine III, and J. Barry, "Antactic undersea exploration using a robotic submarine with a telepresence user interface," IEEE Intell. Syst., vol. 10, pp. 14-23, Dec. 1995.
64. M. Tivey, D. Yoerger, A. Bradley, R. Catanach, A. Duester, S. Liberatore, and H. Singh, "Autonomous underwater vehicle maps seafloor," EOS Trans. American Geophysical Union, vol. 78, no. 22, pp. 229-230, June 1997.
65. S. Tiwari, "Mosaicking of the ocean floor in the presence of three-dimensional occlusion in visual and side-scan sonar images," in Proc. Symp. AUV Technol., Monterey, CA, June 1996, pp. 308-314.
66. R. Tsai, T. S. Huang, and W. L. Zhu, "Estimating three-dimensional motion parameters of a rigid planar patch, II: Singular value decomposition," IEEE Trans. Acoust., Speech, Signal Processing, vol. 30, pp. 525-534, Aug. 1992.
67. V. Uffenkamp, "State of the art of high precision industrial photogrammetry," in Proc. 3rd Int. Workshop Accelerator Alignment, ch. II, Annecy, France, Sept.-Oct 1993, pp. 153-165.
68. G. S. Van der wal, M. W. Hanson, and M. R. Piacentino, "ACADIA vision processor," Proc. IEEE Int. Workshop Computer Architectures Machine Perception, pp. 31-40, Sept. 2000.
69. P. Wade, D. Moran, J. Graham, and C. B. Jackson. Robust and Accurate 3D Measurement of Formed Tube Using Trinocular Stereo Vision. [Online]. Available: http://www.bmva.ac.uk/bmvc/1997/papers/028/028.html
70. I. M. Williams and J. H. J. Leach, "Measurements of benthic species using drop-video platforms- Comparative uses of stereo and single video systems," in Proc. Australian Marine Science Assoc., Sydney, Australia, Nov. 1999, pp. 114-119.
71. X. Xun and S. Negahdaripour, "Vision-based motion sensing for underwater navigation and mosaicking of ocean floor images," in Proc. OCEANS'97, Halifax, NS, Canada, Oct. 1997, pp. 1412-1417.
72. X. Xu and S. Negahdaripour, "Automatic optical station keeping and navigation of an ROV; sea trial experiments," in Proc. OCEANS'99, Seattle, WA, Sept. 1999.
73. X. Xu, "Vision-based ROV system," Ph.D. Dissertation, Univ. Miami, ECE Department, Coral Gables, FL, 2000.
74. A. Yahja, S. Singh, and A. Stentz, "An efficient on-line path planner for outdoor mobile robots operating in vast environments," Robot. Autonomous Syst., vol. 33, no. 2/3, pp. 129-143, 2000.
75. Z. Zhu, K. D. Rajasekar, E. M. Riseman, and A. R. Hanson, "Panoramic virtual stereo vision of cooperative mobile robots for localizing 3D moving objects," in Proc. IEEE Workshop Omnidirectional Vision, June 2000, pp. 29-36.
76. [Online]. Available: http://www.visualizationsoftware.com/3-Dem/vrml.html