Large area 3-D reconstructions from underwater optical surveys

IEEE Journal of Oceanic Engineering

Volumn 34, Issue 2, 2009, Pages 150-169

  Pizarro, Oscar ^a,b,c   Eustice, Ryan Michael ^a,b,d   Singh, Hanumant ^b  

^a MASSACHUSETTS INSTITUTE OF TECHNOLOGY   (United States)

^b WOODS HOLE OCEANOGRAPHIC INSTITUTION   (United States)

^c UNIVERSITY OF SYDNEY   (Australia)

^d UNIVERSITY OF MICHIGAN   (United States)

Author keywords

3 D reconstruction; Computer vision; Structure from motion; Underwater vehicles

Indexed keywords

3-D RECONSTRUCTION; 3D STRUCTURES; BUNDLE ADJUSTMENTS; CALIBRATED CAMERAS; CORAL REEF; DEPTH SENSORS; DOPPLER VELOCITY LOGS; GROUND TRUTH; LEVELS OF DETAIL; NAVIGATION SENSORS; OCEAN FLOOR; OCEANOGRAPHIC SURVEYS; OPTICAL IMAGE; POSE INFORMATION; REFERENCE FRAME; ROBOTIC UNDERWATER VEHICLES; SINGLE IMAGES; STRUCTURE FROM MOTION; SURVEY AREA; UNCERTAINTY ESTIMATES; UNDERWATER ROBOTIC VEHICLE; UNDERWATER VEHICLES;

CAMERAS; COMPUTER VISION; GEOMETRICAL OPTICS; OCEAN ENGINEERING; OCEANOGRAPHY; RESTORATION; ROBOTICS; ROBOTS; SENSORS; SUBMERSIBLE MOTORS; SUBMERSIBLES; SURVEYS; UNCERTAINTY ANALYSIS; UNDERWATER BALLISTICS; UNDERWATER EQUIPMENT; UNDERWATER STRUCTURES; WATER CRAFT;

THREE DIMENSIONAL;

EID: 66449095968     PISSN: 03649059     EISSN: None     Source Type: Journal    
DOI: 10.1109/JOE.2009.2016071     Document Type: Article

References (57)

1. S. Q. Duntley, "Light in the sea," J. Opt. Soc. Amer., vol. 53, no. 2, pp. 214-233, 1963.
2. D. R. Yoerger, A. M. Bradley, M.-H. Cormier, W. B. F. Ryan, and B. B. Walden, "Fine-scale seafloor survey in rugged deep-ocean terrain with an autonomous robot," in Proc. IEEE Int. Conf. Robot. Autom., San Francisco, CA, 2000, vol. 2, pp. 1767-1774.
3. R. D. Ballard, L. E. Stager, D. Master, D. R. Yoerger, D. A. Mindell, L. L. Whitcomb, H. Singh, and D. Piechota, "Iron age shipwrecks in deep water off Ashkelon, Israel," Amer. J. Archaeology, vol. 106, no. 2, pp. 151-168, Apr. 2002.
4. J. Howland, "Digital data logging and processing, Derbyshire survey, 1997," Woods Hole Oceanogr. Inst., Woods Hole, MA, Tech. Rep., Dec. 1999.
5. National Transportation Safety Board, Washington, DC, EgyptAir Flight 990, Boeing 767-366ER, SU-GAP, 60 Miles South of Nantucket, MA, October 31, 1999, Aircraft Accident Brief NTSB/AAB-02/01, 2002.
6. C. R. Smith, "Whale falls: Chemosynthesis at the deep-sea floor," Oceanus, vol. 35, no. 3, pp. 74-78, 1992.
7. H. Singh, R. Eustice, C. Roman, O. Pizarro, R. Armstrong, F. Gilbes, and J. Torres, "Imaging coral I: Imaging coral habitats with the SeaBED AUV," Subsurface Sens. Technol. Appl., vol. 5, no. 1, pp. 25-42, Jan. 2004.
8. H. S. Sawhney and R. Kumar, "True multi-image alignment and its application to mosaicing and lens distortion correction," IEEE Trans. Pattern Anal. Mach. Intell., vol. 21, no. 3, pp. 235-243, Mar. 1999.
9. H. S. Sawhney, S. C. Hsu, and R. Kumar, "Robust video mosaicing through topology inference and local to global alignment," in Proc. Eur. Conf. Comput. Vis., Freiburg, Germany, 1998, pp. 103-119.
10. R. Hartley and A. Zisserman, Multiple View Geometry in Computer Vision. Cambridge, MA: Cambridge Univ. Press, 2000.
11. A. W. Fitzgibbon and A. Zisserman, "Automatic camera recovery for closed or open image sequences," in Proc. 5th Eur. Conf. Comput. Vis., Freiburg, Germany, Jun. 1998, pp. 311-326.
12. S. D. Fleischer, H. H. Wang, S. M. Rock, and M. J. Lee, "Video mosaicking along arbitrary vehicle paths," in Proc. Symp. Autonom. Underwater Veh. Technol., Monterey, CA, Jun. 1996, pp. 293-299.
13. S. Negahdaripour, X. Xu, and L. Jin, "Direct estimation of motion from sea floor images for automatic station-keeping of submersible platforms," IEEE J. Ocean. Eng., vol. 24, no. 3, pp. 370-382, Jul. 1999.
14. N. Gracias and J. Santos-Victor, "Underwater mosaicing and trajectory reconstruction using global alignment," in Proc. OCEANS Conf., Honolulu, HI, 2001, pp. 2557-2563.
15. S. Negahdaripour and X. Xun, "Mosaic-based positioning and improved motion-estimation methods for automatic navigation of submersible vehicles," IEEE J. Ocean. Eng., vol. 27, no. 1, pp. 79-99, Jan. 2002.
16. O. Pizarro and H. Singh, "Toward large-area underwater mosaicing for scientific applications," IEEE J. Ocean. Eng., vol. 28, no. 4, pp. 651-672, Oct. 2003.
17. R. Szeliski, "Image mosaicing for tele-reality applications," Cambridge Res. Lab., Cambridge, MA, Tech. Rep. CRL 94/2, May 1994.
18. "Manual of Photogrammetry," 4th ed. C. C. Slama, Ed., American Society of Photogrammetry, Bethesda, MD, 1980, ch. 2.
19. S. Negahdaripour and H. Madjidi, "Stereovision imaging on submersible platforms for 3-D mapping of benthic habitats and sea-floor structures," IEEE J. Ocean. Eng., vol. 28, no. 4, pp. 625-650, Oct. 2003.
20. O. Pizarro, R. Eustice, and H. Singh, "Relative pose estimation for instrumented, calibrated imaging platforms," in Proc. Conf. Digital Image Comput. Tech. Appl., Sydney, Australia, 2003, pp. 601-612.
21. R. Eustice, O. Pizarro, and H. Singh, "Visually augmented navigation in an unstructured environment using a delayed state history," in Proc. IEEE Int. Conf. Robot. Autom., Apr. 2004, vol. 1, pp. 25-32.
22. Z. Zhang and Y. Shan, "Incremental motion estimation through local bundle adjustment," Microsoft Research, Tech. Rep. MSR-TR-01-54, May 2001.
23. P. A. Beardsley, A. Zisserman, and D. Murray, "Sequential updating of projective and affine structure from motion," Int. J. Comput. Vis. vol. 23, no. 3, pp. 235-259, Jun. 1997.
24. C. Harris and M. Stephens, "A combined corner and edge detector," in Proc. 4th Alvey Vis. Conf., Manchester, U.K., 1988, pp. 147-151.
25. T. Tuytelaars and L. Van Gool, "Wide baseline stereo matching based on local, affinely invariant regions," in Proc. British Mach. Vis. Conf., Bristol, U.K., 2000, pp. 736-739.
26. T. Tuytelaars and L. Van Gool, "Matching widely separated views baed on affine invariant regions," Int. J. Comput. Vis., vol. 59, no. 1, pp. 61-85, 2004.
27. W. Y. Kim and Y. S. Kim, "A region-based shape descriptor using Zernike moments," Signal Process.: Image Commun., vol. 16, no. 1-2, pp. 95-102, Sep. 2000.
28. A. Khotanzad and Y. H. Hong, "Invariant image recognition by Zernike moments," IEEE Trans. Pattern Anal. Mach. Intell., vol. 12, no. 5, pp. 489-497, May 1990.
29. C. Schmid and R. Mohr, "Local greyvalue invariants for image retrieval," IEEE Trans. Pattern Anal. Mach. Intell., vol. 19, no. 5, pp. 530-535, May 1997.
30. M. A. Fischler and R. Bolles, "Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography," Commun. ACM, vol. 24, no. 6, pp. 381-395, 1981.
31. O. Pizarro, "Large scale structure from motion for autonomous underwater vehicle surveys," Ph.D. dissertation, Massachusetts Inst. Technol./Woods Hole Oceanogr. Inst., Cambridge/Woods Hole, MA, Sep. 2004.
32. B. K. P. Horn, "Relative orientation," Int. J. Comput. Vis., vol. 4, no. 1, pp. 58-78, 1990.
33. B. Triggs, "Routines for relative pose of two calibrated cameras from 5 points," INRIA, Montbonnot, France, Tech. Rep., 2000.
34. O. Faugeras and S. Maybank, "Motion from point matches: Multiplicity of solutions," Int. J. Comput. Vis., vol. 4, no. 3, pp. 225-246, 1990.
35. J. Philip, "Critical point configurations of the 5-, 6-, 7-, and 8-point algorithms for relative orientation," KTH Royal Inst. Technol., Stockholm, Sweden, Tech. Rep. TRITA-MAT-1998-MA-13, 1998.
36. R. I. Hartley and P. Sturm, "Triangulation," Comput. Vis. Image Understanding, vol. 68, no. 2, pp. 146-157, Nov. 1997.
37. K. Kanatani, Statistical Optimization for Geometric Computation: Theory and Practice. Amsterdam, The Netherlands: Elsevier, 1996, ch. 5.
38. H. C. Longuet-Higgins, "The reconstruction of a plane surface from two perspective projections," Proc. R. Soc. Lond. B, Biol. Sci., vol. 227, no. 1249, pp. 399-410, May 1986.
39. H. C. Longuet-Higgins, "Multiple interpretations of a pair of images of a surface," Proc. R. Soc. Lond. A, Math. Phys. Sci., vol. 418, no. 1854, pp. 1-15, Jul. 1988.
40. F. Kahl and R. I. Hartley, "Critical curves and surfaces for euclidean reconstruction," in Proc. Eur. Conf. Comput. Vis., 2002, vol. 2, pp. 447-462.
41. Z. Zhang, "Parameter estimation techniques: A tutorial with application to conic fitting," Image Vis. Comput. J., vol. 15, no. 1, pp. 59-76, 1997.
42. B. Triggs, P. F. McLauchlan, R. Hartley, and A. Fitzgibbon, "Bundle adjustment - A modern synthesis," in Vision Algorithms: Theory & Practice, B. Triggs, A. Zisserman, and R. Szeliski, Eds. New York: Springer-Verlag, 2000, pp. 298-372.
43. R. Smith, M. Self, and P. Cheeseman, Estimating Uncertain Spatial Relationships in Robotics, ser. Autonomous Robot Vehicles. New York: Springer-Verlag, 1990, pp. 167-193.
44. P. F. McLauchlan and A. H. Jaenicke, "Image mosaicing using sequential bundle adjustment," in Proc. British Mach. Vis. Conf., Bristol, U.K., 2000, pp. 616-625.
45. P. F. McLauchlan, "Gauge independence in optimization algorithms for 3D vision," in Proc. Workshop Vis. Algorithms, 1999, pp. 183-199.
46. D. Morris, "Gauge freedoms and uncertainty modeling for 3D computer vision," Robotics Inst., Carnegie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-01-15, Mar. 2001.
47. P. J. Besl and N. D. McKay, "A method for registration of 3-D shapes," IEEE Trans. Pattern Anal. Mach. Intell., vol. PAMI-14, no. 2, pp. 239-256, Feb. 1992.
48. B. K. P. Horn, "Closed form solutions of absolute orientation using orthonormal matrices," J. Opt. Soc. Amer. A, vol. 5, no. 7, pp. 1127-1135, 1987.
49. M. Bosse, P. Newman, J. Leonard, and S. Teller, "An Atlas framework for scalable mapping," MIT Marine Robotics Lab., Cambridge, MA, Tech. Memorandum 2002-04, 2002.
50. F. Lu and E. Milios, "Globally consistent range scan alignment for environment mapping," Autonom. Robots, vol. 4, no. 4, pp. 333-349, 1997.
51. M. C. Deans, "Bearing-only localization and mapping," Robotics Inst. Carnagie Mellon Univ., Pittsburgh, PA, Tech. Rep. CMU-RI-TR-05-41, Sep. 2005.
52. G. Sharp, S. Lee, and D.Wehe, "Multiviewregistration of 3D scenes by minimizing error between coordinate frames," in Proc. 7th Eur. Conf. Comput. Vis., Copenhagen, Denmark, May 2002, pp. 587-597.
53. C. Schlegel and T. Kämpke, "Filter design for simultaneous localization and map building (SLAM)," in Proc. IEEE Int. Conf. Robot. Autom., Washington, DC, May 2002, pp. 2737-2742.
54. X. Pennec and J.-P. Thirion, "A framework for uncertainty and validation of 3d registration methods based on points and frames," Int. J. Comput. Vis., vol. 25, no. 3, pp. 203-229, 1997.
55. M. Antone and S. Teller, "Scalable extrinsic calibration of omni-directional image networks," Int. J. Comput. Vis., vol. 49, no. 2-3, pp. 143-174, 2002.
56. X. Pennec, "Computing the mean of geometric features - Application to the mean rotation," INRIA, Sophia Antipolis, France, Res. Rep. RR-3371, Mar. 1998.
57. H. Singh, C. Roman, O. Pizarro, R. M. Eustice, and A. Can, "Towards high-resolution imaging from underwater vehicles," Int. J. Robot. Res., vol. 26, no. 1, pp. 55-74, Jan. 2007.