Recovery of underwater visibility and structure by polarization analysis

IEEE Journal of Oceanic Engineering

Volumn 30, Issue 3, 2005, Pages 570-587

  Schechner, Yoav Y ^a   Karpel, Nir ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Color; Illumination; Image enhancement; Inverse problems; Polarized light; Scattering; Three dimensional reconstruction; Undersea vision; Underwater imaging

Indexed keywords

COLOR IMAGE PROCESSING; COMPUTER VISION; IMAGE ENHANCEMENT; INVERSE PROBLEMS; LIGHT POLARIZATION; LIGHTING; UNDERWATER IMAGING; UNDERWATER VISIBILITY;

COLOR CORRECTION; SCENE CONTRAST; THREE-DIMENSIONAL RECONSTRUCTION; UNDERSEA VISION;

OCEANOGRAPHY;

EID: 33144456139     PISSN: 03649059     EISSN: None     Source Type: Journal    
DOI: 10.1109/JOE.2005.850871     Document Type: Article

References (82)

1. D. F. Coleman, J. B. Newman, and R. D. Ballard, "Design and implementation of advanced underwater imaging systems for deep sea marine archaeological surveys," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, vol. 1, Providence, RI, 2000, pp. 661-665.
2. S. Harsdorf, R. Reuter, and S. Tönebön, "Contrast-enhanced optical imaging of submersible targets," in Proc. Int. Society Optical Engineering (SPIE), vol. 3821, San Diego, CA, 1999, pp. 378-383.
3. J. S. Jaffe, "Computer modelling and the design of optimal underwater imaging systems," IEEE J. Ocean. Eng., vol. 15, no. 2, pp. 101-111, 1990.
4. D. M. Kocak and F. M. Caimi, "Computer vision in ocean engineering," in The Ocean Engineering Handbook, F. El-Hawary, Ed. Boca Raton, FL: CRC Press, 2001, ch. 4.3.
5. J. S. Taylor Jr. and L. B. Wolff, "Partial polarization signature results from the field testing of the shallow water real-time imaging polarimeter (shrimp)," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, vol. 1, Honolulu, HI, 2001, pp. 107-116.
6. L. B. Wolff, "Polarization vision: A new sensory approach to image understanding," Image Vis. Comput., vol. 15, no. 2, pp. 81-93, 1997.
7. G. L. Foresti, "Visual inspection of sea bottom structures by an autonomous underwater vehicle," IEEE Trans. Syst. Man Cybern., vol. 31, pp. 691-705, Oct. 2001.
8. L. Botelho-Ribeiro, "Underwater vision method for low-visibility turbulent conditions," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, vol. 2, Honolulu, HI, 2001, pp. 1080-1084.
9. T. Boult, "Dove: Dolphin omni-directional video equipment," in Proc. Int. Association Science and Technology Development (IASTED) Int. Conf. Robotics and Automation, San Francisco, CA, 2000, pp. 214-220.
10. F. M. Caimi, B. C. Bailey, and J. H. Blatt, "Spatial coherence methods in undersea image formation and detection," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, Fort Lauderdale, FL, 1996, pp. 40-46.
11. J. L. Forand, G. R. Fournier, D. Bonnier, and P. Pace, "LUCIE: A laser underwater camera image enhancer," in Proc. IEEE OCEANS, vol. 3, Victoria, Canada, 1993; pp. 187-190.
12. G. D. Gilbert and J. C. Pernicka, "Improvement of underwater visibility by reduction of backscatter with a circular polarization technique," Appl. Opt., vol. 6, no. 4, pp. 741-746, 1967.
13. G. W. Kattawar and M. J. Rakovic, "Virtues of mueller matrix imaging for underwater target detection," Appl. Opt., vol. 38, no. 30, pp. 6431-6438, 1999.
14. L. J. Mullen and V. M. Contarino, "Hybrid lidar-radar: Seeing through the scatter," IEEE Microw. Mag., vol. 1, no. 3, pp. 42-48, 2000.
15. V. Murino and A. Trucco, "Underwater computer vision and pattern recognition," Comput. Vis. Image Underst., vol. 79, no. 1, pp. 1-3, 2000.
16. B. A. Swartz, "Laser range gate underwater imaging advances," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, Brest, France, 1994, pp. 722-727.
17. A. Ortiz, M. Simo, and G. Oliver, "A vision system for an underwater cable tracker," Mach. Vis. Appl., vol. 13, no. 3, pp. 129-140, 2002.
18. J. M. Lavest, F. Guichard, and C. Rousseau, "Multiview reconstruction combining underwater and air sensors," in Proc. IEEE Int. Conf. Image Processing, vol. 3, Rochester, NY, 2002, pp. 813-816.
19. X. Xu and S. Negahdaripour, "Automatic optical station keeping and navigation of an ROV: Sea trial experiment," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, vol. 1, Seattle, WA, 1999, pp. 71-76.
20. J. Åhlén and D. Sundgren, "Bottom reflectance influence on a color correction algorithm for underwater images," in Proc. Scandinavian Conf. Image Analysis, Gothenburg, Sweden, 2003, pp. 922-926.
21. G. Horváth and D. Varjú, "Underwater refraction-polarization patterns of skylight perceived by aquatic animals through Snell's window of the flat water surface," Vis. Res., vol. 35, no. 12, pp. 1651-1666, 1995.
22. N. Shashar and T. W. Cronin, "Polarization contrast vision in octopus," J. Exp. Biol., vol. 199, no. 4, pp. 999-1004, 1996.
23. R. D. Ballard, "Ancient Ashkelon," Natl. Geogr., vol. 199, no. 1, pp. 91-93, 2001.
24. Y. Kahanov and J. Royal, "Analysis of hull remains of the Dor D vessel, Tantura lagoon, Israel," Int. J. Naut. Archeol., vol. 30, no. 2, pp. 257-265, 2001.
25. K. D. Moore and J. S. Jaffe, "Time-evolution of high-resolution topographic measurements of the sea floor using a 3-D laser line scan mapping system," IEEE J. Ocean. Eng., vol. 27, no. 3, pp. 525-542, 2002.
26. B. Skerry and H. Hall, Successful Underwater Photography. New York: Amphoto Books, 2002, pp. 25-41.
27. M. Webster, The Art and Technique of Underwater Photography. Surrey, England, U.K.: Fountain Press, 1998, pp. 19-22, 33-39, 146-149.
28. D. K. Lynch and W. Livingston, Color and Light in Nature, 2nd ed. Cambridge, U.K.: Cambridge Univ. Press, 2001, ch. 2.4, 2.5, 3.7, 3.16.
29. F. Cozman and E. Krotkov, "Depth from scattering," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, San Juan, PR, 1997, pp. 801-806.
30. O. Emile, F. Bretenaker, and A. L. Floch, "Rotating polarization imaging in turbid media," Opt. Lett., vol. 21, no. 20, pp. 1706-1708, 1996.
31. T. KokKeong and J. P. Oakley, "Physics-based approach to color image enhancement in poor visibility conditions," J. Opt. Soc. Amer. A, vol. 18, no. 10, pp. 2460-2466, 2001.
32. S. G. Narasimhan and S. K. Nayar, "Vision and the atmosphere," Int. J. Comput. Vis., vol. 48, no. 3, pp. 233-254, 2002.
33. J. P. Oakley and B. L. Satherley, "Improving image quality in poor visibility conditions using a physical model for contrast degradation," IEEE Trans. Image Process., vol. 7, pp. 167-179, Feb. 1998.
34. Y. Y. Schechner and N. Karpel, "Clear underwater vision," in Proc. IEEE Computer Society Conf. Computer Vision and Pattern Recognition, vol. I, Washington, DC, 2004, pp. 536-543.
35. S. M. Christie and F. Kvasnik, "Contrast enhancement of underwater images with coherent optical image processors," Appl. Opt., vol. 35, no. 5, pp. 817-825, 1996.
36. D. Miyazaki, M. Saito, Y. Sato, and K. Ikeuchi, "Determining surface orientations of transparent objects based on polarization degrees in visible and infrared wavelengths," J. Opt. Soc. Amer. A, vol. 19, no. 4, pp. 687-694, 2002.
37. Y. Y. Schechner, S. G. Narasimhan, and S. K. Nayar, "Polarization-based vision through haze," Appl. Opt., vol. 42, no. 3, pp. 511-525, 2003.
38. Y. Y. Schechner, J. Shamir, and N. Kiryati, "Polarization and statistical analysis of scenes containing a semi-reflector," J. Opt. Soc. Amer. A, vol. 17, no. 2, pp. 276-284, 2000.
39. L. J. Denes, M. Gottlieb, B. Kaminsky, and P. Metes, "AOTF polarization difference imaging," in Proc. Int. Society Optical Engineering (SPIE) Advances in Computer-Assisted Recognition, vol. 3584, Washington, DC, 1999, pp. 106-115.
40. T. W. Cronin, N. Shashar, R. L. Caldwell, J. Marshall, A. G. Cheroske, and T. H. Chiou, "Polarization vision and its role in biological signaling," Integr. Comp. Biol., vol. 43, no. 4, pp. 549-558, 2003.
41. G. Horváth and D. Varjú, Polarized Light in Animal Vision. Berlin, Germany: Springer-Verlag, 2004, ch. 14, 25, 26, 28.
42. S. Johnsen, "Transparent animals," Sci. Amer., vol. 282, no. 2, pp. 80-89, Feb. 2000.
43. J. N. Lythgoe, "The adaptation of visual pigments to the photic environment," in Handbook of Sensory Physiology. Berlin, Germany: Springer-Verlag, 1972, vol. VII/1, ch. 14, pp. 566-603.
44. M. Michinomae, H. Masuda, M. Seidou, and Y. Kito, "Structural basis for wavelength discrimination in the banked retina of the firefly squid Watasenia scintillans," J. Exp. Biol., vol. 193, no. 11-12, pp. 1-12, 1994.
45. D. C. Parkyn, J. D. Austin, and C. W. Hawryshyn, "Acquisition of polarized-light orientation in salmonids under laboratory conditions," Anim. Behav., vol. 65, pp. 893-904, 2003.
46. M. P. Rowe, E. N. Pugh Jr., J. S. Tyo, and N. Engheta, "Polarization-difference imaging: A biologically inspired technique for observation through scattering media," Opt. Lett., vol. 20, no. 6, pp. 608-610, 1995.
47. T. H. Waterman, "Polarization sensitivity," in Handbook of Sensory Physiology. Berlin, Germany: Springer-Verlag, 1981, vol. VII/6B, ch. 3, pp. 281-469.
48. R. Wehner, "Polarization vision - A uniform sensory capacity?," J. Exp. Biol., vol. 204, no. 14, pp. 2589-2596, 2001.
49. D.-M. He and G. G. L. Seet, "Divergent-beam lidar imaging in turbid water," Opt. Lasers Eng., vol. 41, no. 1, pp. 217-231, 2004.
50. J. S. Jaffe, "Sensors for underwater robotic vision: Status and prospects," in Proc. IEEE Int. Conf. Robotics and Automation, Sacramento, CA, 1991, pp. 2759-2766.
51. M. Levoy, B. Chen, V. Vaish, M. Horowitz, I. McDowall, and M. Bolas, "Synthetic aperture confocal imaging," ACM Trans. Graph., vol. 23, no. 3, pp. 825-834, 2004.
52. D. N. Sitter Jr. and A. Gelbart, "Laser-induced fluorescence imaging of the ocean bottom," Opt. Eng., vol. 40, no. 8, pp. 1545-1553, 2001.
53. J. G. Walker, P. C. Y. Chang, and K. I. Hopcraft, "Visibility depth improvement in active polarization imaging in scattering media," Appl. Opt., vol. 39, no. 27, pp. 4933-4941, 2000.
54. J. N. Lythgoe and C. C. Hemmings, "Polarized light and underwater vision," Nature, vol. 213, no. 79, pp. 893-894, 1967.
55. S. M. Luria and J. A. S. Kinney, "Linear polarizing filters and underwater vision," Undersea Biomed. Res., vol. 1, no. 4, pp. 371-378, 1974.
56. G. P. Können, Polarized Light in Nature. New York: Cambridge Univ. Press, 1985, pp. 1-10, 96-99, 131-137, 144-145.
57. C. D. Mobley, Light and Water: Radiative Transfer in Natural Waters. San Diego, CA: Academic, 1994, ch. 3, 5.
58. P. C. Y. Chang, J. C. Flitton, K. I. Hopcraft, E. Jakeman, D. L. Jordan, and J. G. Walker, "Improving visibility depth in passive underwater imaging by use of polarization," Appl. Opt., vol. 42, no. 15, pp. 2794-2802, 2003.
59. E. Gaten, P. M. J. Shelton, and M. S. Nowel, "Contrast enhancement through structural variations in the rhabdoms of oplophorid shrimps," Mar. Biol., vol. 145, no. 3, pp. 499-504, 2004.
60. L. Peichl, G. Behrmann, and R. H. H. Kröger, "For whales and seals the ocean is not blue: A visual pigment loss in marine mammals," Eur. J. Neurosci., vol. 13, no. 8, pp. 1520-1529, 2001.
61. G. G. Rosenthal and M. J. Ryan, "Visual and acoustic communication in non-human animals: A comparison," J. Biosci., vol. 25, no. 3, pp. 285-290, 2000.
62. N. Shashar, R. Hagan, J. G. Boal, and R. T. Hanlon, "Cuttlefish use polarization sensitivity in predation on silvery fish," Vis. Res., vol. 40, no. 1, pp. 71-75, 2000.
63. J. S. Tyo, M. P. Rowe, E. N. Pugh Jr., and N. Engheta, "Target detection in optically scattering media by polarization-difference imaging," Appl. Opt., vol. 35, no. 11, pp. 1855-1870, 1996.
64. W. S. Jagger and W. R. A. Muntz, "Aquatic vision and the modulation transfer properties of unlighted and diffusely lighted natural waters," Vis. Res., vol. 33, no. 13, pp. 1755-1763, 1993.
65. N. G. Jerlov, Marine Optics, set. Elsevier Oceanography. Amsterdam, The Netherlands: Elsevier, 1976, pp. 87, 96-100, 151-155.
66. B. L. McGlamery, "A computer model for underwater camera system," Proc. SPIE, vol. 208, pp. 221-231, 1979.
67. S. Q. Duntley, "Light in the sea," J. Opt. Soc. Amer, vol. 53, no. 2, pp. 233-241, 1963.
68. K. J. Voss, "Simple empirical model of the oceanic point spread function," Appl. Opt., vol. 30, no. 18, pp. 2647-2651, 1991.
69. R. C. Henry, S. Mahadev, S. Urquijo, and D. Chitwood, "Color perception through atmospheric haze," J. Opt. Soc. Amer. A, vol. 17, no. 5, pp. 831-835, 2000.
70. S. M. Luria and J. A. S. Kinney, "Underwater vision," Science, vol. 167, no. 924, pp. 1454-1461, 1999.
71. E. H. Adelson, "Lightness perception and lightness illusions," in The New Cognitive Neuroscience, 2nd ed. Cambridge, MA: MIT press, 2000, ch. 24, pp. 339-351.
72. M. G. J. Minnaert, Light and Color in the Outdoors (1974). New York: Springer-Verlag, 1983.
73. S. P. Morgan, M. P. Khong, and M. G. Somekh, "Effects of polarization state and scatterer concentration on optical imaging through scattering media," Appl. Opt., vol. 36, no. 7, pp. 1560-1565, 1997.
74. Y. Y. Schechner and N. Karpel, "Attenuating natural flicker patterns," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, Kobe, Japan, 2004, pp. 1262-1268.
75. A. K. Jain, Fundamentals of Digital Image Processing. Englewood Cliffs, NJ: Prentice-Hall, 1989.
76. Y. Y. Schechner. [Online] http://www.ee.technion.ac.il/~yoav
77. J. A. Strickrott and S. Negahdaripour, "On the development of an active vision system for 3-d scene reconstruction and analysis from underwater images," in Proc. Marine Technology Society (MTS)/IEEE OCEANS, vol. 1, Halifax, NS, Canada, 1997, pp. 626-633.
78. S. Zhang and S. Negahdaripour, "3-d shape recovery of planar and curved surfaces from shading cues in underwater images," IEEE J. Ocean. Eng., vol. 27, no. 1, pp. 100-116, 2002.
79. W. A. Shurcliff and S. S. Ballard, Polarized Light. Princeton, NJ: Van Nostrand, 1964, pp. 98-103, 120-121.
80. J. M. Lavest, G. Rivers, and J. T. Lapreste, "Dry camera calibration for underwater applications," Mach. Vis. Appl., vol. 13, no. 5-6, pp. 245-253, 2003.
81. R. Li, H. Li, W. Zou, R. G. Smith, and T. A. Curran, "Quantitative photogrammetric analysis of digital underwater video imagery," IEEE J. Ocean. Eng., vol. 22, no. 2, pp. 364-375, 1997.
82. S. Guimond and D. Elmore, "Polarizing views," SPIE OE Mag., vol. 4, no. 5, pp. 26-29, May 2004.