Inversion by P4: Polarization-picture post-processing

Philosophical Transactions of the Royal Society B: Biological Sciences

Volumn 366, Issue 1565, 2011, Pages 638-648

  Schechner, Yoav Y ^a  

^a TECHNION ISRAEL INSTITUTE OF TECHNOLOGY   (Israel)

Author keywords

Computational photography; Computational vision; Polarized light; Reflection; Scattering

Indexed keywords

ALGORITHM; DATABASE; DIGITAL IMAGE; HAZE; OPTIMIZATION; PIXEL; POLARIZATION; SCATTERING; SIGNAL PROCESSING; UNDERWATER ENVIRONMENT; VISION;

HEXAPODA;

ALGORITHM; COMPUTER SIMULATION; IMAGE ENHANCEMENT; LIGHT; METHODOLOGY; RADIATION SCATTERING; REVIEW; THEORETICAL MODEL;

ALGORITHMS; COMPUTER SIMULATION; IMAGE ENHANCEMENT; LIGHT; MODELS, THEORETICAL; SCATTERING, RADIATION;

EID: 79952326356     PISSN: 09628436     EISSN: 14712970     Source Type: Journal    
DOI: 10.1098/rstb.2010.0205     Document Type: Review

References (57)

1. Fischer, L., Zvyagin, A., Plakhotnik, T. & Vorobyev, M. 2010 Numerical modeling of light propagation in a hexagonal array of dielectric cylinders. J. Opt. Soc. Am. A 27, 865-872. (doi:10.1364/JOSAA.27.000865)
2. Kleinlogel, S. & Marshall, N. J. 2009 Ultraviolet polarisation sensitivity in the stomatopod crustacean Odontodactylus scyllarus. J. Comp. Physiol. A 195, 1153-1162. (doi:10.1007/s00359-009-0491-y)
3. Cronin, T. W., Shashar, N., Caldwell, R. L., Marshall, J., Cheroske, A. G. & Chiou, T. H. 2003 Polarization vision and its role in biological signaling. Integr. Comp. Biol. 43, 549-558. (doi:10.1093/icb/43.4.549) (Pubitemid 38335317)
4. Horväth, G. & Varjú, D. 2004 Polarized light in animal vision. Berlin, Germany: Springer.
5. Johnsen, S. 2000 Transparent animals. Sci. Am. 282, 80-89. (doi:10.1038/scientificamerican0200-80)
6. Lythgoe, J. N. 1972 The adaptation of visual pigments to the photic environment. In Handbook of sensory physiology, VII/1 (ed. H. J. A. Dartnall), pp. 566-603. Berlin, Germany: Springer.
7. Mäthger, L. M., Shashar, N. & Hanlon, R. T. 2009 Do cephalopods communicate using polarized light reflections from their skin? J. Environ. Biol. 212, 2133-2140. (doi:10.1242/jeb.020800)
8. Michinomae, M., Masuda, H., Seidou, M. & Kito, Y. 1994 Structural basis for wavelength discrimination in the banked retina of the firefly squid Watasenia scintillans. J. Environ. Biol. 193, 1-12. (Pubitemid 2125173)
9. Parkyn, D. C., Austin, J. D. & Hawryshyn, C. W. 2003 Acquisition of polarized-light orientation in salmonids under laboratory conditions. Anim. Behav. 65, 893-904. (doi:10.1006/anbe.2003.2136) (Pubitemid 36631793)
10. Roberts, N. W., Chiou, T.-H., Marshall, N. J. & Cronin, T. W. 2009 A biological quarter-wave retarder with excellent achromaticity in the visible wavelength region. Nat. Photon. 3, 641-644. (doi:10.1038/nphoton. 2009.189)
11. Roberts, N. W., Gleeson, H. F., Temple, S. E, Haimberger, T. J. & Hawryshyn, C. W. 2004 Differences in the optical properties of vertebrate photoreceptor classes leading to axial polarization sensitivity. J. Opt. Soc. Am. A 21, 335-345. (doi:10.1364/JOSAA.21.000335)
12. Roberts, N. W. & Needham, M. G. 2007 A mechanism of polarized light sensitivity in cone photoreceptors of the goldfish Carassius auratus. Biophys. J. 93, 3241-3248. (doi:10.1529/biophysj.107.112292) (Pubitemid 350097114)
13. Sabbah, S., Lerner, A., Erlick, C. & Shashar, N. 2005 Under water polarization vision-a physical examination. Recent Res. Dev. Exp. Theor. Biol. 1, 1-53.
14. Shashar, N. & Cronin, T. W. 1996 Polarization contrast vision in octopus. J. Environ. Biol. 199, 999-1004. (Pubitemid 126603738)
15. Waterman, T. H. 1981 Polarization sensitivity. In Handbook of sensory physiology, VII/6 B (ed. H. J. A. Dartnall), pp. 281-469. Berlin, Germany: Springer.
16. Wehner, R. 2001 Polarization vision-a uniform sensory capacity? J. Environ. Biol. 204, 2589-2596. (Pubitemid 34869485)
17. Wolff, L. B. 1997 Polarization vision: a new sensory approach to image understanding. Image Vis. Comp. 15, 81-93. (doi:10.1016/S0262-8856 (96) 01123-7) (Pubitemid 127418775)
18. Dacke, M., Nilsson, D.-E., Warrant, E. J., Blest, A. D., Land, M. F. & O'Carroll, D. C. 1999 Built-in polarizers form part of a compass organ in spiders. Nature 401, 470-473. (doi:10.1038/46773) (Pubitemid 29470203)
19. Kelber, A., Thunell, S. & Arikawa, K. 2001 Polarisationdependent colour vision in papilio butterflies. J. Environ. Biol. 204, 2469-2480. (Pubitemid 34869472)
20. Labhart, T. & Meyer, E. P. 2002 Neural mechanisms in insect navigation: polarization compass and odometer. Curr. Opin. Neurobiol. 12, 707-714. (doi:10.1016/S0959-4388 (02) 00384-7) (Pubitemid 35462026)
21. Muheim, R., Phillips, J. B. & Akesson, S. 2006 Polarized light cues underlie compass calibration in migratory songbirds. Nature 313, 837-839. (Pubitemid 44223352)
22. Sweeney, A., Jiggins, C. & Johnsen, S. 2003 Insect communication: polarized light as a butterfly mating signal. Nature 423, 31-32. (doi:10.1038/423031a) (Pubitemid 36569575)
23. Chang, P. C. Y., Flitton, J. C., Hopcraft, K. I., Jakeman, E., Jordan, D. L. & Walker, J. G. 2003 Improving visibility depth in passive underwater imaging by use of polarization. Appl. Opt. 42, 2794-2802. (doi:10.1364/AO.42. 002794)
24. Denes, L. J., Gottlieb, M., Kaminsky, B. & Metes, P. 1999 AOTF polarization difference imaging. Proc. SPIE 3584, 106-115. (doi:10.1117/12. 339812)
25. Harsdorf, S., Reuter, R. & Töneön, S. 1999 Contrastenhanced optical imaging of submersible targets. Proc. SPIE 3821, 378-383. (doi:10.1117/12.364201)
26. Rowe, M. P., Pugh Jr, E. N., Tyo, J. S. & Engheta, N. 1995 Polarization-difference imaging: a biologically inspired technique for observation through scattering media. Opt. Lett. 20, 608-610. (doi:10.1364/OL.20. 000608)
27. Taylor Jr, J. S. & Wolff, L. B. 2001 Partial polarization signature results from the field testing of the shallow water real-time imaging polarimeter (SHRIMP). Proc. MTS/IEEE Oceans 1, 107-116. (Pubitemid 34022650)
28. Können, G. P. 1985 Polarized light in nature. New York, NY: Cambridge University Press.
29. Lythgoe, J. N. & Hemmings, C. C. 1967 Polarized light and underwater vision. Nature 213, 893-894. (doi:10. 1038/213893a0)
30. Gupta, M., Narasimhan, S. G. & Schechner, Y. Y. 2008 On controlling light transport in poor visibility environments. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Anchorage, AK, 23-28 June 2008.
31. Kaftory, R., Schechner, Y. Y. & Zeevi, Y. Y. 2007 Variational distance dependent image restoration. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Minneapolis, MN, 17-22 June 2007.
32. Namer, E., Shwartz, S. & Schechner, Y. Y. 2009 Skyless polarimetric calibration and visibility enhancement. Opt. Exp. 17, 472-493. (doi:10.1364/OE.17. 000472)
33. Schechner, Y. Y. & Karpel, N. 2005 Recovery of underwater visibility and structure by polarization analysis. IEEE J. Ocean. Eng. 30, 570-587. (Pubitemid 43264147)
34. Schechner, Y. Y., Narasimhan, S. G. & Nayar, S. K. 2003 Polarization-based vision through haze. Appl. Opt. 42, 511-525. (doi:10.1364/AO.42.000511)
35. Treibitz, T. & Schechner, Y. Y. 2009 Active polarization descattering. IEEE Trans. Pattern Anal. Mach. Intell. 31, 385-399. (doi:10.1109/TPAMI.2008.85)
36. Jerlov, N. G. 1976 Marine optics. Amsterdam, The Netherlands: Elsevier.
37. Shashar, N., Hagan, R., Boal, J. G. & Hanlon, R. T. 2000 Cuttlefish use polarization sensitivity in predation on silvery fish. Vis. Res. 40, 71-75. (doi:10.1016/S0042-6989 (99) 00158-3)
38. Jaffe, J. S. 1990 Computer modelling and the design of optimal underwater imaging systems. IEEE J. Ocean. Eng. 15, 101-111.
39. Lynch, D. K. & Livingston, W. 2001 Color and light in nature, 2nd edn. Cambridge, UK: Cambridge University Press.
40. Treibitz, T. & Schechner, Y. Y. 2009 Recovery limits in pointwise degradation. Proc. IEEE Int. Conf. on Computational Photography, San Francisco, CA, 16-17 April 2009.
41. Inoué, S. & Spring, K. R. 1997 Video microscopy, 2nd edn., ch. 6-8. New York, NY: Plenum Press.
42. Barrett, H. H. & Swindell, W. 1981 Radiological imaging, vol. 1. New York, NY: Academic Press.
43. Ratner, N., Schechner, Y. Y. & Goldberg, F. 2007 Optimal multiplexed sensing: bounds, conditions and a graph theory link. Opt. Exp. 15, 17072-17092. (doi:10.1364/OE.15.017072)
44. Kattawar, G. W. & Rakovic, M. J. 1999 Virtues of Mueller matrix imaging for underwater target detection. Appl. Opt. 38, 6431-6438. (doi:10.1364/AO.38.006431) (Pubitemid 129568181)
45. Treibitz, T. & Schechner, Y. Y. 2009 Polarization: beneficial for visibility enhancement? Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Miami, FL, 20-25 June 2009.
46. Sarafraz, A., Negahdaripour, S. & Schechner, Y. Y. 2009 Enhancing images in scattering media utilizing stereovision and polarization. Proc. IEEE Workshop on Applications of Computer Vision.
47. Schechner, Y. Y. & Averbuch, Y. 2007 Regularized image recovery in scattering media. IEEE Trans. Pattern Anal. Mach. Intell. 29, 1655-1660. (doi:10.1109/TPAMI. 2007.1141) (Pubitemid 47299919)
48. Rahmann, S. & Canterakis, N. 2001 Reconstruction of specular surfaces using polarization imaging. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, 149-155
49. Miyazaki, D. & Ikeuchi, K. 2007 Shape estimation of transparent objects by using inverse polarization ray tracing. IEEE Trans. Pattern Anal. Mach. Intell. 29, 2018-2029. (doi:10.1109/TPAMI.2007.1117) (Pubitemid 47423793)
50. Atkinson, G. A. & Hancock, E. R. 2007 Shape estimation using polarization and shading from two views. IEEE Trans. Pattern Anal. Mach. Intell. 29, 2001-2017. (doi:10.1109/TPAMI.2007.1099) (Pubitemid 47423792)
51. Be'ery, E. & Yeredor, A. 2008 Blind separation of superimposed shifted images using parameterized joint diagonalization. IEEE Trans. Image Process. 17, 340-353. (doi:10.1109/TIP.2007.915548) (Pubitemid 351386294)
52. Tsin, Y., Kang, S. B. & Szeliski, R. 2006 Stereo matching with linear superposition of layers. IEEE Trans. Pattern Anal. Mach. Intell. 28, 290-301. (doi:10.1109/TPAMI. 2006.42) (Pubitemid 46395295)
53. Farid, H. & Adelson, E. H. 1999 Separating reflections from images by use of independent component analysis. J. Opt. Soc. Am. A 16, 2136-2145. (doi:10.1364/JOSAA.16.002136) (Pubitemid 129652021)
54. Schechner, Y. Y., Shamir, J. & Kiryati, N. 2000 Polarization and statistical analysis of scenes containing a semi-reflector. J. Opt. Soc. Am. A 17, 276-284. (doi:10.1364/JOSAA.17.000276)
55. Diamant, Y. & Schechner, Y. Y. 2008 Overcoming visual reverberations. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Anchorage, AK, 23-28 June 2008.
56. Umeyama, S. & Godin, G. 2004 Separation of diffuse and specular components of surface reflection by use of polarization and statistical analysis of images. IEEE Trans. Pattern Anal. Mach. Intell. 26, 639-647. (doi:10. 1109/TPAMI.2004.1273960)
57. Nayar, S. K., Fang, X. & Boult, T. 1997 Separation of reflection components using color and polarization. Int. J. Comput. Vis. 21, 163-186. (doi:10.1023/A:1007937815113) (Pubitemid 127506540)