Optimal disparity estimation in natural stereo images

Journal of Vision

Volumn 14, Issue 2, 2014, Pages 1-18

  Burge, Johannes ^a   Geisler, Wilson S ^a  

^a UNIVERSITY OF TEXAS AT AUSTIN   (United States)

Author keywords

Bayesian statistics; Complex cells; Decoding; Depth perception; Disparity energy model; Encoding; Hierarchical model; Ideal observer; Invariance; Natural scene statistics; Perceptual constancy; Population code; Selectivity; Simple cells; Stereopsis

Indexed keywords

ARTICLE; ASSOCIATION; BAYESIAN STATISTICS; BINOCULAR VISION; COMPLEX CELLS; DECODING; DEPTH PERCEPTION; DISPARITY ENERGY MODEL; ENCODING; HIERARCHICAL MODEL; HUMAN; IDEAL OBSERVER; INVARIANCE; NATURAL SCENE STATISTICS; NERVE CELL; PERCEPTUAL CONSTANCY; PHOTOSTIMULATION; PHYSIOLOGY; POPULATION CODE; PSYCHOPHYSICS; SELECTIVITY; SIMPLE CELLS; STEREOSCOPIC VISION;

BAYESIAN STATISTICS; COMPLEX CELLS; DECODING; DEPTH PERCEPTION; DISPARITY ENERGY MODEL; ENCODING; HIERARCHICAL MODEL; IDEAL OBSERVER; INVARIANCE; NATURAL SCENE STATISTICS; PERCEPTUAL CONSTANCY; POPULATION CODE; SELECTIVITY; SIMPLE CELLS; STEREOPSIS;

CUES; HUMANS; NEURONS; PHOTIC STIMULATION; PSYCHOPHYSICS; VISION DISPARITY; VISION, BINOCULAR;

EID: 84897691242     PISSN: None     EISSN: 15347362     Source Type: Journal    
DOI: 10.1167/14.2.1     Document Type: Article

References (70)

1. Albrecht, D. G., & Geisler, W. S. (1991). Motion selectivity and the contrast-response function of simple cells in the visual cortex. Visual Neuroscience, 7(6), 531-546.
2. Albrecht, D. G., & Hamilton, D. B. (1982). Striate cortex of monkey and cat: Contrast response function. Journal of Neurophysiology, 48(1), 217- 237.
3. Anzai, A., Ohzawa, I., & Freeman, R. D. (1999). Neural mechanisms for processing binocular information I. Simple cells. Journal of Neurophysiology, 82(2), 891-908.
4. Badcock, D. R., & Schor, C. M. (1985). Depthincrement detection function for individual spatial channels. Journal of the Optical Society of America A, 2(7), 1211-1215.
5. Banks, M. S., Gepshtein, S., & Landy, M. S. (2004). Why is spatial stereoresolution so low?. Journal of Neuroscience, 24(9), 2077-2089.
6. Berens, P., Ecker, A. S., Gerwinn, S., Tolias, A. S., & Bethge, M. (2011). Reassessing optimal neural population codes with neurometric functions. Proceedings of the National Academy of Sciences, USA, 108(11), 4423.
7. Blakemore, C. (1970). The range and scope of binocular depth discrimination in man. The Journal of Physiology, 211(3), 599-622.
8. Burge, J., & Geisler, W. S. (2011). Optimal defocus estimation in individual natural images. Proceedings of the National Academy of Sciences, USA, 108(40), 16849-16854.
9. Burge, J., & Geisler, W. S. (2012). Optimal defocus estimates from individual images for autofocusing a digital camera. Proceedings of the IS&T/SPIE 47th Annual Meeting, January, 2012, Burlingame, CA.
10. Carandini, M., & Heeger, D. J. (2012). Normalization as a canonical neural computation. Nature Reviews Neuroscience, 13(1), 51-62.
11. Chen, Y., & Qian, N. (2004). A coarse-to-fine disparity energy model with both phase-shift and positionshift receptive field mechanisms. Neural Computation, 16(8), 1545-1577.
12. Cormack, L. K., Stevenson, S. B., & Schor, C. M. (1991). Interocular correlation, luminance contrast and cyclopean processing. Vision Research, 31(12), 2195-2207.
13. Cumming, B. G. (2002). An unexpected specialization for horizontal disparity in primate primary visual cortex. Nature, 418(6898), 633-636.
14. Cumming, B. G., & DeAngelis, G. C. (2001). The physiology of stereopsis. Annual Review of Neuroscience, 24, 203-238.
15. Cumming, B. G., Shapiro, S. E., & Parker, A. J. (1998). Disparity detection in anticorrelated stereograms. Perception, 27(11), 1367-1377.
16. Curcio, C. A., Sloan, K. R., Kalina, R. E., & Hendrickson, A. E. (1990). Human photoreceptor topography. The Journal of Comparative Neurology, 292(4), 497-523.
17. De Valois, R. L., Albrecht, D. G., & Thorell, L. G. (1982). Spatial frequency selectivity of cells in macaque visual cortex. Vision Research, 22(5), 545- 559.
18. DeAngelis, G. C., Ohzawa, I., & Freeman, R. D. (1991). Depth is encoded in the visual cortex by a specialized receptive field structure. Nature, 352(6331), 156-159.
19. Ferster, D., & Miller, K. D. (2000). Neural mechanisms of orientation selectivity in the visual cortex. Annual Review of Neuroscience, 23(1), 441-471.
20. Fincham, E., & Walton, J. (1957). The reciprocal actions of accommodation and convergence. The Journal of Physiology, 137(3), 488-508.
21. Fleet, D. J., Wagner, H., & Heeger, D. J. (1996). Neural encoding of binocular disparity: Energy models, position shifts and phase shifts. Vision Research, 36(12), 1839-1857.
22. Ganguli, D., & Simoncelli, E. P. (2010). Implicit encoding of prior probabilities in optimal neural populations. Advances in Neural Information Processing Systems (NIPS), 23, 658-666.
23. Geisler, W. S., Najemnik, J., & Ing, A. D. (2009). Optimal stimulus encoders for natural tasks. Journal of Vision, 9(13):17, 1-16, http://www. journalofvision.org/content/9/13/17, 10.1167/9.13. 17. [PubMed] [Article]
24. Girshick, A. R., Landy, M. S., & Simoncelli, E. P. (2011). Cardinal rules: Visual orientation perception reflects knowledge of environmental statistics. Nature Neuroscience, 14(7), 926-932.
25. Haefner, R., & Bethge, M. (2010). Evaluating neuronal codes for inference using Fisher information. Advances in Neural Information Processing Systems, 23, 1-9.
26. Haefner, R. M., & Cumming, B. G. (2008). Adaptation to natural binocular disparities in primate V1 explained by a generalized energy model. Neuron, 57(1), 147-158.
27. Harris, J. M., McKee, S. P., & Smallman, H. S. (1997). Fine-scale processing in human binocular stereopsis. Journal of the Optical Society of America A, Optics, Image Science, and Vision, 14(8), 1673- 1683.
28. Hecht, S., Shlaer, S., & Pirenne, M. H. (1942). Energy, quanta, and vision. The Journal of General Physiology, 25(6), 819-840.
29. Heeger, D. J. (1992). Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9(2), 181- 197.
30. Hibbard, P. B. (2008). Binocular energy responses to natural images. Vision Research, 48(12), 1427-1439.
31. Hoyer, P. O., & Hyvärinen, A. (2000). Independent component analysis applied to feature extraction from colour and stereo images. Network: Computation in Neural Systems, 11(3), 191-210.
32. Jazayeri, M., & Movshon, J. A. (2006). Optimal representation of sensory information by neural populations. Nature Neuroscience, 9(5), 690-696.
33. Kaye, M. (1978). Stereopsis without binocular correlation. Vision Research, 18(8), 1013-1022.
34. Landers, D. D., & Cormack, L. K. (1997). Asymmetries and errors in perception of depth from disparity suggest a multicomponent model of disparity processing. Perception & Psychophysics, 59(2), 219-231.
35. Lehky, S. R., & Sejnowski, T. J. (1990). Neural model of stereoacuity and depth interpolation based on a distributed representation of stereo disparity. Journal of Neuroscience, 10(7), 2281-2299.
36. Levi, D. M., McKee, S. P., & Movshon, J. A. (2011). Visual deficits in anisometropia. Vision Research, 51(1), 48-57.
37. Lewicki, M. S. (2002). Efficient coding of natural sounds. Nature Neuroscience, 5(4), 356-363.
38. Li, Z., & Atick, J. J. (1994). Efficient stereo coding in the multiscale representation. Network: Computation in Neural Systems, 5, 157-174.
39. Liu, Y., Bovik, A. C., & Cormack, L. K. (2008). Disparity statistics in natural scenes. Journal of Vision, 8(11):19, 1-14, http://www.journalofvision. org/content/8/11/19, doi:10.1167/8.11.19 [PubMed] [Article].
40. Ma, W. J., Beck, J. M., Latham, P. E., & Pouget, A. (2006). Bayesian inference with probabilistic population codes. Nature Neuroscience, 9(11), 1432- 1438.
41. Marcos, S., & Burns, S. A. (2000). On the symmetry between eyes of wavefront aberration and cone directionality. Vision Research, 40(18), 2437-2447.
42. Marr, D., & Poggio, T. (1976). Cooperative computation of stereo disparity. Science, 194(4262), 283- 287.
43. McKee, S. P., Levi, D. M., & Bowne, S. F. (1990). The imprecision of stereopsis. Vision Research, 30(11), 1763-1779.
44. Nakayama, K., & Shimojo, S. (1990). Da Vinci stereopsis: Depth and subjective occluding contours from unpaired image points. Vision Research, 30(11), 1811-1825.
45. Nienborg, H., Bridge, H., Parker, A. J., & Cumming, B. G. (2004). Receptive field size in V1 neurons limits acuity for perceiving disparity modulation. Journal of Neuroscience, 24(9), 2065-2076.
46. Ogle, K. N. (1952). On the limits of stereoscopic vision. Journal of Experimental Psychology, 44(4), 253- 259.
47. Ohzawa, I. (1998). Mechanisms of stereoscopic vision: The disparity energy model. Current Opinion in Neurobiology, 8(4), 509-515.
48. Ohzawa, I., DeAngelis, G. C., & Freeman, R. D. (1990). Stereoscopic depth discrimination in the visual cortex: Neurons ideally suited as disparity detectors. Science, 249(4972), 1037-1041.
49. Ohzawa, I., DeAngelis, G. C., & Freeman, R. D. (1997). Encoding of binocular disparity by complex cells in the cat's visual cortex. Journal of Neurophysiology, 77(6), 2879-2909.
50. Olshausen, B. A., & Field, D. J. (1996). Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381(6583), 607-609.
51. Panum, P. (1858). Physiologische Untersuchungen über das Sehen mit zwei Augen [Translation: Psychological investigations on seeing with two eyes]. Kiel: Schwerssche Buchandlung.
52. Poggio, G. F., Gonzalez, F., & Krause, F. (1988). Stereoscopic mechanisms in monkey visual cortex: Binocular correlation and disparity selectivity. Journal of Neuroscience, 8(12), 4531-4550.
53. Qian, N. (1997). Binocular disparity and the perception of depth. Neuron, 18(3), 359-368.
54. Qian, N., & Zhu, Y. (1997). Physiological computation of binocular disparity. Vision Research, 37(13), 1811-1827.
55. Read, J. C. A., & Cumming, B. G. (2003). Testing quantitative models of binocular disparity selectivity in primary visual cortex. Journal of Neurophysiology, 90(5), 2795-2817.
56. Read, J. C. A., & Cumming, B. G. (2007). Sensors for impossible stimuli may solve the stereo correspondence problem. Nature Neuroscience, 10(10), 1322- 1328.
57. Read, J. C. A., Parker, A. J., & Cumming, B. G. (2002). A simple model accounts for the response of disparity-tuned V1 neurons to anticorrelated images. Visual Neuroscience, 19(6), 735-753.
58. Simoncelli, E. P., & Olshausen, B. A. (2001). Natural image statistics and neural representation. Annual Review of Neuroscience, 24, 1193-1216.
59. Skottun, B. C., De Valois, R. L., Grosof, D. H., Movshon, J. A., Albrecht, D. G., & Bonds, A. B. (1991). Classifying simple and complex cells on the basis of response modulation. Vision Research, 31(7-8), 1079-1086.
60. Stevenson, S. B., Cormack, L. K., Schor, C. M., & Tyler, C. W. (1992). Disparity tuning in mechanisms of human stereopsis. Vision Research, 32(9), 1685-1694.
61. Stockman, A., & Sharpe, L. T. (2000). The spectral sensitivities of the middle- and long-wavelengthsensitive cones derived from measurements in observers of known genotype. Vision Research, 40(13), 1711-1737.
62. Tanabe, S., & Cumming, B. G. (2008). Mechanisms underlying the transformation of disparity signals from V1 to V2 in the macaque. Journal of Neuroscience, 28(44), 11304-11314.
63. Tanabe, S., Haefner, R. M., & Cumming, B. G. (2011). Suppressive mechanisms in monkey V1 help to solve the stereo correspondence problem. Journal of Neuroscience, 31(22), 8295-8305.
64. Thibos, L. N., Ye, M., Zhang, X., & Bradley, A. (1992). The chromatic eye: A new reduced-eye model of ocular chromatic aberration in humans. Applied Optics, 31(19), 3594-3600.
65. Tsao, D. Y., Conway, B. R., & Livingstone, M. S. (2003). Receptive fields of disparity-tuned simple cells in macaque V1. Neuron, 38(1), 103-114.
66. Tyler, C. W. (1975). Spatial organization of binocular disparity sensitivity. Vision Research, 15(5), 583- 590.
67. Tyler, C. W., & Julesz, B. (1978). Binocular crosscorrelation in time and space. Vision Research, 18(1), 101-105.
68. Vlaskamp, B. N. S., Yoon, G., & Banks, M. S. (2011). Human stereopsis is not limited by the optics of the well-focused eye. Journal of Neuroscience, 31(27), 9814-9818.
69. Williams, D. R. (1985). Visibility of interference fringes near the resolution limit. Journal of the Optical Society of America A, 2(7), 1087-1093.
70. Wyszecki, G., & Stiles, W. (1982). Color science: Concepts and methods, quantitative data and formulas. New York: John Wiley & Sons.