A physiological model for motion-stereo integration and a unified explanation of Pulfrich-like phenomena

Vision Research

Volumn 37, Issue 12, 1997, Pages 1683-1698

  Qian, Ning ^a   Andersen, Richard A ^b  

^a Columbia University ^*  (United States)

^b CALIFORNIA INSTITUTE OF TECHNOLOGY   (United States)

Author keywords

Binocular disparity; Motion; Pulfrich effect; Stereo; Temporal delay; Temporal stretching

Indexed keywords

ARTICLE; BINOCULAR VISION; HUMAN; INTEGRATION; MODEL; MOVEMENT PERCEPTION; PRIORITY JOURNAL; STEREOSCOPIC VISION;

DEPTH PERCEPTION; HUMANS; MATHEMATICS; MODELS, BIOLOGICAL; MOTION PERCEPTION; PATTERN RECOGNITION, VISUAL; PSYCHOPHYSICS; TIME FACTORS; VISION DISPARITY; VISION, BINOCULAR;

EID: 0030987308     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0042-6989(96)00164-2     Document Type: Article

References (63)

1. Adelson, E. H. & Bergen, J. R. (1985). Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America A, 22, 284-299.
2. Adelson, E. H. & Movshon, J. A. (1982). Phenomenal coherence of moving visual patterns. Nature, 3005892, 523-525.
3. Albright, T. D. (1984). Direction and orientation selectivity of neurons in visual area MT of the macaque. Journal of Neurophysiology, 52, 1106-1130.
4. Anstis, S. M. & Hassis, J. P. (1974). Movement aftereffects contingent on binocular disparity. Perception, 3, 153-168.
5. Bishop, P. O., Henry, G. H. & Smith, C. J. (1971). Binocular interaction fields of single units in the cat striate cortex. Journal of Physiology, 216, 39-68.
6. Bradley, D. C., Qian, N. & Andersen, R. A. (1995). Intrgration of motion and stereopsis in cortical area MT of the macaque. Nature, 373, 609-611.
7. Burr, D. C. (1979). Acuity for apparent Vernier offset. Vision Research, 19, 835-837.
8. Burr, D. C. & Ross, J. (1979). How does binocular delay give information about depth? Vision Research, 19, 523-532.
9. Carney, T., Paradiso, M. A. & Freeman, R. D. (1989). A physiological correlate of the Pulfrich effect in cortical neurons of the cat. Vision Research, 29, 155-165.
10. Cynader, M. S., Gardner, J. C. & Douglas, R. M. (1978). Neural mechanisms underlying stereoscopic depth perception in cat visual cortex. In Cool, S. J. & Smith, E. L. III (Eds), Frontiers in visual science (pp. 373-386). Springer: Berlin.
11. Daugman, J. G. (1985). Uncertainty relation for resolution in space, spatial frequency, and orientation optimized by two-dimensional visual cortical filters. Journal of the Optical Society of America A, 2, 1160-1169.
12. DeAngelis, G. C., Ohzawa, I. & Freeman, R. D. (1991). Depth is encoded in the visual cortex by a specialized receptive field structure. Nature, 352, 156-159.
13. DeAngelis, G. C., Ohzawa, I. & Freeman, R. D. (1993). Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. I. General characteristics and postnatal development. Journal of Neurophysiology, 69, 1091-1117.
14. DeAngelis, G. C., Ohzawa, I. & Freeman, R. D. (1995). Neuronal mechanisms underlying stereopsis: how do simple cells in the visual cortex encode binocular disparity? Perception, 24, 3-31.
15. Dow, B. M., Snyder, A. Z., Vautin, R. G. & Bauer, R. (1981). Magnification factor and receptive field size in foveal striate cortex of the monkey. Experimental Brain Research, 44, 213-228.
16. Emerson, R. C., Bergen, J. R. & Adelson, E. H. (1992). Directionally selective complex cells and the computation of motion energy in cat visual cortex. Vision Research, 32, 203-218.
17. Falk, D. S. (1980). Dynamic visual noise and the stereophenomenon: interocular time delays, depth and coherent velocities. Perception & Psychophysics, 28, 19-27.
18. Freeman, R. D. & Ohzawa, I. (1990). On the neurophysiological organization of binocular vision. Vision Research, 30, 1661-1676.
19. Gardner, J. C., Douglas, R. M. & Cynader, M. S. (1985). A time-based stereoscopic depth mechanism in the visual cortex. Brain Research, 328, 154-157.
20. Grzywacz, N. M. & Yuille, A. L. (1990). A model for the estimate of local image velocity by cells in the visual cortex. Proceedings of the Royal Society of London A, 239, 129-161.
21. Hamilton, D. B., Albrecht, D. G. & Geisler, W. S. (1989). Visual cortical receptive fields in monkey and cat: spatial and temporal phase transfer function. Vision Research, 29, 1285-1308.
22. Heeger, D. J. (1987). Model for the extraction of image flow. Journal of the Optical Society of America A, 48, 1455-1471.
23. Hildreth, E. C. (1984). Computations underlying the measurement of visual motion. Artificial Intelligence, 233, 309-355.
24. Hubel, D. H. & Wiesel, T. (1968). Receptive fields and functional architecture of the monkey striate cortex. Journal of Physiology, 195, 215-243.
25. Jones, J. P. & Palmer, L. A. (1987). The two-dimensional spatial structure of simple receptive fields in the cat striate cortex. Journal of Neurophysiology, 58, 1187-1211.
26. Julez, B. & White, B. (1969). Short term visual memory and the Pulfrich phenomenon. Science, 222, 639-641.
27. Kaufman, D. A. & Palmer, L. A. (1990). The luminance dependence of spatiotemporal response of cat striate cortical units. Investigative Ophthalmology and Visual Science Suppl. (ARVO), 31, 398.
28. Lennie, P. (1981). The physiological basis of variation in visual latency. Vision Research, 21, 815-824.
29. Mansfield, R. J. W. & Daugman, J. D. (1978). Retinal mechanisms of visual latency. Vision Research, 18, 1247-1260.
30. Marcelja, S. (1980). Mathematical description of the responses of simple cortical cells. Journal of the Optical Society of America A, 70, 1297-1300.
31. Marr, D. (1982) Vision: a computational investigation into the human representation and processing of visual information. San Francisco: W. H. Freeman.
32. Marr, D. & Poggio, T. (1976). Cooperative computation of stereo disparity. Science, 194, 283-287.
33. Marr, D. & Poggio, T. (1979). A computational theory of human stereo vision. Proceedings of the Royal Society of London B, 204, 301-328.
34. Maske, R., Yamane, S. & Bishop, P. O. (1984). Binocular simple cells for local stereopsis: comparison of receptive field organizations for the two eyes. Vision Research, 24, 1921-1929.
35. Maunsell, J. H. R. & Van Essen, D. C. (1983). Functional properties of neurons in middle temporal visual area of the macaque monkey - II. Binocular interactions and sensitivity to binocular disparity. Journal of Neurophysiology, 49, 1148-1167.
36. Morgan, M. J. (1975). Stereo illusion based on visual persistence. Nature, 256, 639-640.
37. Morgan, M. J. & Thompson, P. (1975). Apparent motion and the Pulfrich effect. Perception, 4, 3-18.
38. Nawrot, M. & Blake, R. (1989). Neural integration of information specifying structure from stereopsis and motion. Science, 244, 716-718.
39. Ohzawa, I., DeAngelis, G. C. & Freeman, R. D. (1990). Stereoscopic depth discrimination in the visual cortex: neurons ideally suited as disparity detectors. Science, 249, 1037-1041.
40. Poggio, G. F. & Fischer, B. (1977). Binocular interaction and depth sensitivity in striate and prestriate cortex of behaving rhesus monkey. Journal of Neurophysiology, 40, 1392-1405.
41. Poggio, G. F. & Poggio, T. (1984). The analysis of stereopsis. Annual Review of Neuroscience, 7, 379-412.
42. Pollard, S. B., Mayhew, J. E. & Frisby, J. P. (1985). PMF: a stereo correspondence algorithm using a disparity gradient limit. Perception, 14, 449-470.
43. Prazdny, K. (1985). Detection of binocular disparities. Biological Cybernetics, 52, 93-99.
44. Qian, N. (1994). Computing stereo disparity and motion with known binocular cell properties. Neural Computations, 6, 390-404.
45. Qian, N. & Andersen, R. A. (1994). Transparent motion perception as detection of unbalanced motion signals II: Physiology. Journal of Neuroscience, 14, 7367-7380.
46. Qian, N., Andersen, R. A. & Adelson, E. H. (1994a) Transparent motion perception as detection of unbalanced motion signals I: Psychophysics. Journal of Neuroscience, 14, 7357-7366.
47. Qian, N., Andersen, R. A. & Adelson, E, H. (1994b) Transparent motion perception as detection of unbalanced motion signals III: Modeling. Journal of Neuroscience, 14, 7381-7392.
48. Qian, N. & Sejnowski, T. J. (1989). Learning to solve random-dot stereograms of dense and transparent surfaces with recurrent backpropagation. Proceedings of the 1988 Connectionist Models Summer School, (pp. 435-443).
49. Qian, N. & Zhu, Y. (1995). Physiological computation of binocular disparity. Society of Neuroscience Abstracts, 21, 1507.
50. Regan, D. & Beverley, K. I. (1973). Disparity detectors in human depth perception: evidence for directional selectivity. Nature, 181, 877-879.
51. Reichardt, W. (1961) Autocorrelation, a principle for the evaluation of sensory information by the central nervous system. In Rosenblith, W. A. (Ed.), Sensory communication. New York: John Wiley.
52. Reid, R. C., Soodak, R. E. & Shapley, R. M. (1987). Linear mechanisms of directional selectivity in simple cells of cat striate cortex. Proceedings of the National Academy of Sciences USA, 84, 8740-8744.
53. Ross, J. (1974). Stereopsis by binocular delay. Nature, 248, 363-364.
54. Ross, J. & Hogben, J. H. (1975). The Pulfrich effect and the short term memory of stereopsis. Vision Research, 15, 1289-1290.
55. Sanger, T. D. (1988). Stereo disparity computation using gabor filters. Biological Cybernetics, 59, 405-418.
56. Snowden, R. J., Treue, S., Erickson, R. E. & Andersen, R. A. (1991). The response of area MT and VI neurons to transparent motion. Journal of Neuroscience, 11, 2768-2785.
57. Tyler, C. W. (1974). Stereopsis in dynamic visual noise. Nature, 250, 781-782.
58. van Santen, J. P. H. & Sperling, G. (1985). Elaborated Reichardt detectors. Journal of the Optical Society of America A, 2, 300-321.
59. Wagner, H. & Frost, B. (1993). Disparity-sensitive cells in the owl have a characteristic disparity. Nature, 364, 796-798.
60. Watson, A. B. & Ahumada, A. J. (1983) A look at motion in the frequency domain. In Tsotsos, J. K. (Ed.), Motion: representation and perception (pp. 1-10). North-Holland: Elsevier.
61. Watson, A. B. & Ahumada, A. J. (1985). Model of human visual-motion sensing. Journal of the Optical Society of America A, 2, 322-342.
62. Yeshurun, Y. & Schwartz, E. L. (1989). Cepstral filtering on a columnar image architecture - a fast algorithm for binocular stereo segmentation. IEEE Pat. Anal. Mach. Intell., 11, 759-767.
63. Zhu, Y. & Qian, N. (1996) Binocular receptive fields, disparity tuning, and characteristic disparity. Neural Comp. (in press).