The role of terminators and occlusion cues in motion integration and segmentation: A neural network model

Vision Research

Volumn 39, Issue 19, 1999, Pages 3301-3320

  Lidén, Lars ^a   Pack, Christopher ^b  

^a BOSTON UNIVERSITY   (United States)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Modeling; Motion integration; Motion segmentation; MT; Occlusion; Terminators

Indexed keywords

ARTIFICIAL NEURAL NETWORK; ASSOCIATION; HUMAN; MODEL; MOTION; PERCEPTIVE DISCRIMINATION; PRIORITY JOURNAL; REVIEW;

EID: 0033019772     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0042-6989(99)00055-3     Document Type: Article

References (91)

1. Adelson E., Bergen J. Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America: A. 2(2):1985;284-299.
2. Adelson E., Movshon A. Phenomenal coherence of moving visual patterns. Nature. 300:1982;523-525.
3. Allman J., Miezin F., McGuinness E. Direction- and velocity-specific responses from beyond the classical receptive field in the middle temporal visual area (MT). Perception. 14:1985;105-126.
4. Anstis S. Imperceptible intersections: the chopstick illusion. Blake A., Troscianko T. AI and the eye. 1990;105-117 Wiley, New York.
5. Barlow H., Levick W. The mechanism of directionally selective units in rabbit's retina. Journal of Physiology. 178:1965;477-504.
6. Ben-Av M.B., Shiffrar M. Disambiguating velocity estimates across image space. Vision Research. 35:1995;2889-2995.
7. Blasdel G., Fitzpatrick D. Physiological organization of layer 4 in macaque striate cortex. Journal of Neuroscience. 4(3):1984;880-895.
8. Born R., Tootell R. Segregation of global and local motion processing in primate middle temporal visual area. Nature. 357:1992;497-499.
9. Braddick O. Segmentation versus integration in visual motion processing. Trends in Neuroscience. 16(7):1993;263-268.
10. Bradley D., Qian N., Anderson R. Integration of motion and stereopsis in middle temporal cortical area of macaque. Nature. 373:1995;609-611.
11. Bulthoff H., Little J., Poggio T. A parallel algorithm for real-time computation of optical flow. Nature. 337:1989;549-553.
12. Bulthoff H., Little J., Poggio T. A parallel motion algorithm consistent with psychophysics and physiology. Proceedings: workshop on visual motion. 1989;165-172 Irvine, California.
13. Castet E., Charton V., Dufour A. The extrinsic/intrinsic classification of 2D motion signals with barber-pole stimuli. Vision Research. 39:1999;915-932.
14. Cavanagh P. Reconstructing the third dimension: interactions between color, texture, motion, binocular disparity, and shape. Computer Vision, Graphics and Image Processing. 37:1987;171-195.
15. Chey J., Grossberg S., Mingolla E. Neural dynamics of motion grouping: from aperture ambiguity to object speed and direction. Journal of the Optical Society of America. 14(10):1997;2570-2594.
16. DeYoe E., Van Essen D. Segregation of efferent connections and receptive field properties in visual area V2 of the macaque. Nature. 317:1985;58-61.
17. Dow B. Functional classes of cells and their laminar distribution in monkey visual cortex. Journal of Neurophysiology. 37:1974;927-945.
18. Duffy C., Wurtz R. Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. Journal of Neurophysiology. 65(6):1991;1329-1345.
19. Duffy C., Wurtz R. Sensitivity of MST neurons to optic flow stimuli. II. Mechanisms of response selectivity revealed by small-field stimuli. Journal of Neurophysiology. 65(6):1991;1346-1359.
20. Fennema C., Thompson W. Velocity determination in scenes containing several moving objects. Computer Graphics and Image Processing. 9:1979;301-315.
21. Ferrera V., Lisberger S. Neuronal responses in visual areas MT and MST during smooth pursuit target selection. Journal of Neurophysiology. 78:1997;1433-1446.
22. Gattass R., Gross C. Visual topography of striate projection zone (MT) in posterior superior temporal sulcus of the macaque. Journal of Neurophysiology. 46(3):1981;621-638.
23. Geesaman B., Andersen R. The analysis of complex motion patterns by form/cue invariant MSTd neurons. Journal of Neuroscience. 16(15):1996;4716-4732.
24. Graziano M., Andersen R., Snowden R. Tuning of MST neurons to spiral motions. Journal of Neuroscience. 14(1):1994;54-67.
25. Grossberg S. 3-D vision and figure-ground separation by visual cortex. Perception and Psychophysics. 55(1):1994;48-120.
26. Grossberg S. Cortical dynamics of three-dimensional figure-ground perception of two-dimensional pictures. Psychological Review. 104(3):1997;618-658.
27. Grossberg S., Mingolla E. Neural dynamics of form perception: boundary completion illusory figures and neon color spreading. Psychological Review. 92(2):1985;173-311.
28. Grossberg S., Rudd M. A neural architecture for visual motion perception: group and element apparent motion. Neural Networks. 2:1989;421-450.
29. Grossberg S., Rudd M.E. Cortical dynamics of visual motion perception: short-range and long-range apparent motion. Psychological Review. 99(1):1992;78-121.
30. Grunewald A. A model of transparent motion and non-transparent motion aftereffects. Advances in Neural Information Processing Systems. 8:1996;838-843.
31. Guzman A. Decomposition of a visual scene into three-dimensional bodies. Grasselli A. Automatic interpretation and classification of images. 1969;243-276 Academic, New York.
32. Hildreth E. The measurement of visual motion. 1983;MIT, Cambridge, MA.
33. Hildreth E., Koch C. The analysis of visual motion: from computational theory to neuronal mechanisms. Annual Reviews in Neuroscience. 10:1987;477-633.
34. Hiris E., Blake R. Direction repulsion in motion transparency. Visual Neuroscience. 13:1996;187-197.
35. Horn B., Schunck B. Determining optical flow. Artificial Intelligence. 17:1981;185-203.
36. Hutchinson J., Koch C., Luo J., Mead C. Computing motion using analog and binary resistive networks. Computer. 21:1988;52-63.
37. Koch C., Wang T., Mathur B. Computing motion in the primate's visual system. Journal of Experimental Biology. 146:1989;115-139.
38. Komatsu H., Wurtz R. Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. Journal of Neurophysiology. 60(2):1988;580-603.
39. Lidén L. A neural model of visual motion segmentation and integration. 1997;Computational Science Graduate Fellowship Conference, Washington DC.
40. Lidén L. A model of motion integration and segmentation in area MT. Investigative Ophthalmology and Visual Science. 38:1998;327.
41. Lidén L., Mingolla E. Monocular occlusion cues alter the influence of terminator motion in the barber pole phenomenon. Vision Research. 38:1998;3883-3898.
42. Lorenceau J., Shiffrar M. The influence of terminators on motion integration across space. Vision Research. 32(2):1992;263-273.
43. Lorenceau J., Shiffrar M., Wells N., Castet E. Different motion sensitive units are involved in recovering the direction of moving lines. Vision Research. 33(9):1993;1207-1217.
44. Marcar V., Xiao K., Raiguel S., Maes H., Orban G. Processing of kinetically defined boundaries in the cortical motion area MT of the macaque monkey. Journal of Neurophysiology. 74(3):1995;1258-1270.
45. Marr D. Directional selectivity. Marr D. Vision. 1982;159-182 Freeman, San Francisco.
46. Marr D., Ullman S. Directional selectivity and its use in early visual processing. Proceeding of the Royal Society of London: B. 211:1981;151-180.
47. Maunsell J., Van Essen D. The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. Journal of Neuroscience. 3(12):1983;2563-2586.
48. Nakayama K., Loomis J. Optical velocity patterns, velocity-sensitive neurons, and space perception: a hypothesis. Perception. 3:1974;63-80.
49. Nakayama K., Silverman G. The aperture problem. I. Perception of nonrigidity and motion direction in translating sinusoidal lines. Vision Research. 28(6):1988;739-746.
50. Nakayama K., Silverman G. The aperture problem. II. Spatial integration of velocity information along contours. Vision Research. 28(6):1988;747-753.
51. Nowlan S., Sejnowski T. Filter selection model for motion segmentation and velocity integration. Journal of the Optical Society of America. A. 11(12):1994;3177-3200.
52. Pack, C. (1998) Visual cortical mechanisms of motion perception and navigation: experiments and models. Doctoral Thesis, Boston University.
53. Pack C., Grossberg S., Mingolla E. Cortical processing of visual motion for smooth pursuit eye movements. Society for Neuroscience Abstracts. 24:1998;34-40.
54. Poggio T., Koch C. Ill-posed problems in early vision: from computational theory to analogue networks. Proceedings of the Royal Society of London: B. 226:1985;303-323.
55. Poggio T., Torre V., Koch C. Computational vision and regularization theory. Nature. 317:1985;314-319.
56. Qian N., Andersen R. Transparent motion perception as detection of unbalanced motion signals. II. Physiology. Journal of Neuroscience. 14(12):1994;7367-7380.
57. Qian N., Andersen R., Adelson E. Transparent motion perception as detection of unbalanced motion signals. III. Modeling. Journal of Neuroscience. 14(12):1994;7381-7392.
58. Raiguel S., Van Hulle M., Xiao D., Marcar V., Orban G. Shape and spatial distribution of receptive fields and antagonistic motion surrounds in the middle temporal area (V5) of the macaque. European Journal of Neuroscience. 7:1995;2064-2082.
59. Ramachandran V., Anstis S. The perception of apparent motion. Scientific American. 254(6):1986;102-109.
60. Ramachandran V., Anstis S. Figure-ground segregation modulates apparent motion. Vision Research. 26(12):1986;1969-1975.
61. Reichardt W. Autocorrelation, a principle for the evaluation of sensory information by the central nervous system. Rosenblith W. Sensory communication. 1961;303-317 MIT, Cambridge, MA.
62. Rodman H., Albright T. Single-unit analysis of pattern-motion selective properties in the middle temporal visual area (MT). Experimental Brain Research. 75:1989;53-64.
63. Sachtler W., Zaidi Q. Visual processing of motion boundaries. Vision Research. 35(6):1995;807-826.
64. Saito H. Hierarchical neural analysis of optical flow in the macaque visual pathway. Ono T., Squire L., Raichle M., Perrett D., Fukuda M. Brain mechanisms of perception and memory: from neuron to behavior. 1993;121-139 Oxford, New York.
65. Shiffrar M., Lorenceau J. Increased motion linking across edges with decreased luminance contrast, edge width and duration. Vision Research. 36(14):1996;2061-2067.
66. Shiffrar M., Pavel M. Percepts of rigid motion within and across apertures. Journal of Experimental Psychology: Human Perception and Performance. 17(3):1991;749-761.
67. Shimojo S., Silverman G.H., Nakayama K. Occlusion and the solution to the aperture problem for motion. Vision Research. 29:1989;619-626.
68. Shipp S., Zeki S. Segregation of pathways leading from area V2 to areas V4 and V5 of macaque monkey visual cortex. Nature. 315:1985;322-325.
69. Sillito A. The contribution of inhibitory mechanisms to the receptive filed properties of neurones in the striate cortex of the cat. Journal of Physiology. 250:1975;305-329.
70. Snowden R., Braddick O. The combination of motion signals over time. Vision Research. 29(11):1989;1621-1630.
71. Snowden R.J., Treue S., Erickson R.G., Andersen R.A. The response of area MT and V1 neurons to transparent motion. Journal of Neuroscience. 11(9):1991;2768-2785.
72. Stoner G., Albright T. Image segmentation cues in motion processing: implications for modularity in vision. Journal of Cognitive Neuroscience. 5(2):1993;129-149.
73. Tanaka K., Hikosaka K., Saito H., Yukie M., Fukada Y., Iwai E. Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey. Journal of Neuroscience. 6(1):1986;134-144.
74. Tanaka K., Sugita Y., Moriya M., Saito H. Analysis of object motion in the ventral part of the medial superior temporal area of the macaque visual cortex. Journal of Neurophysiology. 69(1):1993;128-142.
75. Tse P., Cavanagh P., Nakayama K. The role of parsing in high-level motion processing. Watanabe T. Visual motion processing: from computational, neurophysiological and psychophysical perspectives. 1998;MIT, Cambridge, MA.
76. Vaina, L., & Grzywacz, N. (1992). Testing computational theories of motion discontinuities: a psychophysical study. Second European Conference on Computer Vision (pp. 212-216). Santa Margherita Ligure, Italy.
77. Vaina L., Grzywacz N., Kikinis R. Segregation of computations underlying perception of motion discontinuity and coherence. NeuroReport. 5:1994;2289-2294.
78. Van Essen D., Maunsell J., Bixby J. The middle temporal visual area in macaque: myeloarchitecture, connections, functional properties and topographic organization. Journal of Comparative Neurology. 199:1981;292-326.
79. Van Santen J., Sperling G. Temporal covariance model of human motion perception. Journal of the Optical Society of America: A. 1(5):1984;451-473.
80. Van Santen J., Sperling G. Elaborated reichardt detectors. Journal of the Optical Society of America: A. 2(2):1985;300-321.
81. Wallach H. On perception. 1976;Quadrangle, New York.
82. Wang H., Mathur B., Koch C. Computing optical flow in the primate visual system. Neural Computation. 1:1989;92-103.
83. Watamaniuk S., McKee S., Grzywacz N. Detecting a trajectory embedded in random-direction motion noise. Vision Research. 35(1):1995;65-77.
84. Watanabe T., Cavanagh P. Texture and motion spreading, the aperture problem, and transparency. Perception and Psychophysics. 50(5):1991;459-464.
85. Watanabe T., Cole R. Propagation of local motion correspondence. Vision Research. 35(20):1995;2853-2861.
86. Weiss, Y., & Adelson, E. (1994). Perceptually organized EM: a framework for motion segmentation that combines information about form and motion. MIT Media laboratory Perceptual Computing Section, Technical Report #315.
87. Williams D., Sekuler R. Coherent global motion percepts from stochastic local motions. Vision Research. 24(1):1984;55-62.
88. Wurtz R., Yamasaki D., Duffy C., Roy J. Functional specialization for visual motion processing in primate cerebral cortex. Cold spring harbor symposia on quantitative biology. 1990;717-727 Cold Spring Harbor Laboratory, New York.
89. Yuille A.L., Grzywacz N.M. A computational theory for the perception of coherent visual motion. Nature. 333(6168):1988;71-74.
90. Zeki S. Cells responding to changing image size and disparity in the cortex of rhesus monkey. Journal of Physiology. 242:1974;827-841.
91. Zeki S. Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey. Journal of Physiology. 236:1974;549-573.