Cortical Mechanisms for the Integration of Visual Motion

The Senses: A Comprehensive Reference

Volumn 2, Issue , 2008, Pages 189-218

  Pack, C C ^a   Born, R T ^b  

^a MCGILL UNIVERSITY   (Canada)

^b HARVARD MEDICAL SCHOOL   (United States)

Author keywords

Aperture problem; Computation; Cortex; Electrophysiology; Middle temporal; Modeling; Motion; Neuron; Perception; Primate; Receptive field; Sensory; Vision; Visual

Indexed keywords

EID: 84882563225     PISSN: None     EISSN: None     Source Type: Book    
DOI: 10.1016/B978-012370880-9.00309-1     Document Type: Chapter

References (145)

1. Adelson E.H., Bergen J.R. Spatiotemporal energy models for the perception of motion. J. Opt. Soc. Am. A 1985, 2:284-299.
2. Adelson E.H., Movshon J.A. Phenomenal coherence of moving visual patterns. Nature 1982, 300:523-525.
3. Albright T.D. Direction and orientation selectivity of neurons in visual area MT of the macaque. J. Neurophysiol. 1984, 52:1106-1130.
4. Albright T.D., Desimone R. Local precision of visuotopic organization in the middle temporal area (MT) of the macaque. Exp. Brain Res. 1987, 65:582-592.
5. Allman J., Miezin F., McGuinness E. Direction- and velocity-specific responses from beyond the classical receptive field in the middle temporal visual area (MT). Perception 1985, 14:105-126.
6. Anderson J.S., Lampl I., Gillespie D.C., Ferster D. Membrane potential and conductance changes underlying length tuning of cells in cat primary visual cortex. J. Neurosci. 2001, 21:2104-2112.
7. Attneave F. Some informational aspects of visual perception. Psychol. Rev. 1954, 61:183-193.
8. Barlow H. Possible Principles Underlying the Transformation of Sensory Messages. Sensory Communication 1961, 217-234. MIT Press. W.A. Rosenblith (Ed.).
9. Barlow H.B., Levick W.R. The mechanism of directionally selective units in rabbit's retina. J. Physiol. (Lond.) 1965, 178:477-504.
10. Barth E. A geometric view on early and middle level visual coding. Spat. Vis. 2000, 13:193-199.
11. Bayerl P., Neumann H. Disambiguating visual motion through contextual feedback modulation. Neural Comput. 2004, 16:2041-2066.
12. Blasdel G.G., Fitzpatrick D. Physiological organization of layer 4 in macaque striate cortex. J. Neurosci. 1984, 4:880-895.
13. Born R.T., Bradley D.C. Structure and function of visual area MT. Annu. Rev. Neurosci. 2005, 28:157-189.
14. Bowns L. Evidence for a feature tracking explanation of why type II plaids move in the vector sum direction at short durations. Vision Res. 1996, 36:3685-3694.
15. Bradley D.C., Goyal M.S., Scott B.B. Pattern Velocity Computation by Primate MT Neurons. Program No. 136.9. 2005, Abstract Viewer/Itinerary Planner 2005, Society for Neuroscience, Washington, DC.
16. Britten K.H., Heuer H.W. Spatial summation in the receptive fields of MT neurons. J. Neurosci. 1999, 19:5074-5084.
17. Britten K.H., Newsome W.T., Shadlen M.N., Celebrini S., Movshon J.A. A relationship between behavioral choice and the visual responses of neurons in macaque MT. Vis. Neurosci. 1996, 13:87-100.
18. Britten K.H., Shadlen M.N., Newsome W.T., Movshon J.A. The analysis of visual motion: a comparison of neuronal and psychophysical performance. J. Neurosci. 1992, 12:4745-4765.
19. Bulthoff H., Little J., Poggio T. A parallel algorithm for real-time computation of optical flow. Nature 1989, 337:549-555.
20. Carandini M., Ferster D. Membrane potential and firing rate in cat primary visual cortex. J. Neurosci. 2000, 20:470-484.
21. Carandini M., Heeger D.J., Movshon J.A. Linearity and normalization in simple cells of the macaque primary visual cortex. J. Neurosci. 1997, 17:8621-8644.
22. Castelo-Branco M., Goebel R., Neuenschwander S., Singer W. Neural synchrony correlates with surface segregation rules. Nature 2000, 405(6787):685-689.
23. Castet E., Charton V., Dufour A. The extrinsic/intrinsic classification of two-dimensional motion signals with barber-pole stimuli. Vision Res. 1999, 39:915-932.
24. Cavanaugh J.R., Bair W., Movshon J.A. Nature and interaction of signals from the receptive field center and surround in macaque V1 neurons. J. Neurophysiol. 2002, 88:2530-2546.
25. Churchland M.M., Priebe N.J., Lisberger S.G. Comparison of the spatial limits on direction selectivity in visual areas MT and V1. J. Neurophysiol. 2005, 93:1235-1245.
26. Courellis S.H., Marmarelis V.Z. Nonlinear Functional Representations for Motion Detection and Speed Estimation Schemes. Nonlinear Vision 1992, 91-108. CRC Press. B. Nabet, R.B. Pinter (Eds.).
27. DeAngelis G.C., Ohzawa I., Freeman R.D. Spatiotemporal organization of simple-cell receptive fields in the cat's striate cortex. II. Linearity of temporal and spatial summation. J. Neurophysiol. 1993, 69:1118-1135.
28. Derrington A., Suero M. Motion of complex patterns is computed from the perceived motions of their components. Vision Res. 1991, 31:139-149.
29. Dobbins A., Zucker S.W., Cynader M.S. Endstopping and curvature. Vision Res. 1989, 29:1371-1387.
30. Dow B.M. Functional classes of cells and their laminar distribution in monkey visual cortex. J. Neurophysiol. 1974, 37:927-946.
31. Dubner R., Zeki S.M. Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus in the monkey. Brain Res. 1971, 35:528-532.
32. Duncan R.O., Albright T.D., Stoner G.R. Occlusion and the interpretation of visual motion: perceptual and neuronal effects of context. J. Neurosci. 2000, 20:5885-5897.
33. Emerson R.C., Bergen J.R., Adelson E.H. Directionally selective complex cells and the computation of motion energy in cat visual cortex. Vision Res. 1992, 32:203-218.
34. Emerson R.C., Citron M.C., Vaughn W.J., Klein S.A. Nonlinear directionally selective subunits in complex cells of cat striate cortex. J. Neurophysiol. 1987, 58:33-65.
35. Fennema C., Thompson W. Velocity determination in scenes containing several moving objects. Comp. Graph. Image Process. 1979, 9:301-315.
36. Ferrera V.P., Wilson H.R. Direction specific masking and the analysis of motion in two dimensions. Vision Res. 1987, 27:1783-1796.
37. Ferrera V.P., Wilson H.R. Perceived direction of moving two-dimensional patterns. Vision Res. 1990, 30:273-287.
38. Gilbert C.D. Laminar differences in receptive field properties of cells in cat primary visual cortex. J. Physiol. 1977, 268:391-421.
39. Grossberg S., Mingolla E., Viswanathan L. Neural dynamics of motion integration and segmentation within and across apertures. Vision Res. 2001, 41:2521-2553.
40. Grzywacz N.M., Yuille A.L. A model for the estimate of local image velocity by cells in the visual cortex. Proc R Soc Lond B Biol Sci. 1990, 239(1295):129-161.
41. Guo K., Benson P.J., Blakemore C. Pattern motion is present in V1 of awake but not anaesthetized monkeys. Eur. J. Neurosci. 2004, 19:1055-1066.
42. Hartline H.K. The neural mechanisms of vision. Harvey Lectures Ser. 1941, 37:39.
43. Hartline H.K., Ratliff F. Inhibitory interaction of receptor units in the eye of Limulus. J. Gen. Physiol. 1957, 40:357-376.
44. Hassenstein B., Reichardt W. Systemtheoretische analyse der zeit-, reihenfolgen- und vorzeichenauswertung bei der bewegungsperzeption des rüsselkäfers, Chlorophanus. Z. Naturforsch. Teil. B 1956, 11:513-524.
45. Hawken M.J., Parker A.J., Lund J.S. Laminar organization and contrast sensitivity of direction-selective cells in the striate cortex of the Old World monkey. J. Neurosci. 1988, 8:3541-3548.
46. Heeger D.J. Model for the extraction of image flow. J. Opt. Soc. Am. A 1987, 4:1455-1471.
47. Heeger D.J., Simoncelli E.P., Movshon J.A. Computational models of cortical visual processing. Proc. Natl. Acad. Sci. U. S. A. 1996, 93:623-627.
48. Heuer H.W., Britten K.H. Contrast dependence of response normalization in area MT of the rhesus macaque. J. Neurophysiol. 2002, 88:3398-3408.
49. Hubel D.H., Livingstone M.S. Segregation of form, color, and stereopsis in primate area 18. J. Neurosci. 1987, 7:3378-3415.
50. Hubel D.H., Wiesel T.N. Receptive fields, binocular interaction and functional architecture in the cat's visual cortex. J Physiol 1962, 160:106-154.
51. Hubel D.H., Wiezel T.N. Receptive fields and functional architecture in two nonstriate visual areas (18 and 19) of the cat. J. Neurophysiol. 1965, 28:229-289.
52. Humphrey D.R., Corrie W.S. Properties of pyramidal tract neuron system within a functionally defined subregion of primate motor cortex. J. Neurophysiol. 1978, 41:216-243.
53. Hupé J.M., Rubin N. The dynamics of bi-stable alternation in ambiguous motion displays: a fresh look at plaids. Vision Res. 2003, 43:531-548.
54. Jones H.E., Grieve K.L., Wang W., Sillito A.M. Surround suppression in primate V1. J. Neurophysiol. 2001, 86:2011-2028.
55. Kapadia M.K., Westheimer G., Gilbert C.D. Dynamics of spatial summation in primary visual cortex of alert monkeys. Proc. Natl. Acad. Sci. U. S. A. 1999, 96:12073-12078.
56. Kawakami S., Okamoto H. A cell model for the detection of local image motion on the magnocellular pathway of the visual cortex. Vision Res. 1996, 36:117-147.
57. Koechlin E., Anton J.L., Burnod Y. Bayesian inference in populations of cortical neurons: a model of motion integration and segmentation in area MT. Biol. Cybern. 1999, 80:25-44.
58. Kooi F.L. Local direction of edge motion causes and abolishes the barberpole illusion. Vision Res. 1993, 33:2347-2351.
59. Krekelberg B., Albright T.D. Motion mechanisms in macaque MT. J. Neurophysiol. 2005, 93:2908-2921.
60. Kuffler S.W. Discharge patterns and functional organization of mammalian retina. J. Neurophysiol. 1953, 16:37-68.
61. Lamme V.A., Zipser K., Spekreijse H. Figure-ground activity in primary visual cortex is suppressed by anesthesia. Proc. Natl. Acad. Sci. U. S. A. 1998, 95:3263-3268.
62. Lemon R. Methods for Neuronal Recording in Conscious Animals 1984, Wiley.
63. Leopold D.A., Logothetis N.K. Multistable phenomena: changing views in perception. Trends Cogn. Sci. 1999, 3:254-264.
64. Levitt J.B., Lund J.S. Contrast dependence of contextual effects in primate visual cortex. Nature 1997, 387:73-76.
65. Lidén L., Pack C. The role of terminators and occlusion cues in motion integration and segmentation: a neural network model. Vision Res. 1999, 39:3301-3320.
66. Limb J.O., Murphy J.A. Estimating the velocity of moving images in television signals. Comp. Graph. Image Process. 1975, 4:311-327.
67. Lisberger S.G., Ferrera V.P. Vector averaging for smooth pursuit eye movements initiated by two moving targets in monkeys. J. Neurosci. 1997, 17:7490-7502.
68. Livingstone M.S., Hubel D.H. Specificity of intrinsic connections in primate primary visual cortex. J. Neurosci. 1984, 4:2830-2835.
69. Livingstone M.S., Pack C.C., Born R.T. Two-dimensional substructure of MT receptive fields. Neuron 2001, 30:781-793.
70. Lorençeau J., Alais D. Form constraints in motion binding. Nat. Neurosci. 2001, 4:745-751.
71. Lorençeau J., Shiffrar M. The influence of terminators on motion integration across space. Vision Res. 1992, 32:263-273.
72. Lorençeau J., Shiffrar M., Wells N., Castet E. Different motion sensitive units are involved in recovering the direction of moving lines. Vision Res. 1993, 33(9):1207-1217.
73. Majaj N.J., Carandini M., Movshon J.A. Motion integration by neurons in macaque MT is local, not global. J. Neurosci. 2007, 27:366-370.
74. Marr D. Vision 1982, W.H. Freeman & Co.
75. Maunsell J.H., van Essen D.C. The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. J. Neurosci. 1983, 3:2563-2586.
76. McDermott J., Adelson E.H. The geometry of the occluding contour and its effect on motion interpretation. J. Vis. 2004, 4(10):944-954.
77. Mikami A., Newsome W.T., Wurtz R.H. Motion selectivity in macaque visual cortex. II. Spatiotemporal range of directional interactions in MT and V1. J. Neurophysiol. 1986, 55:1328-1339.
78. Mingolla E., Todd J.T., Norman J.F. The perception of globally coherent motion. Vision Res. 1992, 32:1015-1031.
79. Movshon J.A., Newsome W.T. Visual response properties of striate cortical neurons projecting to area MT in macaque monkeys. J. Neurosci. 1996, 16:7733-7741.
80. Movshon J.A., Adelson E.H., Gizzi M.S., Newsome W.T. The Analysis of Moving Visual Patterns. Pattern Recognition Mechanisms 1985, 117-151. Vatican Press. C. Chagas, R. Gattass, C. Gross (Eds.).
81. Movshon J.A., Albright T.D., Stoner G.R., Majaj N.J., Smith M.A. Cortical responses to visual motion in alert and anesthetized monkeys. Nat. Neurosci. 2003, 6:3. (reply by Pack, C. C., Berezovskii, V. K. and Born, R. T., pp. 3-4).
82. Newsome W.T., Britten K.H., Movshon J.A. Neuronal correlates of a perceptual decision. Nature 1989, 341:52-54.
83. Nowlan S.J., Sejnowski T.J. A selection model for motion processing in area MT of primates. J. Neurosci. 1995, 15:1195-1214.
84. Ogata M., Sato T. Motion perception model with interaction between spatial frequency channels. Syst. Comput. Jap. 1991, 22:30-39.
85. Okamoto H., Kawakami S., Saito H., Hida E., Odajima K., Tamanoi D., Ohno H. MT neurons in the macaque exhibited two types of bimodal direction tuning as predicted by a model for visual motion detection. Vision Res. 1999, 39(20):3465-3479.
86. Pack C.C., Born R.T. Temporal dynamics of a neural solution to the aperture problem in visual area MT of macaque brain. Nature 2001, 409:1040-1042.
87. Pack C.C., Berezovskii V.K., Born R.T. Dynamic properties of neurons in cortical area MT in alert and anaesthetized macaque monkeys. Nature 2001, 414:905-908.
88. Pack C.C., Born R.T., Livingstone M.S. Two-dimensional substructure of motion and stereo interactions in primary visual cortex of alert macaque. Neuron 2003, 37:525-535.
89. Pack C.C., Conway B.R., Born R.T., Livingstone M.S. Spatiotemporal structure of nonlinear subunits in macaque visual cortex. J. Neurosci. 2006, 26:893-907.
90. Pack C.C., Gartland A.J., Born R.T. Integration of contour and terminator signals in visual area MT of alert macaque. J. Neurosci. 2004, 24:3268-3280.
91. Pack C.C., Livingstone M., Duffy K., Born R.T. End-stopping and the aperture problem: two-dimensional motion signals in macaque V1. Neuron 2003, 39:671-680.
92. Parker A.J., Newsome W.T. Sense and the single neuron: probing the physiology of perception. Annu. Rev. Neurosci. 1998, 21:227-277.
93. Perrone J.A., Thiele A. Speed skills: measuring the visual speed analyzing properties of primate MT neurons. Nat. Neurosci. 2001, 4(5):526-532.
94. Poggio T., Reichardt W. Considerations on models of movement detection. Kybernetik 1973, 13:223-227.
95. Polat U., Mizobe K., Pettet M.W., Kasamatsu T., Norcia A.M. Collinear stimuli regulate visual responses depending on cell's contrast threshold. Nature 1998, 391:580-584.
96. Power R.P., Moulden B. Spatial gating effects on judged motion of gratings in apertures. Perception 1992, 21:449-463.
97. Priebe N.J., Cassanello C.R., Lisberger S.G. The neural representation of speed in macaque area MT/V5. J. Neurosci. 2003, 23:5650-5661.
98. Priebe N.J., Lisberger S.G., Movshon J.A. Tuning for spatiotemporal frequency and speed in directionally selective neurons of macaque striate cortex. J. Neurosci. 2006, 26:2941-2950.
99. Qian N., Andersen R.A. Transparent motion perception as detection of unbalanced motion signals. II. Physiology. J. Neurosci. 1994, 14:7367-7380.
100. Recanzone G.H., Wurtz R.H., Schwarz U. Responses of MT and MST neurons to one and two moving objects in the receptive field. J. Neurophysiol. 1997, 78:2904-2915.
101. Reichardt W. Autocorrelation, a Principle for the Evaluation of Sensory Information by the Central Nervous System. Sensory Communications 1961, 303-318. Wiley. W.A. Rosenblith (Ed.).
102. Rodman H.R., Albright T.D. Single-unit analysis of pattern-motion selective properties in the middle temporal visual area (MT). Exp. Brain Res. 1989, 75(1):53-64.
103. Rubin N., Hochstein S. Isolating the effect of one-dimensional motion signals on the perceived direction of moving two-dimensional objects. Vision Res. 1993, 33:1385-1396.
104. Rust N.C., Mante V., Simoncelli E.P., Movshon J.A. How MT cells analyze the motion of visual patterns. Nat. Neurosci. 2006, 9:1421-1431.
105. Salzman C.D., Britten K.H., Newsome W.T. Cortical microstimulation influences perceptual judgements of motion direction. Nature 1990, 346:174-177.
106. Salzman C.D., Murasugi C.M., Britten K.H., Newsome W.T. Microstimulation in visual area MT: effects on direction discrimination performance. J. Neurosci. 1992, 12:2331-2355.
107. Sceniak M.P., Hawken M.J., Shapley R. Visual spatial characterization of macaque V1 neurons. J. Neurophysiol. 2001, 85:1873-1887.
108. Sceniak M.P., Ringach D.L., Hawken M.J., Shapley R. Contrast's effect on spatial summation by macaque V1 neurons. Nat. Neurosci. 1999, 2:733-739.
109. Sekuler R.W., Ganz L. Aftereffect of seen motion with a stabilized retinal image. Science 1963, 139:419-420.
110. Sereno M.E. Neural Computation of Pattern Motion 1993, MIT Press.
111. Shannon C.E. A mathematical theory of communication. Bell Syst. Tech. J. 1948, 27:379-423.
112. Shannon C.E., Weaver W. The Mathematical Theory of Communication 1963, University of Illinois Press.
113. Shimojo S., Silverman G.H., Nakayama K. Occlusion and the solution to the aperture problem for motion. Vision Res. 1989, 29:619-626.
114. Shipp S., Zeki S. The organization of connections between areas V5 and V1 in macaque monkey visual cortex. Eur. J. Neurosci. 1989, 1:309-332.
115. Simoncelli E.P., Heeger D.J. A model of neuronal responses in visual area MT. Vision Res. 1998, 38:743-761.
116. Simoncelli E.P., Bair W.D., Cavanaugh J.R., Movshon J.A. Testing and refining a computational model of neuronal responses in area MT. Investigative Ophthalmology and Visual Science 1996, 37:916.
117. Sincich L.C., Horton J.C. Independent projection streams from macaque striate cortex to the second visual area and middle temporal area. J. Neurosci. 2003, 23:5684-5692.
118. Skottun B.C. A model for end-stopping in the visual cortex. Vision Res. 1998, 38:2023-2035.
119. Skottun B.C. Neuronal responses to plaids. Vision Res. 1999, 39:2151-2156.
120. Snowden R.J., Treue S., Erickson R.G., Andersen R.A. The response of area MT and V1 neurons to transparent motion. J. Neurosci. 1991, 11:2768-2785.
121. Stocker A.A., Simoncelli E.P. Noise characteristics and prior expectations in human visual speed perception. Nat. Neurosci. 2006, 9:578-585.
122. Stoner G.R., Albright T.D. Neural correlates of perceptual motion coherence. Nature 1992, 358:412-414.
123. Stoner G.R., Albright T.D. The interpretation of visual motion: evidence for surface segmentation mechanisms. Vision Res. 1996, 36(9):1291-1310.
124. Stoner G.R., Albright T.D. Luminance contrast affects motion coherency in plaid patterns by acting as a depth-from-occlusion cue. Vision Res. 1998, 38(3):387-401.
125. Svaetichin G., MacNichol E.F. Retinal mechanisms for chromatic and achromatic vision. Ann. N. Y. Acad. Sci. 1959, 74:385-404.
126. Tal D., Schwartz E.L. Computing with the leaky integrate-and-fire neuron: logarithmic computation and multiplication. Neural Comput. 1997, 9:305-318.
127. Thiele A., Stoner G. Neuronal synchrony does not correlate with motion coherence in cortical area MT. Nature 2003, 421(6921):366-370.
128. Tinsley C.J., Webb B.S., Barraclough N.E., Vincent C.J., Parker A., Derrington A.M. The nature of V1 neural responses to 2D moving patterns depends on receptive-field structure in the marmoset monkey. J. Neurophysiol. 2003, 90:930-937.
129. Towe A.L., Harding G.W. Extracellular microelectrode sampling bias. Exp. Neurol. 1970, 29:366-381.
130. Trueswell J.C., Hayhoe M.M. Surface segmentation mechanisms and motion perception. Vision Res. 1993, 33(3):313-328.
131. Ullman S. The Interpretation of Visual Motion 1979, MIT Press.
132. Van Essen D.C., Newsome W.T., Maunsell J.H. The visual field representation in striate cortex of the macaque monkey: asymmetries, anisotropies, and individual variability. Vision Res. 1984, 24:429-448.
133. van Santen J.P., Sperling G. Elaborated Reichardt detectors. J. Opt. Soc. Am. A 1985, 2:300-321.
134. Wallach H. Uber visuell wahrgenommene Bewegungsrichtung. Psychol. Forsch. 1935, 20:325-380.
135. Watson A.B., Ahumada A.J. Model of human visual-motion sensing. J Opt Soc Am A. 1985, 2(2):322-341.
136. Weiss Y., Adelson E.H. Slow and smooth: a Bayesian theory for the combination of local motion signals in human vision. AI Memo 1998, 1624.
137. Weiss Y., Simoncelli E.P., Adelson E.H. Motion illusions as optimal percepts. Nat. Neurosci. 2002, 5:598-604.
138. Welch L. The perception of moving plaids reveals two motion-processing stages. Nature 1989, 337:734-736.
139. Wiener N. Nonlinear Problems in Random Theory 1958, MIT Press.
140. Wuerger S., Shapley R., Rubin N. "On the visually perceived direction of motion" by Hans Wallach: 60 years later. Perception 1996, 25:1317-1367.
141. Yo C., Wilson H.R. Perceived direction of moving two-dimensional patterns depends on duration, contrast and eccentricity. Vision Res. 1992, 32:135-147.
142. Zetzsche C., Barth E. Fundamental limits of linear filters in the visual processing of two-dimensional signals. Vision Res. 1990, 30:1111-1117.
143. Bradley D.C., Qian N., Andersen R.A. Integration of motion and stereopsis in middle temporal cortical area of macaques. Nature 1995, 373:609-611.
144. http://www.cns.nyu.edu/~hupe/plaid_demo/demo_plaids.html.
145. field=filename&op=matches&value= HypercomplexCortCell250.mpg&template= main_record&catalog=protol. http://viperlib.york.ac.uk/scripts/Portweb.dll?