A model of neuronal responses in visual area MT

Vision Research

Volumn 38, Issue 5, 1998, Pages 743-761

  Simoncelli, Eero P ^a   Heeger, David J ^b  

^a NEW YORK UNIVERSITY   (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

Model; MT; Normalization; Opponency; Velocity

Indexed keywords

ARTICLE; DIRECTIONAL VISION; ELECTROPHYSIOLOGY; MATHEMATICAL MODEL; METHODOLOGY; NERVE CELL; PRIMATE; PRIORITY JOURNAL; RECEPTIVE FIELD; SIMULATION; STIMULUS RESPONSE; TEMPORAL CORTEX; VELOCITY; VISUAL STIMULATION;

BRAIN MAPPING; HUMANS; MATHEMATICS; MODELS, NEUROLOGICAL; MOTION PERCEPTION; TIME FACTORS;

EID: 0032031687     PISSN: 00426989     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0042-6989(97)00183-1     Document Type: Article

References (109)

1. Adelson, E. H. & Bergen, J. R. (1985). Spatiotemporal energy models for the perception of motion. Journal of the Optical Society of America A, 2, 284-299.
2. Adelson, E. H. & Bergen, J. R. (1986). The extraction of spatiotemporal energy in human and machine vision. In Proceedings of IEEE Workshop on Motion: Representation and Analysis (pp. 151-156). S. Carolina: Charleston.
3. Adelson, E. H. & Movshon, J. A. (1982). Phenomenal coherence of moving visual patterns. Nature, 3005892, 523-525.
4. Albrecht, D. G., Farrar, S. B. & Hamilton, D. B. (1984). Spatial contrast adaptation characteristics of neurones recorded in the cat's visual cortex. Journal of Physiology (London), 347, 713-739.
5. Albrecht, D. G. & Geisler, W. S. (1991). Motion sensitivity and the contrast-response function of simple cells in the visual cortex. Visual Neuroscience, 7, 531-546.
6. Albright, T. D. (1984). Direction and orientation selectivity of neurons in visual area MT of the macaque. Journal of Neurophysiology, 52, 1106-1130.
7. Albright, T. D. (1992). Form-cue invariant motion processing in primate visual cortex. Science, 255, 1141-1143.
8. Albright, T. D. (1993). Cortical processing of visual motion. In Miles, F. A. & Wallman, J. (Eds), Visual motion and its role in the stabilization of gaze (pp. 177-201). Oxford: Elsevier.
9. Albright, T. D. & Desimone, R. (1987). Local precision of visutopic organization in the middle temporal area (MT) of the macaque. Experimental Brain Research, 65, 582-592.
10. Allman, J., Miezin, F. & McGuinness, E. (1985a) Direction and velocity-specific responses from beyond the classical receptive field in the middle temporal visual area. Perception, 14, 105-126.
11. Allman, J., Miezin, F. & McGuinness, E. (1985b) Stimulus specific responses from beyond the classical receptive field. Annual Review of Neuroscience, 8, 407-428.
12. Benardete, E. A., Kaplan, E. & Knight, B. W. (1992). Contrast gain control in the primate retina: P cells are not X-like, some M cells are. Visual Neuroscience, 8, 483-486.
13. Bonds, A. B. (1989). Role of inhibition in the specification of orientation selectivity of cells in the cat striate cortex. Visual Neuroscience, 2, 41-55.
14. Born, R. T. & Tootell, R. B. (1992). Segregation of global and local motion processing in middle temporal visual area. Nature, 357, 497-499.
15. Bradley, D. C., Qian, N. & Andersen, R. A. (1995). Integration of motion and stereopsis in middle temporal cortical area of macaques. Nature, 373, 609-611.
16. Britten, K. H., Shadlen, M. N., Newsome, W. T. & Movshon, J. A. (1992). The analysis of visual motion: a comparison of neuronal and psychophysical performance. Journal of Neuroscience, 12, 4745-4765.
17. Britten, K. H., Shadlen, M. N., Newsome, W. T. & Movshon, J. A. (1993). Responses of neurons in macaque MT to stochastic motion signals. Visual Neuroscience, 10, 1157-1169.
18. Burr, D. C., Ross, J. & Morrone, M. C. (1986). Seeing objects in motion. Proceedings of the Royal Society of London B, 227, 249-265.
19. Campbell, F. W., Cleland, B. G., Cooper, G. F. & Enroth-Cugell, C. (1968). The angular selectivity of visual cortical cells to moving gratings. Journal of Physiology (London), 198, 237-250.
20. Campbell, F. W., Cooper, G. F. & Enroth-Cugell, C. (1969). The spatial selectivity of visual cells of the cat. Journal of Physiology (London), 203, 223-235.
21. Carandini, M. (1996). Linearity, gain control and spike encoding in the primary visual cortex. PhD thesis, New York University, Center for Neural Science, New York, NY.
22. Carandini, M. & Heeger, D. J. (1994). Summation and division by neurons in primate visual cortex. Science, 264, 1333-1336.
23. Carandini, M., Heeger, D. J. & Movshon, J. A. (1997). Linearity and normalization in simple cells on the macaque primary visual cortex. Journal of Neuroscience, 17, 8621-8644.
24. Cavanagh, P. & Mather, G. (1989). Motion: the long and short of it. Spatial Vision, 4, 103-129.
25. Chubb, C. & Sperling, G. (1988). Drift-balanced random stimuli: a general basis for studying non-Fourier motion perception. Journal of the Optical Society of America A, 5, 1986-2006.
26. Chubb, C. & Sperling, G. (1989). Two motion perception mechanisms revealed through distance-driven reversal of apparent motion. Proceedings of the National Academy of Sciences USA, 86, 2985-2989.
27. DeAngelis, G. C., Ohzawa, I. & Freeman, R. D. (1993). The spatiotemporal organization of simple cell receptive fields in the cat's striate cortex, II. Linearity of temporal and spatial summation. Journal of Neurophysiology, 69, 1118-1135.
28. DeAngelis, G. C., Robson, J. G., Ohzawa, I. & Freeman, R. D. (1992). The organization of suppression in receptive fields of neurons in the cat's visual cortex. Journal of Neurophysiology, 68, 144-163.
29. Derrington, A. M. & Lennie, P. (1984). Spatial and temporal contrast sensitivities of neurones in lateral geniculate nucleus of macaque. Journal of Physiology (London), 357, 219-240.
30. Dubner, R. & Zeki, S. M. (1971). Response properties and receptive fields of cells in an anatomically defined region of the superior temporal sulcus of the monkey. Brain Research, 35, 528-532.
31. Dursteler, M. R., Newsome, W. T. & Wurtz, R. H. (1986). Directional and retinotopic pursuit deficits following lesions of the foveal representation within the superior temporal sulcus of the macaque monkey. Journal of Neurophysiology, 57, 1262.
32. Emerson, R. C., Bergen, J. R. & Adelson, E. H. (1992). Directionally selective complex cells and the computation of motion energy in cat visual cortex. Vision Research, 32, 203-218.
33. Fahle, M. & Poggio, T. (1981). Visual hyperacuity: spatiotemporal interpolation in human vision. Proceedings of the Royal Society of London B, 213, 451-477.
34. Fennema, C. L. & Thompson, W. B. (1979). Velocity determination in scenes containing several moving objects. Computer Vision, Graphics, and Image Processing, 9, 301-315.
35. Fleet, D. J. & Langley, K. (1994). Computational analysis of non-Fourier motion. Vision Research, 22, 3057-3079.
36. Fleet, D. J. & Langley, K. (1995). Recursive filters for optical flow. IEEE Pattern Analysis and Machine Intelligence, 17, 61-67.
37. Freeman, W. T. & Adelson, E. H. (1991). The design and use of steerable filters. IEEE Pattern Analysis and Machine Intelligence, 13, 891-906.
38. Georgopoulos, A. P., Schwartz, A. B. & Kettner, R. E. (1986). Neuronal population coding of movement direction. Nature, 233, 1416-1419.
39. Gizzi, M. S., Katz, E., Schumer, R. A. & Movshon, J. A. (1990). Selectivity for orientation and direction of motion of single neurons in cat striate and extrastriate visual cortex. Journal of Neurophysiology, 63, 1529-1543.
40. Groh, J. M., Born, R. T. & Newsome, W. T. (1995). Microstimulation of area MT affects both saccades and smooth pursuit eye movements. Society of Neuroscience Abstracts, 21, 281.
41. Grzywacz, N. M. & Yuille, A. L. (1990). A model for the estimate of local image velocity by cells in the visual codex. Proceedings of the Royal Society of London A, 239, 129-161.
42. Hamilton, D. B., Albrecht, D. G. & Geisler, W. S. (1989). Visual cortical receptive fields in monkey and cat: spatial and temporal phase transfer function. Vision Research, 29, 1285-1308.
43. Hammond, P. & Reck, J. (1980). Influence of velocity on directional tuning of complex cells in cat striate cortex for texture motion. Neuroscience Letters, 19, 309-314.
44. Hammond, P. & Smith, A. T. (1983). Directional tuning interactions between moving oriented and textured stimuli in complex cells of feline striate cortex. Journal of Physiology (London), 342, 35-49.
45. Heeger, D. J. (1987). Model for the extraction of image flow. Journal of the Optical Society of America A, 4, 1455-1471.
46. Heeger, D. J. (1991). Nonlinear model of neural responses in cat visual cortex. In Landy, M. & Movshon, J. A. (Eds), Computational models of visual processing (pp. 119-133). Cambridge, MA: MIT Press.
47. Heeger, D. J. (1992a) Half-squaring in responses of cat simple cells. Visual Neuroscience, 9, 427-443.
48. Heeger, D. J. (1992b) Normalization of cell responses in cat striate cortex. Visual Neuroscience, 9, 181-198.
49. Heeger, D. J. (1993). Modeling simple cell direction selectivity with normalized, half-squared, linear operators. Journal of Neurophysiology, 70, 1885-1898.
50. Heeger, D. J. & Simoncelli, E. P. (1993). Model of visual motion sensing. In Harris, L. & Jenkin, M. (Eds), Spatial vision in humans and robots (pp. 367-392). New York: Cambridge University Press.
51. Heeger, D. J., Simoncelli, E. P. & Movshon, J. A. (1996). Computational models of cortical visual processing. Proceedings of the National Academy of Sciences USA, 93, 623-627.
52. Hubel, D. & Wiesel, T. (1962). Receptive fields, binocular interaction, and functional architecture in the cat's visual cortex. Journal of Physiology (London), 160, 106-154.
53. Johnston, A., McOwan, P. W. & Buxton, H. (1992). A computational model of the analysis of some first-order and second-order motion patterns by simple and complex cells. Proceedings of the Royal Society of London B, 250, 297-306.
54. Koenderink, J. J. & van Doorn, A. J. (1987). Representation of local geometry in the visual system. Biological Cybernetics, 55, 367-375.
55. Lagae, L., Raiguel, S. & Orban, G. A. (1993). Speed and direction selectivity of macaque middle temporal neurons. Journal of Neurophysiology, 69, 19-39.
56. Logothetis, N. K. & Schall, J. D. (1989). Neuronal correlates of subjective visual perception. Science, 245, 761-763.
57. Maunsell, J. H. R. & van Essen, D. C. (1983a) Functional properties of neurons in middle temporal visual area of the macaque monkey 1. Selectivity for stimulus direction, speed, and orientation. Journal of Neurophysiology, 49, 1127-1147.
58. Maunsell, J. H. R. & van Essen, D. C. (1983b) Functional properties of neurons in middle temporal visual area of the macaque monkey II. Binocular interactions and sensitivity to binocular disparity. Journal of Neurophysiology, 49, 1148-1167.
59. Maunsell, J. H. R. & van Essen, D. C. (1987). Topographic organization of the middle temporal visual area in the macaque monkey: representational biases and the relationship to callosal connections and myeloarchitectonic boundaries. Journal of Comparative Neurology, 266, 535-555.
60. Maunsell, J. H. R., Nealy, T. A. & DePriest, D. D. (1990). Magnocellular and parvocellular contributions to responses in the middle temporal visual area (MT) of the macaque monkey. Journal of Neuroscience, 10, 3323-3334.
61. Maunsell, J. H. R. & Newsome, W. T. (1987). Visual processing in monkey extrastriate cortex. Annual Review of Neuroscience, 10, 363-401.
62. McLean, J. & Palmer, L. A. (1989). Contribution of linear spatiotemporal receptive field structure to velocity selectivity of simple cells in area 17 of cat. Vision Research, 29, 675-679.
63. McLean, J., Raab, S. & Palmer, L. A. (1994). Contribution of linear mechanisms to the specification of local motion by simple cells in areas 17 and 18 of the cat. Visual Neuroscience, 11, 271-294.
64. Mikami, A., Newsome, W. T. & Wurtz, R. H. (1986). Motion selectivity in macaque visual cortex. I. Mechanisms of direction and speed selectivity in extrastriate area MT. Journal of Neurophysiology, 55, 1308-1327.
65. Movshon, J. A., Adelson, E. H., Gizzi, M. S. & Newsome, W. T. (1986). The analysis of moving visual patterns. In Chagas, C., Gattass R. & Gross, C. (Eds), Experimental brain research supplementum II: Pattern recognition mechanisms (pp. 117-151). New York: Springer.
66. Movshon, J. A., Lisberger, S. G. & Krauzlis, R. J. (1990). Visual cortical signals supporting smooth pursuit eye movements. In Cold Spring Harbor Symposia on Quantitative Biology, Vol. 15, pp. 707-716.
67. Movshon, J. A. & Newsome, W. T. (1996). Visual response properties of striate cortical neurons projecting to area MT in macaque monkeys. Visual Neuroscience, 1623, 7733-7741.
68. Movshon, J. A., Thompson, I. D. & Tolhurst, D. J. (1978a) Receptive field organization of complex cells in the cat's striate cortex. Journal of Physiology (London), 283, 79-99.
69. Movshon, J. A., Thompson, I. D. & Tolhurst, D. J. (1978b) Spatial summation in the receptive fields of simple cells in the cat's striate cortex. Journal of Physiology (London), 283, 53-77.
70. Nestares, O. & Heeger, D. J. (1997). Modeling the apparent frequency-specific suppression in simple cells responses. Vision Research, 37, 1535-1543.
71. Newsome, W. T., Britten, K. H. & Movshon, J. A. (1989). Neuronal correlates of a perceptual decision. Nature, 341, 52-54.
72. Newsome, W. T., Gizzi, M. S. & Movshon, J. A. (1983). Spatial and temporal properties of neurons in macaque MT. Investigative Ophthalmology and Visual Science Supplement, 24, 106.
73. Newsome, W. T. & Pare, E. B. (1988). A selective impairment of motion perception following lesions of the middle temporal visual area (MT). Journal of Neuroscience, 8, 2201-2211.
74. Newsome, W. T., Wurtz, R. H., Dursteler, M. R. & Mikami, A. (1985). Deficits in visual motion processing following ibotenic acid lesions of the middle temporal visual area of the macaque monkey. Journal of Neuroscience, 5, 825-840.
75. Nowlan, S. J. & Sejnowski, T. J. (1995). A selection model for motion processing in area MT of primates. Journal of Neuroscience, 15, 1195-1214.
76. O'Keefe, L. P., Carandini, M., Beusmans, J. M. H. & Movshon, J. A. (1993). MT neuronal responses to 1st-and 2nd-order motion. Society for Neuroscience Abstracts, 19, 1283.
77. Pollen, D. & Ronner, S. (1983). Visual cortical neurons as localized spatial frequency filters. IEEE Transactions on Systems, Man, and Cybernetics, 13, 907-916.
78. Qian, N. & Andersen, R. A. (1994). Transparent motion perception as detection of unbalanced motion signals: II. Physiology. Journal of Neuroscience, 14, 7367-7380.
79. Robson, J. G. (1988). Linear and nonlinear operations in the visual system. Investigative Ophthalmology and Visual Science Supplement, 29, 117.
80. Rodman, H. R. & Albright, T. D. (1987). Coding of visual stimulus velocity in area MT of the macaque. Vision Research, 27, 2035-2048.
81. Rodman, H. R. & Albright, T. D. (1989). Single-unit analysis of pattern-motion selective properties in the middle temporal visual area (MT). Experimental Brain Research, 75, 53-64.
82. Rubin, N. & Hochstein, S. (1992). Global motion computation and the behavior of single cells. In Neurosci Abstracts, Vol. 464.
83. Salzman, C. D., Britten, K. H. & Newsome, W. T. (1990). Cortical microstimulation influences perceptual judgements of motion direction. Nature, 346, 174-177.
84. Salzman, C. D., Murasugi, C. M., Britten, K. H. & Newsome, W. T. (1992). Microstimulation in visual area MT: effects on direction discrimination performance. Journal of Neurophysiology, 12, 2331-2355.
85. Sclar, G., Maunsell, J. H. R. & Lennie, P. (1990). Coding of image contrast in central visual pathways of the macaque monkey. Vision Research, 30, 1-10.
86. Sereno, M. E. (1993). Neural computation of pattern motion: modeling stages of motion analysis in the primate visual cortex. MIT Press, Cambridge, MA.
87. Shapley, R. (1990). Visual sensitivity and parallel retinocortical channels. Annual Review of Psychology, 41, 635-658.
88. Shapley, R. & Enroth-Cugell, C. (1984). Visual adaptation and retinal gain control. Progress in Retinal Research, 3, 263-346.
89. Siegel, R. M. & Andersen, R. A. (1986). Motion perceptual deficits following ibotenic acid lesions of the middle temporal area (MT) in the behaving rhesus monkey. Society of Neuroscience Abstracts, 12, 1183.
90. Simoncelli, E. P. (1993). Distributed analysis and representation of visual motion. PhD thesis, Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science, Cambridge, MA.
91. Simoncelli, E. P., Bair, W. D., Cavanaugh, J. R. & Movshon, J. A. (1996). Testing and refining a computational model of neural responses in area MT. Investigative Ophthalmology and Visual Science Supplement, 37, p. 916.
92. Simoncelli, E. P. & Heeger, D. J. (1994). A velocity representation model for MT cells. Investigative Ophthalmology and Visual Science Supplement, 35, 1827.
93. Simoncelli, E. P. & Heeger, D. J. (1992). A computational model for perception of two-dimensional pattern velocities. Investigative Ophthalmology and Visual Science Supplement, 33, p. 954.
94. Smith, J. A. & Grzywacz, N. M. (1993). A local model for transparent motion based on spatio-temporal filtering. In Eeckman, F. H. & Bower, J. M. (Eds), Computation and neural systems (pp. 177-181). Hingham, MA: Kluwer.
95. Snowden, R. J., Treue, S., Erikson, R. G. & Andersen, R. A. (1991). The response of area MT and V1 neurons to transparent motion. Journal of Neuroscience, 11, 2768-2785.
96. Sparks, D. L., Holland, R. & Guthrie, B. L. (1976). Size and distribution of movement fields in the monkey superior colliculus. Brain Research, 113, 21.
97. Stoner, G. R. & Albright, T. D. (1992). Neural correlates of perceptual motion coherence. Nature, 358, 412-414.
98. Stoner, G. R., Albright, T. D. & Ramachondran, V. S. (1990). Transparancy and coherence in human motion perception. Nature, 344, 153-155.
99. Tanaka, K., Hikosaka, K., Saito, H., Yukie, M., Fukada, Y. & Iwai, E. (1986). Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey. Journal of Neuroscience, 6, 134-144.
100. Tolhurst, D. J. & Heeger, D. J. (1997a). Comparison of contrast normalization and threshold models of the responses of simple cells in cat striate cortex. Visual Neuroscience, 14, 293-310.
101. Tolhurst, D. J. & Heeger, D. J. (1997b) Contrast normalization and a linear model for the directional selectivity of simple cells in cat striate cortex. Visual Neuroscience, 14, 19-26.
102. Tootell, R. B. H., Hamilton, S. L. & Switkes, E. (1988). Functional anatomy of macaque striate cortex, IV. Contrast and magno-parvo streams. Journal of Neuroscience, 8, 1594-1609.
103. van Santen, J. P. H. & Sperling, G. (1985). Elaborated Reichardt detectors. Journal of the Optical Society of America A, 2, 300-321.
104. Wang, H. T., Mathur, B. & Koch, C. (1989). Computing optical flow in the primate visual system. Neural Computation, 1, 92-103.
105. Watson, A. B. & Ahumada, A. J. (1983). A look at motion in the frequency domain In Tsotsos, J. K. (Eds), Motion: perception and representation (pp. 1-10). New York: Association for Computing Machinery.
106. Watson, A. B. & Ahumada, A. J. (1985). Model of human visual-motion sensing. Journal of the Optical Society of America A, 2, 322-342.
107. Wilson, H. R., Ferrara, V. P. & Yo, C. (1992). A psychophysically motivated model for two-dimensional motion perception. Visual Neuroscience, 9, 79-97.
108. Wilson, H. R. & Kim, J. (1994). A model for motion coherence and transparency. Visual Neuroscience, 11, 1205-1220.
109. Young, R. A. & Lesperance, R. M. (1993). A physiological model of motion analysis for machine vision. Proceedings of the SPIE, 1913, 48-123.