From 1D to 2D via 3D: Dynamics of surface motion segmentation for ocular tracking in primates

Journal of Physiology Paris

Volumn 98, Issue 1-3 SPEC. ISS., 2004, Pages 35-52

  Masson, Guillaume S ^a  

^a CNRS   (France)

Author keywords

2D visual motion integration; Binocular disparity; Motion segmentation; Non Fourier motion; Tracking eye movements

Indexed keywords

EYE TRACKING; IMAGE ANALYSIS; IMAGE DISPLAY; MOVEMENT PERCEPTION; PRIMATE; RETINA; REVIEW; SENSORIMOTOR FUNCTION; THREE DIMENSIONAL IMAGING; VISION;

EID: 5144225233     PISSN: 09284257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2004.03.017     Document Type: Article

References (122)

1. Adelson E.H., Bergen J.R. Spatio-temporal energy models for the perception of motion. J. Opt. Soc. Am A. 2:1985;284-299
2. Adelson E.H., Movshon J.A. Phenomenal coherence of moving visual pattern. Nature. 300:1982;523-525
3. Albright T.D. Form-cue invariant motion processing in primate visual cortex. Science. 255:1992;1141-1143
4. Albright T.D., Stoner G.R. Contextual influences on visual processing. Annu. Rev. Neurosci. 23:2002;339-379
5. Anstis S.M. Phi movement as a subtraction process. Vision Res. 10:1970;1411-1430
6. Baker C.L. Jr. Central neural mechanisms for detecting second-order motion. Curr. Opin. Neurobiol. 9:1999;461-466
7. Barlow H.B., Levick W.R. The mechanisms of directionally selective units in rabbit's retina. J. Physiol. (Lond.). 178:1965;477-504
8. Benson P.J., Guo K. Stages in motion processing revealed by the ocular following response. NeuroReport. 10:1999;3803-3807
9. Beutter B.R., Stone L.S. Human motion perception and smooth pursuit eye movements show similar directional biases for elongated apertures. Vision Res. 38:1998;1273-1286
10. Braddick O., Qian N. The organization of global motion and transparency. Zanker J.M., Zeil J. Motion Vision - Computational, Neural and Ecological Constraints. 2001;86-112 Springer Verlag, Berlin
11. Bradley D.C., Qian N., Andersen R.A. Integration of motion and stereopsis in middle temporal cortical areas of macaques. Nature. 373:1995;609-611
12. Britten K.H., Heuer H.W. Spatial summation in the receptive fields of MT neurons. J. Neurosci. 15:1999;5074-5084
13. Bullier J. Integrated model of visual processing. Brain Res. Rev. 134:2001;193-204
14. Bullier J., Nowak L.G. Parallel versus serial processing: new vistas on the distributed organization of the visual system. Cur. Opin. Neurobiol. 5:1995;497-503
15. Busettini C., Masson G.S., Miles F.A. A role for binocular stereo cues in the rapid visual stabilization of the eyes. Nature. 380:1996;342-345
16. Busettini C., Miles F.A., Krauzlis R.J.K. Short-latency disparity vergence responses and their dependence on a prior saccadic eye movement. J. Neurophysiol. 75:1996;1392-1410
17. Busettini C., FitzGibbon E.J., FitzGibbon F.A. Short-latency disparity vergence in humans. J. Neurophysiol. 85:2001;1129-1152
18. Bützer F., Ilg U.W., Zanker J.M. Smooth-pursuit eye movements elicited by first-order and second-order motion. Exp. Brain Res. 115:1997;61-70
19. Carpenter R.H.S. Eye Movements. Vision and Visual Dysfunctions. vol. 8:1991;Macmillan, London
20. Castet E., Charton V., Dufour A. The extrinsic/intrinsic classification of 2D motion signals in the barberpole illusion. Vision Res. 39:1999;705-720
21. Chubb C., Sperling G. Two motion perception mechanisms revealed by distance driven reversal of apparent motion. Proc. Natl. Acad. Sci. USA. 86:1989;2985-2989
22. Churan J., Ilg U.J. Processing of second-order motion stimuli in primate middle temporal area and medial superior temporal area. J. Opt. Soc. Am. A. 18:2001;2297-2306
23. Churchland M.M., Lisberger S.G.L. Apparent motion produces multiple deficits in visually guided smooth pursuit eye movements on monkeys. J. Neurophysiol. 84:2000;216-235
24. Cumming B.G., Parker A.J. Responses of primary visual cortical neurons to binocular disparity without depth perception. Nature. 389:1997;280-283
25. DeYoe E.A., Van Essen D.C. Segregation of efferent connections and receptive field properties in visual area V2 of the macaque. Nature. 317:1985;58-61
26. Dobkins K.R., Stoner G.R., Albright T.D. Perceptual, oculomotor and neural responses to moving color plaids. Perception. 27:1998;681-709
27. Duncan R.O., Albright T.D., Stoner G.R. Occlusion and the interpretation of visual motion: perceptual and neuronal effects of context. J. Neurosci. 20:2000;5885-5897
28. Egelhaaf M., Borst A. Are there separate ON and OFF channels in fly motion vision? Vis. Neurosci. 8:1992;151-164
29. Eifuku S., Wurtz R.H. Response to motion in extrastriate area MSTl: disparity sensitivity. J. Neurophysiol. 82:1989;2462-2475
30. Emerson R.C., Citron M.N., Vaughn W.J., Klein S. Nonlinear directionally selective subunits in complex cells of cat striate cortex. J. Neurophysiol. 58:1987;33-65
31. Fennema C.L., Thompson W.B. Velocity determination in scenes containing several moving objects. Comp. Graph. Image Proc. 9:1979;301-315
32. Ferrera V.P., Lisberger S.G.L. Neuronal responses in visual areas MT and MST during smooth pursuit target selection. J. Neurophysiol. 78:1997;1433-1446
33. Ferrera V.P., Wilson H.R. Perceived direction of moving two-dimensional patterns. Vision Res. 30:1990;272-285
34. Fischer N., Fischer J.M. Directional tuning of the barberpole illusion. Perception. 30:2001;1321-1336
35. Franceschini N., Riehle A., Le Nestour A. Directionally selective motion detection by insect neurons. Stavenga H. Facets of Vision. 1989;360-390 Springer-Verlag, Berlin
36. Gellman R.S., Carl J.R., Miles F.A. Short-latency ocular following responses in man. Vis. Neurosci. 5:1990;107-122
37. Gomi H., Shidara M., Takemura A., Inoue Y., Kawano K., Kawato M. Temporal firing patterns of Purkinje cells in the cerebellar ventral paraflocullus during ocular following responses in monkey. I. Simple spikes. J. Neurophysiol. 80:1998;832-848
38. Goréa A., Lorenceau J. Directional performances with moving plaids: component-related and plaid-related modes coexist. Spat. Vis. 5:1991;231-252
39. Groh J.M., Born R.T., Newsome W.T. How is a sensory map read-out? Effects of microstimulation in visual area MT on saccades and smooth-pursuit eye movements. J. Neurosci. 17:1997;4312-4330
40. Hawken M.J., Gegenfurtner K.R. Pursuit eye movements to second-order motion targets. J. Opt. Soc. Am. A. 18:2001;2282-2296
41. Heinen S.J., Watamaniuk S.N.J. Spatial integration in human smooth pursuit. Vision Res. 38:1998;3785-3794
42. Howard I.P., Gonzales E.G. Human optokinetic nystagmus is response to moving binocularly disparate stimuli. Vision Res. 27:1987;1807-1816
43. Ilg U.J. Slow eye movements. Prog. Neurobiol. 53:1997;293-329
44. Inoue Y., Takemura A., Kawano K., Mustari M.J. Role of the pretectal nucleus of the optic tract in short-latency ocular following responses in monkeys. Exp. Brain Res. 131:2000;269-281
45. Kawano K. Ocular tracking: behaviour and neurophysiology. Curr. Opin. Neurobiol. 9:1999;467-473
46. Kawano K., Shidara M., Yamane S. Neural activity in dorsolateral pontine nucleus of alert monkey during ocular following responses. J. Neurophysiol. 67:1992;680-703
47. Kawano K., Inoue Y., Takemura A., Miles F.A. Effect of disparity in the peripheral field on short-latency ocular following responses. Vis. Neurosci. 11:1994;833-837
48. Kawano K., Shidara M., Watanabe Y., Yamane S. Neural activity in cortical area MST of alert monkey during ocular following responses. J. Neurophysiol. 71:1994;2305-2324
49. Keller E.L., Heinen S.J. Generation of smooth pursuit eye movements: neuronal mechanisms and pathways. Neurosci. Res. 11:1991;79-107
50. Krauzlis R.J., Adler S.A. Effects of directional expectation on motion perception and pursuit eye movements. Vis. Neurosci. 18:2001;365-376
51. Krauzlis R.J., Stone L.S. Tracking with the mind's eye. Trends Neurosci. 22:1999;544-550
52. Krug K., Cumming B.G., Parker A.J. Response of single MT neurons to anti-correlated stereograms in the awake macaque. Soc. Neurosci. Abstr. 25:1999;109-119
53. Lamme V.A., Roelfsema P.R. The distinct modes of vision offered by feedforward and recurrent processing. Trends Neurosci. 23:2000;571-579
54. Lindner A., Ilg U.J. Initiation of smooth pursuit eye movements to first-order and second-order stimuli. Exp. Brain Res. 133:2000;450-456
55. Lisberger S.G., Movshon J.A. Visual motion analysis for pursuit eye movements in area MT of macaque monkeys. J. Neurosci. 19:1999;2224-2246
56. Lisberger S.G., Morris E.J., Tychsen L. Visual motion processing and sensorimotor integration for smooth pursuit eye movements. Annu. Rev. Neurosci. 10:1987;97-129
57. M.S. Livingstone, B.R. Livingstone, Responses of V1 neurons to reverse phi stimuli, in: 2nd Annual Meeting, Vision Sciences Society, Sarasota, 10-15 May 2002, p. 49
58. Livingstone M.S., Pack C.C., Born R.T. Two-dimensional substructure of MT receptive fields. Neuron. 30:2001;781-793
59. Löffler G., Orbach H.S. Computing feature motion without feature detectors: a model for terminator motion. Vision Res. 39:1999;859-871
60. Lorenceau J., Lorenceau M., Wells N., Castet E. Different motion sensitive units are involved in recovering the direction of moving lines. Vision Res. 33:1993;1207-1217
61. Lu Z.-L., Sperling G. Second-order reversed phi. Percept. Psychophy. 61:1999;1075-1088
62. Lu Z., Sperling G. Three-systems theory of human visual motion perception: review and update. J. Opt. Soc. Am. A. 18:2001;2331-2370
63. N. Majaj, M.A. Smith, A. Kohn, W. Bair, J.A. Movshon, A role for terminators in motion processing by macaque MT neurons? in: 2nd Annual Meeting, Vision Sciences Society, Sarasota, 10-15 May, 2002, p. 147
64. Mareschal I., Baker C.L. Jr. Temporal and spatial response to second-order stimuli in cat area 18. J. Neurophysiol. 80:1998;2811-2823
65. Marr D., Ullman S. Directional selectivity at its use in early visual processing. Proc. Roy. Soc. Lond. B. 211:1981;151-180
66. Masson G.S., Castet E. Parallel motion processing for the initiation of short-latency ocular following in humans. J. Neurosci. 22:2002;5149-5163
67. Masson G.S., Mestre D.R. A look in the black box: eye movements as a probe of visual motion processing. Cah. Psychol. Cog. 17:1998;807-829
68. Masson G.S., Stone L.S. From following edges to pursuing objects. J. Neurophysiol. 88:2002;2869-2873
69. Masson G.S., Busettini C., Miles F.A. Vergence eye movements in response to binocular disparity without depth perception. Nature. 389:1997;283-286
70. Masson G.S., Mestre D.R., Stone L.S. Speed tuning for motion segmentation and discrimination. Vision Res. 39:1999;4297-4308
71. Masson G.S., Rybarczyk Y., Castet E., Mestre D.R. Temporal dynamics of motion integration for the initiation of tracking responses at ultra-short latencies. Vis. Neurosci. 17:2000;753-767
72. Masson G.S., Busettini C., Yang D.-S., Miles F.A. Short-latency ocular following in humans: sensitivity to binocular disparity. Vision Res. 41:2001;3371-3387
73. Masson G.S., Yang D.-S., Miles F.A. Reversed short-latency ocular following in humans. Vision Res. 42:2002;2081-2087
74. Masson G.S., Yang D.-S., Miles F.A. Version and vergence eye movements in humans: open-loop dynamics determined by monocular rather than binocular image speed. Vision Res. 42:2002;2853-2867
75. Maunsell J.H.R., Van Essen D.C. Functional properties of neurons in middle temporal visual areas of the macaque monkey. II. Binocular interactions and sensitivity to binocular disparity. J. Neurophysiol. 49:1983;1148-1167
76. Maunsell J.H.R., Van Essen D.C. The connections of the middle temporal visual area (MT) and their relationship to a cortical hierarchy in the macaque monkey. J. Neurosci. 3:1983;2563-2586
77. Merigan W.H., Maunsell J.H.R. How parallel are the primate visual pathways? Annu. Rev. Neurosci. 16:1993;369-402
78. Merigan W.H., Nealey T.A., Maunsell J.H.R. Visual effects of lesions of cortical areas V2 in macaques. J. Neurosci. 13:1993;3223-3334
79. Mestre D.R., Masson G.S. Ocular responses to motion parallax stimuli: the role of perceptual and attentional factors. Vision Res. 37:1997;1627-1641
80. Mestre D.R., Masson G.S., Stone L.S. Spatial scale of motion segmentation from speed cues. Vision Res. 41:2001;2697-2713
81. Miles F.A. The sensing of rotational and translational optic flow by the primate optokinetic system. Miles F.A., Wallman J. Visual Motion and its Role in the Stabilization of Gaze. Reviews in Oculomotor Research. vol. 5:1993;393-417 Elsevier, New York
82. Miles F.A. The neural processing of 3-D visual information: evidence from eye movements. Eur. J. Neurosci. 10:1998;811-822
83. Miles F.A., Kawano K. Visual stabilization of the eyes. Trends Neurosci. 10:1987;153-158
84. Miles F.A., Kawano K., Optican L.M. Short-latency ocular following responses of monkey. I. Dependence on temporo-spatial properties of the visual input. J. Neurophysiol. 56:1986;1321-1354
85. Movshon J.A., Newsome W.T. Visual response properties of striate cortical neurons projecting to area MT in macaque monkeys. J. Neurosci. 16:1996;7733-7741
86. Movshon J.A., Adelson E.H., Gizzi M.S., Newsome W.T. The analysis of visual moving patterns. Chagas C., Gattass R., Gross C. Pattern Recognition Mechanisms. 1985;117-151 Springer, New York
87. Movshon J.A., Smith A.T., Majaj N.J., Kohn A., Bayr K.W. Dynamics of pattern motion signals in macaque area MT. Perception. 31S:2002;101d
88. Munk M.H.J., Nowak L.G., Girard P., Choulamountri N., Bullier J. Visual latencies in cytochrome oxidase bands of macaque area V2. Proc. Natl. Acad. Sci. USA. 92:1995;988-992
89. Nieder A., Wagner H. Hierarchical processing of horizontal disparity information in the visual forebrain of behaving owls. J. Neurosci. 21:2001;4514-4522
90. O'Keefe L.P., Movshon J.A. Processing of first- and second-order motion signals by neurons in area MT of the macaque monkey. Vis. Neurosci. 15:1998;305-317
91. Pack C.C., Born R.T. Temporal dynamics of a neural solution to the aperture problem in visual area MT. Nature. 409:2001;1040-1042
92. Pack C.C., Berezovskii V.K., Born R.T. Dynamic properties of neurons in cortical area MT in alert and anesthetized macaque monkeys. Nature. 414:2001;905-908
93. Priebe N.J., Churchland M.M., Lisberger S.G.L. Reconstruction of target speed for the guidance of pursuit eye movements. J. Neurosci. 21:2001;3196-3206
94. Power R.P., Moulden B. Spatial gating effects on judged motion of gratings in apertures. Perception. 21:1992;449-463
95. Recanzone G.H., Wurtz R.H., Schwartz U. Responses of MT and MST neurons to one or two moving objects in the receptive field. J. Neurophysiol. 78:1997;2904-2915
96. Reichardt W. Autocorrelation, a principle for the evaluation of sensory information by the central nervous system. Rosenblith W.A. Sensory Communication. 1961;303-317 Wiley, New York
97. Rodman H.R., Albright T.D. Single-unit analysis of pattern-motion selective properties in the middle temporal visual area (MT). Exp. Brain Res. 73:1989;53-64
98. Sato T. Reversed apparent motion with random dot patterns. Vision Res. 29:1989;1749-1758
99. Sclar G., Maunsell J.H., Lennie P. Coding of image contrast in central visual pathways of the macaque monkey. Vision Res. 30:1990;1-10
100. Shidara M., Kawano K. Role of Purkinje cells in the ventral paraflocullus in short-latency ocular following responses. Exp. Brain Res. 93:1993;185-195
101. Shimojo S., Silverman G., Nakayama K. Occlusion and the solution to the aperture problem for motion. Vision Res. 29:1989;619-626
102. Shipp S., Zeki S. The organisation of connections between areas V5 and V1 in macaque monkey visual cortex. Eur. J. Neurosci. 1:1989;308-331
103. Simoncelli E.P., Heeger D.J. A model of neuronal responses in visual area MT. Vision Res. 38:1998;101-112
104. Smith A.T., Snowden R.J. Visual Detection of Motion. 1994;Academic Press, San Diego
105. Snowden R.J., Treue S., Erickson R.G., Andersen R.A. The response of area MT and V1 neurons to transparent motion. J. Neurosci. 11:1991;2768-2785
106. Stone L.S., Beutter B.R., Lorenceau J. Visual motion integration for perception and pursuit. Perception. 29:2000;771-787
107. Sugita Y. Grouping of image fragments in primary visual cortex. Nature. 401:1999;269-272
108. Takemura A., Inoue Y., Kawano K. The role of MST neurons in short-latency tracking eye movements. Soc. Neurosci. Abstr. 26:2000;1715
109. Takemura A., Inoue Y., Kawano K. The effect of disparity on the very earliest ocular following responses and the initial neuronal activity in monkey cortical area MST. Neurosci. Res. 38:2000;93-101
110. Takemura A., Inoue Y., Kawano K., Quaia C., Miles F.A. Single-unit activity in cortical area MST associated with disparity-vergence eye movements: evidence for population coding. J. Neurophysiol. 85:2001;2254-2266
111. Van Santen J.P.H., Sperling G. Elaborated Reichardt detectors. J. Opt. Soc. Am. A. 2:1985;322-342
112. Wallace J., Masson G.S., Mestre D.R., Mamassian P. The efficiency of smooth pursuit for surface motion. Invest. Opth. Vis. Sci. 42S:2001;3330
113. Wallach H. Ueber Visuell Wahrgenommene Bewegungrichtung. Psycholog. Forsch. 20:1935;325-380. (English translation by S. Wuerger, B. Shapley, Perception 11 (1996) 1317-1367)
114. Watanabe T. High-level Motion Processing. Computational, Neurobiological and Psychophysical Perspective. 1998;MIT Press, Cambridge
115. Watson A.B., Ahumada A.J. Model of human visual motion sensing. J. Opt. Soc. Am. A. 2:1985;322-342
116. Wertheimer M. Experimentelle Studienüber das Sehen von Bewegung. Z. Psychol. 1912;161-265
117. Wilson H.R. Non-Fourier cortical processes in texture form and motion perception. Ulinsky P.S. Cerebral Cortex. Models of Cortical Circuits. vol. 13:1999;445-477 Kluwer Academic, New York
118. Wilson H.R., Ferrera V.P., Yo C. A psychophysically motivated model for two-dimensional motion perception. Vis. Neurosci. 9:1992;79-98
119. Yabuta N.H., Sawatari A., Callaway E.M. Two functional channels from primary visual cortex to dorsal visual cortical areas. Science. 292:2001;297-300
120. Yamamoto K., Kobayashi Y., Takemura A., Kawano K., Kawato M. A mathematical model that reproduces vertical ocular following responses from visual stimuli by reproducing the simple spike firing frequency of Purkinje cells in the cerebellum. Neurosci. Res. 29:1997;161-169
121. Yo C., Wilson H.R. Perceived direction of moving two-dimensional patterns depends on duration, contrast and eccentricity. Vision Res. 32:1992;135-147
122. Zhou Y.-X., Baker C.L. Jr. A processing stream in mammalian visual cortex neurons for non-Fourier responses. Science. 261:1993;98-101