A model of the combination of optic flow and extraretinal eye movement signals in primate extrastriate visual cortex: Neural model of self-motion from optic flow and extraretinal cues

Neural Networks

Volumn 11, Issue 3, 1998, Pages 397-414

  Lappe, Markus ^a  

^a RUHR UNIVERSITY BOCHUM   (Germany)

Author keywords

Cortex; Heading; Human; Modelling; Monkey; Optic flow; Self motion; Visual motion

Indexed keywords

COMPUTER SIMULATION; EYE MOVEMENTS; MATHEMATICAL MODELS; OPTICAL FLOWS; VISION;

EXTRARETINAL EYE MOVEMENTS; VISUAL MOTION;

NEURAL NETWORKS;

ARTICLE; EYE MOVEMENT; MATHEMATICAL MODEL; MOVEMENT PERCEPTION; NERVE CELL NETWORK; NEUROPHYSIOLOGY; PRIORITY JOURNAL; PSYCHOPHYSICS; VISUAL CORTEX;

EID: 0032052509     PISSN: 08936080     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0893-6080(98)00013-6     Document Type: Article

References (74)

1. Albright T.D. Centrifugal directionality bias in the middle temporal visual area (MT) of the macaque. Vis. Neurosci. 2:1989;177-188.
2. Andersen R., Graziano M., Snowden R. Translational invariance and attentional modulation of MST cells. Soc. Neurosci. Abstr. 16:1990;7.
3. Baloh R.W., Beykirch K., Honrubia V., Yee R.D. Eye movements induced by linear acceleration on a parallel swing. J. Neurophysiol. 60:1988;2000-2013.
4. Boussaoud D., Ungerleider L.G., Desimone R. Pathways for motion analysis: cortical connections of the medial superior temporal visual areas in the macaque. J. Comp. Neurol. 296:1990;462-495.
5. Bradley D., Maxwell M., Andersen R., Banks M.S., Shenoy K.V. Mechanisms of heading perception in primate visual cortex. Science. 273:1996;1544-1547.
6. Bremmer F., Ilg U.J., Thiele A., Distler C., Hoffmann K.-P. Eye position effects in monkey cortex. I: visual and pursuit related activity in extrastriate areas MT and MST. J. Neurophysiol. 77:1997;944-961.
7. Bruss A.R., Horn B.K.P. Passive navigation. Comput. Vis. Graph. Image Proc. 21:1983;3-20.
8. Bülthoff H., Little J., Poggio T. A parallel algorithm for real-time computation of optical flow. Nature. 337:1989;549-553.
9. Carpenter, R.H.S., 1988. Movement of The Eyes, 2nd ed. Pion, London.
10. Duffy C.J., & Wurtz R.H. (1991a). Sensitivity of MST neurons to optic flow stimuli. I. A continuum of response selectivity to large-field stimuli. J. Neurophysiol., 65 (6), 1329-1345.
11. Duffy C.J., & Wurtz R.H. (1991b). Sensitivity of MST neurons to optic flow stimuli. II. Mechanisms of response selectivity revealed by small-field stimuli. J. Neurophysiol., 65 (6), 1346-1359.
12. Duffy C.J., Wurtz R.H. Response of monkey MST neurons to optic flow stimuli with shifted centers of motion. J. Neurosci. 15:1995;5192-5208.
13. Dürsteler M.R., Wurtz R.H. Pursuit and optokinetic deficits following chemical lesions of cortical areas MT and MST. J. Neurophysiol. 60:1988;940-965.
14. Erickson R.G., Dow B.M. Foveal tracking cells in the superior temporal sulcus of the macaque monkey. Exp. Brain Res. 78:1989;113-131.
15. Erickson R.G., Thier P. A neuronal correlate of spatial stability during periods of self-induced visual motion. Exp. Brain Res. 86:1991;608-616.
16. Erickson R.G.L., Thier P. Responses of direction-selective neurons in monkey cortex to self-induced visual motion. Ann. N.Y. Acad. Sci. 656:1992;766-774.
17. Gibson, J. J. (1950). The Perception of the Visual World. Houghton Mifflin, Boston.
18. Graziano M.S.A., Andersen R.A., Snowden R. Tuning of MST neurons to spiral motions. J. Neurosci. 14(1):1994;54-67.
19. Haarmeier T., Thier P. Modification of the Filehne illusion by conditioning visual stimuli. Vision Res. 36:1996;741-750.
20. Heeger D.J., Jepson A. Subspace methods for recovering rigid motion I: algorithm and implementation. Int. J. Computer Vision. 7(2):1992;95-117.
21. Hildreth E.C. Recovering heading for visually-guided navigation. Vision Res. 32:1992;1177-1192.
22. Honda H. The extraretinal signal from the pursuit eye movement system: Its role in the perceptual and the egocentric localization systems. Percep. Psychophys. 48:1990;509-515.
23. Ilg U.J., & Thier P. (1996a). Inability of rhesus monkey area V1 to discriminate between self-induced and externally induced retinal image slip. Eur. J. Neurosci., 8, 1156-1166.
24. Ilg, U.J. & Thier, P. (1996b). MST neurons are activated by pursuit of imaginary targets. In: Thier, P., Karnath, H.-O. (Eds.), Parietal Lobe Contributions to Orientation in 3D-Space. Experimental Brain Research Supplement, Springer, Berlin.
25. Kawano K., Sasaki M. Response properties of neurons in posterior parietal cortex of monkey during visual-vestibular stimulation II. Optokinetic neurons. J. Neurophysiol. 51:1984;352-360.
26. Koenderink J.J., van Doorn A.J. Invariant properties of the motion parallax field due to the movement of rigid bodies relative to an observer. Opt. Acta. 22(9):1975;773-791.
27. Koenderink J.J., van Doorn A.J. Facts on optic flow. Biol. Cybernet. 56:1987;247-254.
28. Komatsu H., Wurtz R.H. Relation of cortical areas MT and MST to pursuit eye movements. I. Localization and visual properties of neurons. J. Neurophysiol. 60(2):1988;580-603.
29. Lagae L., Maes H., Raiguel S., Xiao D.-K., Orban G.A. Responses of macaque STS neurons to optic flow components: a comparison of areas MT and MST. J. Neurophysiol. 71:1994;1597-1626.
30. Lappe, M., & Rauschecker, J. P. (1993a). Computation of heading direction from optic flow in visual cortex. In: Giles, C. L., Hanson, S. J., Cowan, J. D. (Eds.), Advances in Neural Information Processing Systems, Vol. 5. Morgan Kaufmann, San Mateo, CA, pp. 433-440.
31. Lappe, M., & Rauschecker, J. P. (1993b). A neural network for the processing of optic flow from egomotion in man and higher mammals. Neural Comput., 5, 374-391.
32. Lappe M., Rauschecker J.P. Heading detection from optic flow. Nature. 369:1994;712-713.
33. Lappe M., & Rauschecker J.P. (1995a). An illusory transformation in a model of optic flow processing. Vision Res., 35, 1619-1631.
34. Lappe M., & Rauschecker J.P. (1995b). Motion anisotropies and heading detection. Biol. Cybernet., 72, 261-277.
35. Lappe, M., Bremmer, F., Hoffmann & K.-P. (1994). How to use non-visual information for optic flow processing in monkey visual cortical area MSTD. In: Marinaro, M., Morasso, P. G. (Eds.), ICANN 94 - Proceedings of the International Conference on Artificial Neural Networks, Springer, Berlin, pp. 46-49.
36. Lappe M., Pekel M., Hoffmann K.-P. Optokinetic eye movements elicited by radial optic flow in the macaque monkey. J. Neurophysiol. 79:1998;1461-1480.
37. Lappe M., Bremmer F., Pekel M., Thiele A., Hoffmann K.-P. Optic flow processing in monkey STS: a theoretical and experimental approach. J. Neurosci. 16:1996;6265-6285.
38. Longuet-Higgins H.C. The visual ambiguity of a moving plane. Proc. R. Soc. Lond. B. 223:1984;165-175.
39. Longuet-Higgins H.C., Prazdny K. The interpretation of a moving retinal image. Proc. R. Soc. Lond. B. 208:1980;385-397.
40. Maunsell J.H.R., Van Essen D.C. Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. J. Neurophysiol. 49(5):1983;1127-1147.
41. Mittelstaedt, H. (1990). Basic solutions to the problem of head-centric visual localization. In: Warren, R., Wertheim, A.H. (Eds.), The Perception and Control of Self-Motion. Erlbaum, Hillsdale, NJ.
42. Movshon, J. A., Adelson, E. H., Gizzi, M. S. & Newsome, W. T. (1985). The analysis of moving visual patterns. In: Chagas, C., Gattass, R., Gross, C. (Eds.), Pattern Recognition Mechanisms. Springer, Berlin.
43. Newsome W.T., Wurtz R.H., Komatsu H. Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. J. Neurophysiol. 60(2):1988;604-620.
44. Newsome, W. T., Britten, K. H., Salzman, C. D., Movshon, J. A. (1990). Neuronal mechanisms of motion perception. Cold Spring Harbor Symposia on Quantitative Biology.
45. Nowlan S., Sejnowski T. A selection model for motion processing in area MT of primates. J. Neurosci. 15:1995;1195-1214.
46. Paige G.D., Tomko D.L. Eye movement responses to linear head motion in the squirrel monkey I. Basic characteristics. J. Neurophysiol. 65:1991;1170-1183.
47. Pekel M., Lappe M., Bremmer F., Thiele A., Hoffmann K.-P. Neuronal responses in the motion pathway of the macaque monkey to natural optic flow stimuli. Neuroreport. 7(4):1996;884-888.
48. Prazdny K. Egomotion and relative depth map from optical flow. Biol. Cybernet. 36:1980;87-102.
49. Regan D., Beverly K.I. How do we avoid confounding the direction we are looking and the direction we are moving? Science. 215:1982;194-196.
50. Rieger J.H., Lawton D.T. Processing differential image motion. J. Opt. Soc. Am. A. 2:1985;354-360.
51. Rieger J.H., Toet L. Human visual navigation in the presence of 3-D rotations. Biol. Cybernet. 52:1985;377-381.
52. Rodman H.R., Albright T.D. Coding of visual stimulus velocity in area MT of the macaque. Vision Res. 27(12):1987;2035-2048.
53. Rodman H.R., Albright T.D. Single-unit analysis of pattern-motion selective properties in the middle temporal visual area MT. Exp. Brain Res. 75:1989;53-64.
54. Royden C.S. Analysis of misperceived observer motion during simulated eye rotations. Vision Res. 34:1994;3215-3222.
55. Royden C.S., Crowell J.A., Banks M.S. Estimating heading during eye movements. Vision Res. 34:1994;3197-3214.
56. Saito H.-A., Yukie M., Tanaka K., Hikosaka K., Fukada Y., Iwai E. Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey. J. Neurosci. 6(1):1986;145-157.
57. Solomon D., Cohen B. Stabilization of gaze during circular locomotion in light: I. compensatory head and eye nystagmus in the running monkey. J. Neurophysiol. 67(5):1992;1146-1157.
58. Sperry R.W. Neural basis of the spontaneous optokinetic response produced by visual inversion. J. Comput. Physiol. Psychol. 43:1950;482-489.
59. Tanaka K., Saito H.-A. Underlying mechanisms of the response specificity of expansion/contraction and rotation cells in the dorsal part of the medial superior temporal area of the macaque monkey. J. Neurophysiol. 62(3):1989;642-656.
60. Tanaka K., Hikosaka K., Saito H.-A., Yukie M., Fukada Y., Iwai E. Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey. J. Neurosci. 6(1):1986;134-144.
61. Thier P., Erickson R.G. Resonses of visual-tracking neurons from cortical area MST-1 to visual, eye and head motion. Eur. J. Neurosci. 4:1992;539-553.
62. Treue S., Maunsell J. Attentional modulation of visual motion processing in cortical areas MT and MST. Nature. 382:1996;539-541.
63. van den Berg A.V. Robustness of perception of heading from optic flow. Vision Res. 32(7):1992;1285-1296.
64. van den Berg A.V. Perception of heading. Nature. 365:1993;497-498.
65. van den Berg A.V. Judgements of heading. Vision Res. 36:1996;2337-2350.
66. von Helmholtz, H. (1896). Handbuch der Physiologischen Optik. Leopold Voss, Hamburg.
67. Von Holst E., Mittelstaedt H. Das Reafferenzprinzip (Wechselwirkung zwischen Zentralnervensystem und Peripherie). Naturwissenschaften. 37:1950;464-476.
68. Wang H.T., Mathur B.P., Koch C. Computing optical flow in the primate visual system. Neural Comput. 1:1989;92-103.
69. Warren W.H. Jr., Hannon D.J. Direction of self-motion is perceived from optical flow. Nature. 336:1988;162-163.
70. Warren W.H. Jr., Hannon D.J. Eye movements and optical flow. J. Opt. Soc. Am. A. 7(1):1990;160-169.
71. Warren W.H., Morris M.W., Kalish M. Perception of translational heading from optical flow. J. Exp. Psychol. Hum. Percept. Perform. 14(4):1988;646-660.
72. Wertheim A.H. Retinal and extraretinal information in movement perception: how to invert the Filehne illusion. Perception. 16:1987;299-308.
73. Wertheim A.H. Motion perception during self-motion. Behav. Brain Sci. 17:1994;293-355.
74. Wilson H., Kim J. A model for motion coherence and transparency. Vis. Neurosci. 11:1994;1205-1220.