A theory of geometric constraints on neural activity for natural three- dimensional movement

Journal of Neuroscience

Volumn 19, Issue 8, 1999, Pages 3122-3145

  Zhang, Kechen ^a   Sejnowski, Terrence J ^a,b,c  

^a HOWARD HUGHES MEDICAL INSTITUTE   (United States)

^b UNIVERSITY OF CALIFORNIA   (United States)

^c SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

3 D object; Cortical representation; Gradient field; Motor system; Potential function; Reaching movement; Speed modulation; Tuning curve; Visual cortex; Zero curl

Indexed keywords

ARM MOVEMENT; ARTICLE; GEOMETRY; MATHEMATICAL ANALYSIS; MOTONEURON; MOVEMENT PERCEPTION; NEUROTRANSMISSION; PRIORITY JOURNAL; SENSORY NERVE CONDUCTION; VELOCITY; VISUOMOTOR COORDINATION;

EID: 0033560901     PISSN: 02706474     EISSN: None     Source Type: Journal    
DOI: 10.1523/jneurosci.19-08-03122.1999     Document Type: Article

References (123)

1. Adelson EH, Bergen JR (1985) Spatiotemporal energy models for the perception of motion. J Opt Soc Am A 2:284-299.
2. Albright TD (1984) Direction and orientation selectivity of neurons in visual area MT of the macaque. J Neurophysiol 52:1106-1130.
3. Alhright TD (1992) Form-cue invariant motion processing in primate visual cortex. Science 255:1141-1143.
4. Alexander GE, Crutcher MD (1990) Neural representations of the target (goal) of visually guided arm movements in three motor areas of the monkey. J Neurophysiol 64:164-178.
5. Allman JM, Miezin F, McGuinness E (1985) Direction- and velocity-specific responses from beyond the classical receptive field in the middle temporal visual area (MT). Perception 14:105-126.
6. Andersen RA, Snyder LH, Bradley DC, Xing J (1997) Multimodal representation of space in the posterior parietal cortex and its use in planning movements. Ann Rev Neurosci 20:303-330.
7. Ashe J, Georgopoulos AP (1994) Movement parameters and neural activity in motor cortex and area 5. Cereh Cortex 6:590-600.
8. Baker J. Goldherg J, Hermann G. Peterson B (1984) Optimal response planes and canal convergence in secondary neurons in vestihular nuclei of alert cats. Brain Res 294:133-137.
9. Bradley DC, Maxwell M, Andersen RA, Banks MS, Shenoy KV (1996) Mechanisms of heading perception in primate visual cortex. Science 273:1544-1547.
10. Biilthoff HH, Edelman SY. Tarr MJ (1995) How are three-dimensional objects represented in the brain? Cereb Cortex 3:247-260.
11. Bunco CA, Soechting JF, Flanders M (1997) Postural dependence of muscle actions: implications for neural control. J Neurosci 17:2128-2142.
12. Buračas GT, Albright TD (1996) Contribution of area MT to perception of three-dimensional shape: a computational study. Vision Res 36:869-887.
13. Caminiti R, Johnson PB, Urhano A (1990) Making arm movements within different parts of space: dynamic aspects of the primate motor cortex. J Neurosci 10:2039-2058.
14. Caminiti R, Johnson PB, Galli C, Fcrraina S, Burnod Y (1991) Making arm movements within different parts of space: premotor and motor cortical representation of a coordinate system for reaching to visual targets. J Neurosci 11:1182-1197.
15. Cheng K, Hasegawa T, Saleem KS, Tanaka K (1994) Comparison of neuronal selectivity for stimulus speed, length, and contrast in the prestriate visual areas V4 and MT of the macaque monkey. J Neurophysiol 71:2269-2280.
16. Cohen DA, Prud'homme MJ, Kalaska JF (1994) Tactile activity in primate primary somatosensory cortex during active arm movements: correlation with receptive field properties. J Neurophysiol 71:161-172.
17. Colhy CL, Duhamel J-R, Goldhcrg ME (1993) Ventral intraparietal area of the macaque: anatomic location and visual response properties. J Neurophysiol 69:902-914.
18. Crammond DJ. Kalaska JF (1996) Differential relation of discharge in primary motor cortex and prcmotor cortex to movements versus actively maintained postures during a reaching task. Exp Brain Res 108:45-61.
19. Dobbins AC, Jeo RM. Fiser J, Allman JM (1998) Distance modulation of neural activity in the visual cortex. Science 281:552-555.
20. Duffy CJ, Wurtz RH (1995) Response of monkey MST neurons to optic flow stimuli with shifted centers of motion. J Neurosci 15:5192-5208.
21. Duffy CJ, Wurtz RH (1997a) Medial superior temporal area neurons respond to speed patterns in optic flow. J Neurosci 17:2839-2851.
22. Duffy CJ, Wurtz RH (1997b) Planar directional contributions to optic flow response in MST neurons. J Neurophysiol 77:782-796.
23. Edelman S. Biilthoff HH (1992) Orientation dependence in the recognition of familiar and novel views of three-dimensional objects. Vision Res 32:2385-2400.
24. Eifuku S. Wurtz RH (1998) Response to motion in extrastriate area MSTI: center-surround interactions. J Neurophysiol 80:282-296.
25. Fetz EE (1992) Are movement parameters recognizably coded in the activity of single neurons? Bchav Brain Sci 15:679-690.
26. Flanders H (1989) Differential forms with applications to the physical sciences. New York: Dover.
27. Flanders M, Herrmann U (1992) Two components of muscle activation: scaling with the speed of arm movement. J Neurophysiol 67:931-943.
28. Flanders M, Soechting JF (1990) Arm muscle activation for static forces in three-dimensional space. J Neurophysiol 64:1818-1837.
29. Forticr PA. Kalaska JF, Smith AM (1989) Cerebellar neuronal activity related to whole-arm reaching movements in the monkey. J Neurophysiol 62:198-211.
30. Forticr PA, Smith AM, Kalaska JF (1993) Comparison of cerebellar and motor cortex activity during reaching: directional tuning and response variability. J Neurophysiol 69:1136-1149.
31. Fu Q-G. Suarez JI, Ebner TJ (1993) Neuronal specification of direction and distance during reaching movements in the superior precentral prcmotor area and primary motor cortex of monkeys. J Neurophysiol 70:2097-2116.
32. Gaál G (1993) Calculation of movement direction from firing activities of neurons in intrinsic co-ordinate systems defined by their preferred directions. J Theor Biol 162:103-130.
33. Gccsaman BJ, Andersen RA (1996) The analysis of complex motion patterns by form/cue invariant MSTd neurons. J Neurosci 16:4716-4732.
34. Georgopoulos AP, Schwartz AB, Kettner RE (1986) Neuronal population coding of movement direction. Science 233:1416-1419.
35. Georgopoulos AP, Kettner RE, Schwartz AB (1988) Primate motor cortex and free arm movements to visual targets in three-dimensional space. II. Coding of the direction of movement by a neuronal population. J Neurosci 8:2928-2937.
36. Georgopoulos AP, Crutcher MD, Schwartz AB (1989a) Cognitive spatial-motor processes. 3. Motor cortical prediction of movement direction during an instructed delay period. Exp Brain Res 75:183-194.
37. Georgopoulos AP. Lurito JT, Petrides M, Schwartz AB, Massey JT (1989b) Mental rotation of the neuronal population vector. Science 243:234-236.
38. Georgopoulos AP, Ashe J, Smyrnis N, Taira M (1992) The motor cortex and the coding of force. Science 256:1692-1695.
39. Giszter SF, Mussa-Ivaldi FA, Bizzi E (1993) Convergent force fields organized in the frog's spinal cord. J Neurosci 13:467-491.
40. Goldstein H (1980) Classical mechanics. Ed 2. Reading, MA: Addison-Wesley.
41. Graf W, Baker J, Peterson BW (1993) Sensorimotor transformation in the cat's vestibuloocular flex system. I. Neuronal signals coding spatial coordination of compensatory eye movemenls. J Neurophysiol 70:2425-2441.
42. Graziano MS, Andersen RA, Snowden RJ (1994) Tuning of MST neurons to spiral motions. J Neurosci 14:54-67.
43. Heegcr DJ (1993) Modeling simple-cell direction selectivity with normalized, half-squared, linear operators. J Neurophysiol 70:1885-1898.
44. Heeger DJ, Jepson A (1990) Visual perception of three-dimensional motion. Neural Comput 2:129-137.
45. Hirase H, Czurkó A, Csicsvari J. Buzsaki G (1998) Hippocampal pyramidal neurons sustain discharge frequency when the rat is "clamped' in space. Soc Neurosci Ahstr 24:921.
46. Kalaska JF, Cohen DAD. Hyde ML, Prud'homme M (1989) A comparison of movement direction-related versus load direction-related activity in primate motor cortex, using a two-dimensional reaching task. J Neurosci 9:2080-2102.
47. Kalaska JF, Cohen DAD, Prud'homme M, Hyde ML (1990) Parietal area 5 neuronal activity encodes movement kinematics, not movement dynamics. Exp Brain Res 80:351-364.
48. Kettner RE. Schwartz AB. Georgopoulos AP (1988) Primate motor cortex and free arm movements to visual targets in three-dimensional space. III. Positional gradients and population coding of movement direction from various movement origins. J Neurosci 8:2938-2947.
49. Kocnderink JJ, van Doom AJ (1976) Local structure of movement parallax of the plane. J Opt Soc Am 66:717-723.
50. Krauzlis RJ, Lisherger SG (1996) Directional organization of eye movement and visual signals in the floccular lohe of the monkey cerebellum. Exp Brain Res 109:289-302.
51. Lacquaniti F, Terzuolo C, Viviani P (1983) The law relating the kinematic and figurai aspects of drawing movements. Acta Psychologica 54:115-130.
52. Lappe M, Bremmer F, Pekel M, Thiele A, Hoffmann K-P (1996) Optic flow processing in monkey STS: a theoretical and experimental approach. J Neurosci 16:6265-6285.
53. Lisberger SG, O'Keefe LP, Kahlon M, Mahncke HW, Movshon JA (1995) Temporal dynamics in responses of macaque MT cells during target acceleration. Soc Neurosci Abstr 21:664.
54. Liu, Z-L, Knill DC, Kersten D (1995) Object classification for human and ideal observers, Vision Res 35:549-568.
55. Logothetis NK, Pauls J (1995) Psychophysical and physiological evidence for viewer-centered object representation in the primate. Cereb Cortex 3:270-288.
56. Logothetis NK, Pauls J, Poggio T (1995) Shape representation in the inferior temporal cortex of monkeys. Curr Biol 5:552-563.
57. Longuet-Higgins HC, Prazdny K (1980) The interpretation of a moving retinal image. Proc R Soe Lond B Biol Sci 208:3X5-397.
58. Maunsell JHR, Van Essen DC (1983) Functional properties of neurons in middle temporal visual area of the macaque monkey. I. Selectivity for stimulus direction, speed, and orientation. J Neurophysiol 49:1127-1147.
59. McNaughton BL, Barnes CA. O'Keefe J (1983) The contributions of position, direction, and velocity to single unit activity in the hippocampus of freely-moving rats. Exp Brain Res 52:41-49.
60. Moody SL, Zipser D (1998) A model of reaching dynamics in primary motor cortex. J Cognit Neurosci 10:35-45.
61. Moody SL, Wise SP, di Pellegrino G, Zipser D (1998) A model that accounts for activity in primate frontal cortex during a delayed matching-to-sample task. J Neurosci 18:399-410.
62. Moran DW, Schwartz AB (1999) Motor cortical representation of speed and direction during reaching. J Neurophysiol, in press.
63. Moran DW, Kakavand A, Schwartz AB (1995) Effect of a virtual reality illusion on motor cortical population vectors during drawing. Soc Neurosci Abstr 21:2076.
64. Movshon JA, Adelson EH, Gizzi MS.Newsome WT (1985) The analysis of moving visual patterns. In: Pattern recognition mechanisms (Chagas C, Gattass R, Gross C, eds), pp 117-151. New York: Springer-Verlag.
65. Movshon JA, Lisberger SG, Krauzlis RJ (1990) Visual cortical signals supporting smooth pursuit eye movements. Cold Spring Harbor Symp Quant Biol 55:707-716.
66. Mussa-Ivakli FA (1988) Do neurons in the motor cortex encode movement direction? An alternative hypothesis. Neurosci Lett 91:106-111.
67. Mussa-Ivaldi FA (1992) From basis functions to basis fields: vector field approximation from sparse data. Biol Cybern 67:479-489.
68. Mussa-Ivaldi FA. Hogan N, Bizzi E (1985) Neural, mechanical, and geometric factors subserving arm posture in humans. J Neurosci 5:2732-2743.
69. Newsome WT, Wurtz RH. Komatsu H (1988) Relation of cortical areas MT and MST to pursuit eye movements. II. Differentiation of retinal from extraretinal inputs. J Neurophysiol 60:604-620.
70. Nowlan S, Sejnowski TJ (1995) A selection model for motion processing in area MT of primates. J Neurosci 15:1195-1214.
71. Orban GA, Lagae L, Raiguel S, Xiao D, Maes H (1995) The speed tuning of medial superior temporal (MST) cell responses to optic-flow components. Perception 24:269-285.
72. Pekel M, Lappe M, Bremmer F, Thiele A, Hoffmann K-P (1996) Neuronal responses in the motion pathway of the macaque monkey to natural optic flow stimuli. NeuroReport 22:884-888.
73. Pellizzer G, Sargent P, Georgopoulos AP (1995) Motor cortical activity in a context-recall task. Science 269:702-705.
74. Perrett DI, Oram MW, Harries MH, Bevan R, Hietanen JK, Benson PJ. Thomas S (1991) View-centered and object-centered coding of heads in the macaque temporal cortex. Exp Brain Res 86:159-173.
75. Perrone JA, Stone LS (1994) A model of self-motion estimation within primate extrastriate visual cortex. Vision Res 34:2917-2938.
76. Poggio T, Edelman S (1990) A network that learns to recognize three-dimensional objects. Nature 343:263-266.
77. Poggio T, Verri A. Torre V (1991) Green theorems and qualitative properties of the optical flow. MIT A.I. Memo 1289. Cambridge, MA: MIT.
78. Pouget A, Zhang K-C. Dcneve S, Latham PE (1998) Statistically efficient estimation using population code. Neural Comput 10:373-401.
79. Prud'homme MJL, KalaskaJF (1994) Proprioceptive activity in primate primary somatosensory cortex during active arm reaching movements. J Neurophysiol 72:2280-2301.
80. Qian N, Andersen RA (1994) Transparent motion perception as detection of unbalanced motion signals. II. Physiology. J Neurosci 14:7367-7380.
81. Raiguel S. Van Hulle MM. Xiao D-K, Orban GA (1995) Shape and spatial distribution of receptive fields and antagonistic motion surrounds in the middle temporal area (V5) of the macaque. Eur J Neurosci 7:2064-2082.
82. Recanzone GH, Wurtz RH, Schwarz U (1997) Responses of MT and MST neurons to one and two moving objects in the receptive field. J Neurophysiol 78:2904-2915.
83. Rodman HR. Albright TD (1987) Coding of visual stimulus velocity in area MT of the macaque. Vision Res 27:2035-2048.
84. Roy J-P. Komatsu H, Wurtz RH (1992) Disparity sensitivity of neurons in monkey extrastriate area MST. J Neurosci 12:2478-2492.
85. Saito H, Yukie M. Tanaka K, Hikosaka K. Fukada Y, Iwai E (1986) Integration of direction signals of image motion in the superior temporal sulcus of the macaque monkey. J Neurosci 6:145-157.
86. Sakata H, Shibutani H, Ito Y, Tsurugai K, Mine S, Kusunoki M (1994) Functional properties of rotation-sensitive neurons in the posterior parietal association cortex of the monkey. Exp Brain Res 101:183-202.
87. Salinas E, Abbott LF (1994) Vector reconstruction from firing rates. J Comput Neurosci 1:89-107.
88. Salinas E, Abbott LF (1997) A model of multiplicative neural responses in parietal cortex. Proc Nat Acad Sci USA 93:11956-11961.
89. Sanger TD (1994) Theoretical considerations for the analysis of population coding in motor cortex. Neural Comput 6:12-21.
90. Schaafsma SJ. Duysens J (1996) Neurons in the ventral intraparietal area of awake macaque monkey closely resemble neurons in the dorsal part of the medial superior temporal area in their responses to optic flow patterns. J Neurophysiol 76:4056-4068.
91. Schwartz AB (1993) Motor cortical activity during drawing movements: population representation during sinusoid tracing. J Neurophysiol 70:28-36.
92. Schwartz AB (1994) Direct cortical representation of drawing. Science 265:540-542.
93. Schwartz AB, Kettner RE. Georgopoulos AP (1988) Primate motor cortex and free arm movements to visual targets in three-dimensional space. 1. Relations between single cell discharge and direction of movement. J Neurosci 8:2913-2927.
94. Scott SH, Kalaska JF (1997) Reaching movements with similar hand paths but different arm orientations. I. Activity of individual cells in motor cortex. J Neurophysiol 77:826-852.
95. Sereno ME (1993) Neural computation of pattern motion: modeling stages of motion analysis in the primate visual cortex. Cambridge, MA: MIT.
96. Sereno MI, Sereno ME (1991) Learning to see rotation and dilation with a Hebb rule. In: Advances in neural information processing systems (Lippmann RP, Moody J, Touretzky DS, eds), pp 320-326. San Mateo, CA: Morgan Kaufmann.
97. Sergio LE, Kalaska JF (1997) Systematic changes in directional tuning of motor cortex cell activity with hand location in the workspace during generation of static isometric forces in constant spatial directions. J Neurophysiol 78:1170-1174.
98. Shen L-M, Alexander GE (1997a) Neural correlates of a spatial sensoryto-motor transformation in primary motor cortex. J Neurophysiol 77:1171-1194.
99. Shen L-M, Alexander GE (1997b) Preferential representalion of instructed target location versus limb trajectory in dorsal premotor area. J Neurophysiol 77:1195-1212.
100. Siegel RM, Read HL (1997) Analysis of optic flow in the monkey parietal area 7a. Cereb Cortex 7:327-346.
101. Simoncelli EP, Heeger DJ (1998) A model of neuronal responses in visual area MT. Vision Res 38:743-761.
102. Sinha P, Poggio T (1996) Role of learning in three-dimensional form perception. Nature 384:460-463.
103. Soechting JF, Buneo CA, Herrmann U, Flanders M (1995) Moving effortlessly in three dimensions: does Donders's law apply to arm movement? J Neurosci 15:6271-6280.
104. Squatrito S, Maioli MG (1997) Encoding of smooth pursuit direction and eye position by neurons of area MSTd of macaque monkey. J Neurosci 17:3847-3860.
105. Stone JV (1998) Object recognition using spatiotemporal signatures, Vision Res 38:947-951.
106. Stoner GR, Albright TD (1992) Neural correlates of perceptual motion coherence. Nature 358:412-414.
107. Tanaka K, Saito H-A (1989) Analysis of motion of the visual field by direction, expansion/contraction, and rotation cells clustered in the dorsal part of the medial superior temporal area of the macaque monkey. J Neurophysiol 62:626-641.
108. Tanaka K, Hikosaka K, Saito H-A, Yukic M, Fukada Y. Iwai E (1986) Analysis of local and wide-field movements in the superior temporal visual areas of the macaque monkey. J Neurosci 6:134-144.
109. Thier P, Erickson RG (1992) Responses of visual-tracking neurons from cortical area MST-1 to visual, eye and head motion. Eur J Neurosci 4:539-553.
110. Treue S, Maunsell JHR (1996) Attentional modulation of visual motion processing in cortical areas MT and MST. Nature 382:539-541.
111. Trotter Y, Cclcbrini S, Stricannc B, Thorpe S, Imbert M (1992) Modulation of neural stereoscopic processing in primate area VI by the viewing distance. Science 257:1279-1281.
112. Turner RS, Anderson ME (1997) Pallidal discharge related to the kinematics of reaching movements in two dimensions. J Neurophysiol 77:1051-1074.
113. Ullman S, Basri R (1991) Recognition by linear combinations of models. IEEE Trans Pattern Analysis Machine Intelligence 13:992-1005.
114. Ungcrleider LG, Mishkin M (1982) Two cortical visual systems. In: Analysis of visual behavior (Ingle DJ, Goodale MA, Mansfield RJW, eds), pp 549-586. Cambridge, MA: MIT.
115. Wang G. Tanaka K, Tanifuji M (1996) Optical imaging of functional organization in the monkey infcrotemporal cortex. Science 272:1665-1668.
116. Wang R (1995) A simple competitive account of some response properties of visual neurons in area MSTd. Neural Comput 7:290-306.
117. Watt A, Watt M (1992) Advanced animation and rendering techniques: theory and practice. New York: Addison-Wesley.
118. Wise SP, di Pellegrino G, Boussaoud D (1992) Primate prcmotor cortex: dissociation of visumotor from sensory signals. J Neurophysiol 68:969-972.
119. Zeki SM (1974) Functional organization of a visual area in the posterior bank of the superior temporal sulcus of the rhesus monkey. J Physiol 236:549-573.
120. Zemel RS, Sejnowski TJ (1998) A model for encoding multiple object motions and self-motion in area MST of primate visual cortex. J Neurosci 18:531-547.
121. Zhang K-C, Sereno MI, Sereno ME (1993) Emergence of position-independent detectors of sense of rotation and dilation with Hebbian learning: an analysis. Neural Comput 5:597-612.
122. Zhang K-C, Ginzburg I. McNaughton BL, Sejnowski TJ (1998) Interpreting neuronal population activity by reconstruction: unified frame-work with application to hippocampal place cells. J Neurophysiol 79:1017-1044.
123. Zipser D (1992) Identification models of the nervous system. Neuroscience 47:853-862.