Recovering stimulus locations using populations of eye-position modulated neurons in dorsal and ventral visual streams of non-human primates

Frontiers in Integrative Neuroscience

Volumn 8, Issue MAR, 2014, Pages

  Sereno, Anne B ^a   Sereno, Margaret E ^b   Lehky, Sidney R ^c  

^a UNIVERSITY OF TEXAS MEDICAL SCHOOL   (United States)

^b UNIVERSITY OF OREGON   (United States)

^c SALK INSTITUTE FOR BIOLOGICAL STUDIES   (United States)

Author keywords

Active vision; Monkey; Multidimensional scaling; Population coding; Spatial vision

Indexed keywords

ANIMAL BEHAVIOR; ANIMAL CELL; ANIMAL EXPERIMENT; ANIMAL TISSUE; ANTERIOR INFEROTEMPORAL CORTEX; ARTICLE; BRAIN CORTEX; BRAIN NERVE CELL; CELL POPULATION; CONTROLLED STUDY; HISTOLOGY; LATERAL INTRAPARIETAL CORTEX; MACACA NEMESTRINA; MALE; NONHUMAN; PRIMATE; RHESUS MONKEY; SACCADIC EYE MOVEMENT; TASK PERFORMANCE; VISUAL STIMULATION;

EID: 84897136199     PISSN: 16625145     EISSN: None     Source Type: Journal    
DOI: 10.3389/fnint.2014.00028     Document Type: Article

References (81)

1. Aggelopoulos, N. C., and Rolls, E. T. (2005). Scene perception: inferior temporal cortex neurons encode the positions of different objects in the scene. Eur. J. Neurosci. 22, 2903-2916. doi: 10.1111/j.1460-9568.2005.04487.x
2. Andersen, R. A., Bracewell, R. M., Barash, S., Gnadt, J. W., and Fogassi, L. (1990). Eye position effects on visual, memory, and saccade-related activity in areas LIP and 7a of macaque. J. Neurosci. 10, 1176-1196.
3. Andersen, R. A., Essick, G. K., and Siegel, R. M. (1985). Encoding of spatial location by posterior parietal neurons. Science 230, 456-458. doi: 10.1126/science.4048942
4. Andersen, R. A., and Mountcastle, V. B. (1983). The influence of the angle of gaze upon the excitability of the light-sensitive neurons of the posterior parietal cortex. J. Neurosci. 3, 532-548.
5. Andersen, R. A., Snyder, L. H., Li, C.-S., and Stricanne, B. (1993). Coordinate transformations in the representation of spatial information. Curr. Opin. Neurobiol. 3, 171-176. doi: 10.1016/0959-4388(93)90206-E
6. Averbeck, B. B., Latham, P. E., and Pouget, A. (2006). Neural correlations, population coding and computation. Nat. Rev. Neurosci. 7, 358-366. doi: 10.1038/nrn1888
7. Ballard, D. H. (1991). Animate vision. Artif. Intell. 48, 57-86. doi: 10.1016/0004-3702(91)90080-4
8. Borg, I., and Groenen, P. (2010). Modern Multidimensional Scaling: Theory and Applications, 2nd Edn. New York, NY: Springer.
9. Boussaoud, D., and Bremmer, F. (1999). Gaze effects in the cerebral cortex: reference frames for space coding and action. Exp. Brain Res. 128, 170-180. doi: 10.1007/s002210050832
10. Boussaoud, D., Jouffrais, C., and Bremmer, F. (1998). Eye position effects on the neuronal activity of dorsal premotor cortex in the macaque monkey. J. Neurophysiol. 80, 1132-1150.
11. Bremmer, F. (2000). Eye position effects in macaque area V4. Neuroreport 11, 1277-1283. doi: 10.1097/00001756-200004270-00027
12. Bremmer, F., Ilg, U. J., Thiele, A., Distler, C., and Hoffmann, K.-P. (1997). Eye position effects in monkey cortex. I. Visual and pursuit-related activity in extrastriate areas MT and MST. J. Neurophysiol. 77, 944-961.
13. Colby, C. L., and Duhamel, J.-R. (1996). Spatial representations for action in parietal cortex. Brain Res. Cogn. Brain Res. 5, 105-115. doi: 10.1016/S0926-6410(96)00046-8
14. Corbetta, M., and Shulman, G. L. (2002). Control of goal-directed and stimulus-driven attention in the brain. Nat. Rev. Neurosci. 3, 201-215. doi: 10.1038/nrn755
15. DeSouza, J. F. X., Dukelow, S. P., and Vilis, T. (2002). Eye position signals modulate early dorsal and ventral visual areas. Cereb. Cortex 12, 991-997. doi: 10.1093/cercor/12.9.991
16. Duhamel, J.-R., Colby, C. L., and Goldberg, M. E. (1992). The updating of the representation of visual space in parietal cortex by intended eye movements. Science 255, 90-92. doi: 10.1126/science.1553535
17. Edelman, S. (2002). Constraining the neural representation of the visual world. Trends Cogn. Sci. 6, 125-131. doi: 10.1016/S1364-6613(00)01854-4
18. Farah, M. J. (2004). Visual Agnosia, 2nd Edn. Cambridge: MIT Press/Bradford Books.
19. Findlay, J. M. (1998). Active vision: visual activity in everyday life. Curr. Biol. 8, R640-R642. doi: 10.1016/S0960-9822(07)00411-3
20. Fisher, N. I., and Lee, A. J. (1983). A correlation coefficient for circular data. Biometrika 70, 327-332. doi: 10.1093/biomet/70.2.327
21. Friedman-Hill, S. R., Robertson, L. C., and Triesman, A. (1995). Parietal contributions to visual feature binding: evidence from a patient with bilateral lesions. Science 269, 853-855. doi: 10.1126/science.7638604
22. Galletti, C., and Battaglini, P. P. (1989). Gaze-dependent visual neurons in area V3A of monkey prestriate cortex. J. Neurosci. 9, 1112-1125.
23. Galletti, C., Battaglini, P. P., and Fattori, P. (1995). Eye position influence on the parieto-occipital area PO (V6) of the macaque monkey. Eur. J. Neurosci. 7, 2486-2501. doi: 10.1111/j.1460-9568.1995.tb01047.x
24. Goodale, M. A., and Milner, A. D. (1992). Separate visual pathways for perception and action. Trends Neurosci. 15, 20-25. doi: 10.1016/0166-2236(92)90344-8
25. Gower, J. C., and Dijksterhuis, G. B. (2004). Procrustes Problems, Oxford Statistical Science Series, Vol. 30. Oxford: Oxford University Press. doi: 10.1093/acprof:oso/9780198510581.001.0001
26. Guo, K., and Li, C.-Y. (1997). Eye position-dependent activation of neurones in striate cortex of macaque. Neuroreport 8, 1405-1409. doi: 10.1097/00001756-199704140-00017
27. Hayworth, K., Lescroart, M. D., and Biederman, I. (2011). Neural encoding of relative position. J. Exp. Psychol. Hum. Percept. Perform. 37, 1032-1050. doi: 10.1037/a0022338
28. Jeannerod, M., and Jacob, P. (2005). Visual cognition: a new look at the two-visual systems model. Neuropsychologia 43, 301-312. doi: 10.1016/j.neuropsychologia.2004.11.016
29. Kaplan, D. M., and Snyder, L. H. (2012). The need for speed: eye-position signal dynamics in the parietal cortex. Neuron 76, 1048-1051. doi: 10.1016/j.neuron.2012.12.005
30. Kayaert, G., Biederman, I., and Vogels, R. (2005). Representation of regular and irregular shapes in macaque inferotemporal cortex. Cereb. Cortex 15, 1308-1321. doi: 10.1093/cercor/bhi014
31. Kiani, R., Esteky, H., Mirpour, K., and Tanaka, K. (2007). Object category structure in response patterns of neuronal population in monkey inferior temporal cortex. J. Neurophysiol. 97, 4296-4309. doi: 10.1152/jn.00024.2007
32. Konen, C. S., and Kastner, S. (2008). Two hierarchically organized neural systems for object information in human visual cortex. Nat. Neurosci. 11, 224-231. doi: 10.1038/nn2036
33. Kosslyn, S. M., Chabris, C. F., Marsolek, C. J., and Koenig, O. (1992). Categorical versus coordinate spatial relations: computational analyses and computer simulations. J. Exp. Psychol. Hum. Percept. Perform. 18, 562-577. doi: 10.1037/0096-1523.18.2.562
34. Kosslyn, S. M., Koenig, O., Barrett, A., Cave, C. B., Tang, J., and Gabriell, J. D. (1989). Evidence for two types of spatial representations: hemispheric specialization for categorical and coordinate relations. J. Exp. Psychol. Hum. Percept. Perform. 15, 723-735. doi: 10.1037/0096-1523.15.4.723
35. Kravitz, D. J., Saleem, K. S., Baker, C. I., and Mishkin, M. (2011). A new neural framework for visuospatial processing. Nat. Rev. Neurosci. 12, 217-230. doi: 10.1038/nrn3008
36. Kriegeskorte, N., and Kreiman, G. (eds.). (2011). Visual Population Codes: Toward a Common Multivariate Framework for Cell Recording and Functional Imaging Cambridge, MA: MIT Press.
37. Lehky, S. R., Peng, X., McAdams, C. J., and Sereno, A. B. (2008). Spatial modulation of primate inferotemporal responses by eye position. PLoS ONE 3:e3492. doi: 10.1371/journal.pone.0003492
38. Lehky, S. R., and Sereno, A. B. (2007). Comparison of shape encoding in primate dorsal and ventral visual pathways. J. Neurophysiol. 97, 307-319. doi: 10.1152/jn.00168.2006
39. Lehky, S. R., and Sereno, A. B. (2011). Population coding of visual space: modeling. Front. Comput. Neurosci. 4:155. doi: 10.3389/fncom.2010.00155
40. Lehky, S. R., Sereno, M. E., and Sereno, A. B. (2013). Population coding and the labeling problem: extrinsic versus intrinsic representations Neural Comput. 25, 2235-2264. doi: 10.1162/NECO_a_00486
41. Messinger, A., Squire, L. R., Zola, S. M., and Albright, T. D. (2005). Neural correlates of knowledge: stable representation of stimulus associations across variations in behavioral performance. Neuron 48, 359-371. doi: 10.1016/j.neuron.2005.08.035
42. Missal, M., Vogels, R., Li, C.-Y., and Orban, G. A. (1999). Shape interactions in macaque inferior temporal neurons. J. Neurophysiol. 82, 131-142.
43. Morris, A. P., Bremmer, F., and Krekelberg, B. (2013). Eye-position signals in the dorsal visual system are accurate and precise on short timescales. J. Neurosci. 33, 12395-12406. doi: 10.1523/JNEUROSCI.0576-13.2013
44. Morris, A. P., Kubischik, M., Hoffmann, K.-P., Krekelberg, B., and Bremmer, F. (2012). Dynamics of eye-position signals in the dorsal visual system. Curr. Biol. 22, 173-179. doi: 10.1016/j.cub.2011.12.032
45. Murata, A., Gallese, V., Luppino, G., Kaseda, M., and Sakata, H. (2000). Selectivity for the shape, size, and orientation of objects for grasping in neurons of monkey parietal area AIP. J. Neurophysiol. 83, 2580-2601.
46. Nakamura, K., and Colby, C. L. (2002). Updating of the visual representation in monkey striate and extrastriate cortex during saccades. Proc. Natl. Acad. Sci. U.S.A. 99, 4026-4031. doi: 10.1073/pnas.052379899
47. Newell, F. N., Sheppard, D. M., Edelman, S., and Shapiro, K. L. (2005). The interaction of shape-and location-based priming in object categorisation: evidence for a hybrid "what + where" representation stage. Vision Res. 45, 2065-2080. doi: 10.1016/j.visres.2005.02.021
48. Op de Beeck, H., Wagemans, J., and Vogels, R. (2001). Inferotemporal neurons represent low-dimensional configurations of parameterized shapes. Nat. Neurosci. 4, 1244-1252. doi: 10.1038/nn767
49. Pouget, A., Dayan, P., and Zemel, R. (2000). Information processing with population codes. Nat. Rev. Neurosci. 1, 125-132. doi: 10.1038/35039062
50. Pouget, A., and Sejnowski, T. J. (1997). Spatial transforms in the parietal cortex using basis functions. J. Cogn. Neurosci. 9, 222-237. doi: 10.1162/jocn.1997.9.2.222
51. Pouget, A., and Snyder, L. H. (2000). Computational approaches to sensorimotor transformations. Nat. Neurosci. 3(Suppl.), 1192-1198. doi: 10.1038/81469
52. Quian Quiroga, R., and Panzeri, S. (2009). Extracting information from neuronal populations: information theory and decoding approaches. Nat. Rev. Neurosci. 10, 173-185. doi: 10.1038/nrn2578
53. Rayner, K. (1998). Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 124, 372-422. doi: 10.1037/0033-2909.124.3.372
54. Rayner, K. (2009). Eye movements and attention in reading, scene perception, and visual search. Q. J. Exp. Psychol. 62, 1457-1506. doi: 10.1080/17470210902816461
55. Rayner, K., and Pollatsek, A. (1992). Eye movements and scene perception. Can. J. Psychol. 46, 342-376. doi: 10.1037/h0084328
56. Ringo, J. L., Sobotka, S., Diltz, M. D., and Bunce, C. M. (1994). Eye movements modulate activity in hippocampal, parahippocampal, and inferotemporal neurons. J. Neurophysiol. 71, 1285-1288.
57. Rizzolatti, G., and Matelli, M. (2003). Two different streams form the dorsal visual system: anatomy and functions. Exp. Brain Res. 153, 146-157. doi: 10.1007/s00221-003-1588-0
58. Rolls, E. T., and Tovée, M. J. (1995). Sparseness of the neuronal representation of stimuli in the primate temporal visual cortex. J. Neurophysiol. 73, 713-726.
59. Rosenbluth, D., and Allman, J. M. (2002). The effect of gaze angle and fixation distance on the responses of neurons in V1, V2, and V4. Neuron 33, 143-149. doi: 10.1016/S0896-6273(01)00559-1
60. Rueckl, J. G., Cave, K. R., and Kosslyn, S. M. (1989). Why are "What" and "Where" processed by separate cortical visual systems? A computational investigation. J. Cogn. Neurosci. 1, 171-186. doi: 10.1162/jocn.1989.1.2.171
61. Salinas, E., and Abbott, L. F. (2001). Coordinate transformations in the visual system: how to generate gain fields and what to compute with them. Prog. Brain Res. 130, 175-190. doi: 10.1016/S0079-6123(01)30012-2
62. Sanger, T. D. (2003). Neural population codes. Curr. Opin. Neurobiol. 13, 238-249. doi: 10.1016/S0959-4388(03)00034-5
63. Sereno, A. B. (2011). Eye Position Signals in Dorsal and Ventral Streams, Talk Hosted by the Vision Sciences Laboratory, Harvard University. Cambridge, MA.
64. Sereno, A. B., and Amador, S. C. (2006). Attention and memory-related responses of neurons in the lateral intraparietal area during spatial and shape-delayed match-to-sample tasks. J. Neurophysiol. 95, 1078-1098. doi: 10.1152/jn.00431.2005
65. Sereno, A. B., and Lehky, S. R. (2011). Population coding of visual space: comparison of spatial representations in dorsal and ventral pathways. Front. Comput. Neurosci. 4:159. doi: 10.3389/fncom.2010.00159
66. Sereno, A. B., and Lehky, S. R. (2012). "Recovering stimulus locations using eye-position modulations of cortical responses, " in 38th Annual Meeting of the Society for Neuroscience (New Orleans, LA).
67. Sereno, A. B., and Maunsell, J. H. R. (1998). Shape selectivity in primate lateral intraparietal cortex. Nature 395, 500-503. doi: 10.1038/26752
68. Sereno, M. E., Trinath, T., Augath, M., and Logothetis, N. K. (2002). Three-dimensional shape representation in monkey cortex. Neuron 33, 635-652. doi: 10.1016/S0896-6273(02)00598-6
69. Shepard, R. N. (1980). Multidimensional scaling, tree-fitting, and clustering. Science 210, 390-398. doi: 10.1126/science.210.4468.390
70. Snyder, L. H. (2000). Coordinate transformations for eye and arm movements in the brain. Curr. Opin. Neurobiol. 10, 747-754. doi: 10.1016/S0959-4388(00)00152-5
71. Squatrito, S., and Maioli, M. G. (1996). Gaze field properties of eye position neurones in areas MST and 7a of the macaque monkey. Vis. Neurosci. 13, 385-398. doi: 10.1017/S0952523800007628
72. Tanaka, K. (1996). Inferotemporal cortex and object vision. Annu. Rev. Neurosci. 19, 109-139. doi: 10.1146/annurev.ne.19.030196.000545
73. Trotter, Y., and Celebrini, S. (1999). Gaze direction controls response gain in primary visual-cortex neurons. Nature 398, 239-242. doi: 10.1038/18444
74. Ungerleider, L. G., and Haxby, J. V. (1994). "What" and "where" in the human brain. Curr. Opin. Neurobiol. 4, 157-165. doi: 10.1016/0959-4388(94)90066-3
75. Ungerleider, L. G., and Mishkin, M. (1982). "Two cortical systems, " in Analysis of Visual Behavior, eds D. J. Ingle, M. A. Goodale, and R. Mansfield (Cambridge, MA: MIT Press), 549-586.
76. Wojciulik, E., and Kanwisher, N. (1998). Implicit but not explicit feature binding in a Balint's patient. Vis. Cogn. 5, 157-181. doi: 10.1080/713756779
77. Wurtz, R. H., and Sommer, M. A. (2004). Identifying corollary discharges for movement in the primate brain. Prog. Brain Res. 144, 47-60. doi: 10.1016/S0079-6123(03)14403-2
78. Xu, B. Y., Karachi, C., and Goldberg, M. E. (2012). The postsaccadic unreliability of gain fields renders it unlikely that the motor system can use them to calculate target position in space. Neuron 76, 1201-1209. doi: 10.1016/j.neuron.2012.10.034
79. Yamane, Y., Tsunoda, K., Matsumoto, M., Phillips, A. N., and Tanifuji, M. (2006). Representation of the spatial relationship among object parts by neurons in macaque inferotemporal cortex. J. Neurophysiol. 96, 3147-3156. doi: 10.1152/jn.01224.2005
80. Young, M. P., and Yamane, S. (1992). Sparse population coding of faces in the inferotemporal cortex. Science 256, 1327-1331. doi: 10.1126/science.1598577
81. Zipser, D., and Andersen, R. A. (1988). A back-propagation programmed network that simulates response properties of a subset of posterior parietal neurons. Nature 331, 679-684. doi: 10.1038/331679a0