Computational advances towards linking BOLD and behavior

Neuropsychologia

Volumn 50, Issue 4, 2012, Pages 435-446

  Serences, John T ^a   Saproo, Sameer ^a  

^a UNIVERSITY OF CALIFORNIA   (United States)

Author keywords

Decoding model; Encoding model; FMRI; MVPA; Vision

Indexed keywords

ACCURACY; AMPLITUDE MODULATION; ARTICLE; BEHAVIORAL RESEARCH; BOLD SIGNAL; BRAIN DEPTH STIMULATION; BRAIN REGION; CLASSIFICATION ALGORITHM; CLASSIFIER; ELECTROENCEPHALOGRAM; EVOKED CORTICAL RESPONSE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; MATHEMATICAL COMPUTING; MATHEMATICAL MODEL; MULTI VOXEL PATTERN ANALYSIS; NEUROIMAGING; NEUROMODULATION; NONHUMAN; PREDICTION; QUANTITATIVE STUDY; RECEPTIVE FIELD; SENSITIVITY AND SPECIFICITY; SINGLE UNIT ACTIVITY; SYNAPTIC TRANSMISSION; WORKING MEMORY;

BRAIN; BRAIN MAPPING; HUMANS; IMAGE PROCESSING, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MODELS, NEUROLOGICAL; NEUROIMAGING; NEURONS;

EID: 84857139330     PISSN: 00283932     EISSN: 18733514     Source Type: Journal    
DOI: 10.1016/j.neuropsychologia.2011.07.013     Document Type: Article

References (111)

1. Andersen R.A., Hwang E.J., Mulliken G.H. Cognitive neural prosthetics. Annual Review of Psychology 2010, 61:169-190. C161-C163.
2. Awh E., Jonides J. Overlapping mechanisms of attention and spatial working memory. Trends in Cognitive Sciences 2001, 5:119-126.
3. Boynton G.M. Attention and visual perception. Current Opinion in Neurobiology 2005, 15:465-469.
4. Boynton G.M. Imaging orientation selectivity: Decoding conscious perception in V1. Nature Neuroscience 2005, 8:541-542.
5. Boynton G.M., Demb J.B., Glover G.H., Heeger D.J. Neuronal basis of contrast discrimination. Vision Research 1999, 39:257-269.
6. Boynton G.M., Engel S.A., Glover G.H., Heeger D.J. Linear systems analysis of functional magnetic resonance imaging in human V1. Journal of Neuroscience 1996, 16:4207-4221.
7. Briggman K.L., Kristan W.B. Multifunctional pattern-generating circuits. Annual Review of Neuroscience 2008, 31:271-294.
8. Brindley G. Physiology of the retina and visual pathways 1960, Edward Arnold, London. 1st ed.
9. Brouwer G.J., Heeger D.J. Decoding and reconstructing color from responses in human visual cortex. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2009, 29:13992-14003.
10. Brouwer, G. J., & Heeger, D. J. (in press). Contrast suppression in human visual cortex. Journal of Neurophysiology.
11. Buxton R.B. Introduction to functional magnetic resonance imaging: Principles and techniques 2002, Cambridge University Press.
12. Carandini M., Demb J.B., Mante V., Tolhurst D.J., Dan Y., Olshausen B.A., et al. Do we know what the early visual system does?. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2005, 25:10577-10597.
13. Chai B., Walthert D.B., Beck D.M., Fei-Fei L. Exploring functional connectivities of the human brain using multivariate information analysis. NIPS 2009.
14. Cohen M.R., Maunsell J.H. Attention improves performance primarily by reducing interneuronal correlations. Nature Neuroscience 2009, 12:1594-1600.
15. Cohen M.R., Maunsell J.H. A neuronal population measure of attention predicts behavioral performance on individual trials. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2010, 30:15241-15253.
16. Cohen M.R., Maunsell J.H. Using neuronal populations to study the mechanisms underlying spatial and feature attention. Neuron 2011, 70:1192-1204.
17. Corbetta M., Patel G., Shulman G.L. The reorienting system of the human brain: From environment to theory of mind. Neuron 2008, 58:306-324.
18. Corbetta M., Shulman G.L. Control of goal-directed and stimulus-driven attention in the brain. Nature Reviews. Neuroscience 2002, 3:201-215.
19. Cox D.D., Savoy R.L. Functional magnetic resonance imaging (fMRI) "brain reading": Detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 2003, 19:261-270.
20. D'Esposito M. From cognitive to neural models of working memory. Philosophical Transactions of the Royal Society of London. Series B, Biological Sciences 2007, 362:761-772.
21. Das A., Sirotin Y.B. What could underlie the trial-related signal?. A response to the commentaries by Drs. Kleinschmidt and Muller, and Drs. Handwerker and Bandettini. Neuroimage 2011, 55:1413-1418.
22. David S.V., Gallant J.L. Predicting neuronal responses during natural vision. Network 2005, 16:239-260.
23. deCharms R.C., Zador Neural representation and the cortical code. Annual Review of Neuroscience 2000, 23:613-647.
24. De Martino F., Valente G., Staeren N., Ashburner J., Goebel R., Formisano E. Combining multivariate voxel selection and support vector machines for mapping and classification of fMRI spatial patterns. Neuroimage 2008, 43:44-58.
25. Douglas R.J., Martin K.A. Recurrent neuronal circuits in the neocortex. Current Biology: CB 2007, 17:R496-R500.
26. Doya K., Ishii S., Pouget A., Rao R.P.N. Bayesian brain: probabilistic approaches to neural coding 2007, MIT Press, Cambridge, Mass.
27. Dumoulin S.O., Wandell B.A. Population receptive field estimates in human visual cortex. Neuroimage 2008, 39:647-660.
28. Ester E.F., Serences J.T., Awh E. Spatially global representations in human primary visual cortex during working memory maintenance. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2009, 29:15258-15265.
29. Esterman M., Chiu Y.C., Tamber-Rosenau B.J., Yantis S. Decoding cognitive control in human parietal cortex. Proceedings of the National Academy of Sciences of the United States of America 2009, 106:17974-17979.
30. Field G.D., Gauthier J.L., Sher A., Greschner M., Machado T.A., Jepson L.H., et al. Functional connectivity in the retina at the resolution of photoreceptors. Nature 2010, 467:673-677.
31. Formisano E., De Martino F., Valente G. Multivariate analysis of fMRI time series: Classification and regression of brain responses using machine learning. Magnetic Resonance Imaging 2008, 26:921-934.
32. Freeman J., Brouwer G.J., Heeger D.J., Merriam E.P. Orientation decoding depends on maps, not columns. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2011, 31:4792-4804.
33. Ganesh G., Burdet E., Haruno M., Kawato M. Sparse linear regression for reconstructing muscle activity from human cortical fMRI. Neuroimage 2008, 42:1463-1472.
34. Gardner J.L. Is cortical vasculature functionally organized?. Neuroimage 2010, 49:1953-1956.
35. Gourtzelidis P., Tzagarakis C., Lewis S.M., Crowe D.A., Auerbach E., Jerde T.A., et al. Mental maze solving: Directional fMRI tuning and population coding in the superior parietal lobule. Experimental Brain Research. Experimentelle Hirnforschung. Experimentation Cerebrale 2005, 165:273-282.
36. Hampton A.N., Bossaerts P., O'Doherty J.P. The role of the ventromedial prefrontal cortex in abstract state-based inference during decision making in humans. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2006, 26:8360-8367.
37. Handwerker D.A., Bandettini P.A. Hemodynamic signals not predicted? Not so: A comment on Sirotin and Das (2009). Neuroimage 2011, 55:1409-1412.
38. Handwerker D.A., Bandettini P.A. Simple explanations before complex theories: Alternative interpretations of Sirotin and Das' observations. Neuroimage 2011, 55:1419-1422.
39. Harrison S.A., Tong F. Decoding reveals the contents of visual working memory in early visual areas. Nature 2009, 458:632-635.
40. Haxby J.V., Gobbini M.I., Furey M.L., Ishai A., Schouten J.L., Pietrini P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
41. Haynes J.D. Decoding visual consciousness from human brain signals. Trends in Cognitive Sciences 2009, 13:194-202.
42. Haynes J.D., Rees G. Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nature Neuroscience 2005, 8:686-691.
43. Haynes J.D., Rees G. Decoding mental states from brain activity in humans. Nature Reviews. Neuroscience 2006, 7:523-534.
44. Heeger D.J., Huk A.C., Geisler W.S., Albrecht D.G. Spikes versus BOLD: What does neuroimaging tell us about neuronal activity?. Nature Neuroscience 2000, 3:631-633.
45. Heeger D.J., Ress D. What does fMRI tell us about neuronal activity?. Nature Reviews Neuroscience 2002, 3:142-151.
46. Heekeren H.R., Marrett S., Ungerleider L.G. The neural systems that mediate human perceptual decision making. Nature Reviews. Neuroscience 2008, 9:467-479.
47. Hochberg L.R., Serruya M.D., Friehs G.M., Mukand J.A., Saleh M., Caplan A.H., et al. Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature 2006, 442:164-171.
48. Jazayeri M., Movshon J.A. Optimal representation of sensory information by neural populations. Nature Neuroscience 2006, 9:690-696.
49. Kamitani Y., Tong F. Decoding the visual and subjective contents of the human brain. Nature Neuroscience 2005, 8:679-685.
50. Kamitani Y., Tong F. Decoding seen and attended motion directions from activity in the human visual cortex. Current Biology: CB 2006, 16:1096-1102.
51. Kang K., Shapley R.M., Sompolinsky H. Information tuning of populations of neurons in primary visual cortex. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2004, 24:3726-3735.
52. Kastner S., Ungerleider L.G. Mechanisms of visual attention in the human cortex. Annual Review of Neuroscience 2000, 23:315-341.
53. Kay K.N., Gallant J.L. I can see what you see. Nature Neuroscience 2009, 12:245.
54. Kay K.N., Naselaris T., Prenger R.J., Gallant J.L. Identifying natural images from human brain activity. Nature 2008, 452:352-355.
55. Kleinschmidt A., Muller N.G. The blind, the lame, and the poor signals of brain function- A comment on Sirotin and Das (2009). Neuroimage 2010, 50:622-625.
56. Kriegeskorte N., Simmons W.K., Bellgowan P.S., Baker C.I. Circular analysis in systems neuroscience: The dangers of double dipping. Nature Neuroscience 2009, 12:535-540.
57. Kriegeskorte N., Bandettini P. Analyzing for information, not activation, to exploit high-resolution fMRI. Neuroimage 2007, 38:649-662.
58. Kriegeskorte N., Bandettini P. Combining the tools: Activation- and information-based fMRI analysis. Neuroimage 2007, 38:666-668.
59. Kriegeskorte N., Goebel R., Bandettini P. Information-based functional brain mapping. Proceedings of the National Academy of Sciences of the United States of America 2006, 103:3863-3868.
60. Logothetis N.K., Pauls J., Augath M., Trinath T., Oeltermann A. Neurophysiological investigation of the basis of the fMRI signal. Nature 2001, 412:150-157.
61. Logothetis N.K., Wandell B.A. Interpreting the BOLD signal. Annual Review of Physiology 2004, 66:735-769.
62. Logothetis N.K. What we can do and what we cannot do with fMRI. Nature 2008, 453(7197):869-878.
63. Martinez-Trujillo J.C., Treue S. Feature-based attention increases the selectivity of population responses in primate visual cortex. Current Biology: CB 2004, 14:744-751.
64. McAdams C.J., Maunsell J.H. Effects of attention on orientation-tuning functions of single neurons in macaque cortical area V4. Journal of Neuroscience 1999, 19:431-441.
65. Mitchell J.F., Sundberg K.A., Reynolds J.H. Spatial attention decorrelates intrinsic activity fluctuations in macaque area V4. Neuron 2009, 63:879-888.
66. Mitchell T.M., Shinkareva S.V., Carlson A., Chang K.M., Malave V.L., Mason R.A., et al. Predicting human brain activity associated with the meanings of nouns. Science 2008, 320:1191-1195.
67. Miyawaki Y., Uchida H., Yamashita O., Sato M.A., Morito Y., Tanabe H.C., et al. Visual image reconstruction from human brain activity using a combination of multiscale local image decoders. Neuron 2008, 60:915-929.
68. Mukamel R., Gelbard H., Arieli A., Hasson U., Fried I., Malach R. Coupling between neuronal firing, field potentials, and FMRI in human auditory cortex. Science 2005, 309:951-954.
69. Naselaris T., Kay K.N., Nishimoto S., Gallant J.L. Encoding and decoding in fMRI. Neuroimage 2011, 56:400-410.
70. Naselaris T., Prenger R.J., Kay K.N., Oliver M., Gallant J.L. Bayesian reconstruction of natural images from human brain activity. Neuron 2009, 63:902-915.
71. Norman K.A., Polyn S.M., Detre G.J., Haxby J.V. Beyond mind-reading: Multi-voxel pattern analysis of fMRI data. Trends in Cognitive Sciences 2006, 10:424-430.
72. O'Toole A.J., Jiang F., Abdi H., Penard N., Dunlop J.P., Parent M.A. Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data. Journal of Cognitive Neuroscience 2007, 19:1735-1752.
73. Offen S., Schluppeck D., Heeger D.J. The role of early visual cortex in visual short-term memory and visual attention. Vision Research 2009, 49:1352-1362.
74. Op de Beeck H.P. Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses?. Neuroimage 2010, 49:1943-1948.
75. Paradiso M.A. A theory for the use of visual orientation information which exploits the columnar structure of striate cortex. Biological Cybernetics 1988, 58:35-49.
76. Pasternak T., Greenlee M.W. Working memory in primate sensory systems. Nature Reviews. Neuroscience 2005, 6:97-107.
77. Pereira F., Mitchell T., Botvinick M. Machine learning classifiers and fMRI: A tutorial overview. Neuroimage 2009, 45:S199-S209.
78. Pessoa L., Padmala S. Decoding near-threshold perception of fear from distributed single-trial brain activation. Cerebral Cortex 2007, 17:691-701.
79. Postle B.R. Working memory as an emergent property of the mind and brain. Neuroscience 2006, 139:23-38.
80. Pouget A., Dayan P., Zemel R.S. Inference and computation with population codes. Annual Review of Neuroscience 2003, 26:381-410.
81. Pouget A., Deneve S., Ducom J.C., Latham P.E. Narrow versus wide tuning curves: What's best for a population code?. Neural Computation 1999, 11:85-90.
82. Reynolds J.H., Heeger D.J. The normalization model of attention. Neuron 2009, 61:168-185.
83. Reynolds J.H., Pasternak T., Desimone R. Attention increases sensitivity of V4 neurons. Neuron 2000, 26:703-714.
84. Rieke F., Warland D., de Ruyter van Steveninck R., Bialek W. Spikes: exploring the neural code 1999, MIT, Cambridge, Mass.; London.
85. Ringach D.L., Hawken M.J., Shapley R. Dynamics of orientation tuning in macaque primary visual cortex. Nature 1997, 387:281-284.
86. Sanger T.D. Probability density estimation for the interpretation of neural population codes. Journal of Neurophysiology 1996, 76:2790-2793.
87. Saproo S., Serences J.T. Spatial attention improves the quality of population codes in human visual cortex. Journal of Neurophysiology 2010, 104:885-895.
88. Saproo S., Serences J.T. Attention improves information transmission between V1 and MT in humans. COSYNE 2011.
89. Schonwiesner M., Zatorre R.J. Spectro-temporal modulation transfer function of single voxels in the human auditory cortex measured with high-resolution fMRI. Proceedings of the National Academy of Sciences of the United States of America 2009, 106:14611-14616.
90. Seidemann E., Newsome W.T. Effect of spatial attention on the responses of area MT neurons. Journal of Neurophysiology 1999, 81:1783-1794.
91. Serences J.T., Boynton G.M. Feature-based attentional modulations in the absence of direct visual stimulation. Neuron 2007, 55:301-312.
92. Serences J.T., Ester E.F., Vogel E.K., Awh E. Stimulus-specific delay activity in human primary visual cortex. Psychological Science: A Journal of the American Psychological Society/APS 2009, 20:207-214.
93. Serences J.T., Yantis S. Attention and perceptual cohence fields. Trends in Cognitive Sciences 2006, 10:38-45.
94. Series P., Latham P.E., Pouget A. Tuning curve sharpening for orientation selectivity: Coding efficiency and the impact of correlations. Nature Neuroscience 2004, 7:1129-1135.
95. Shannon C.E. A Mathematical Theory of Communication. Bell System Technical Journal 1948, 27. 379-423, 623-656.
96. Shmuel A., Augath M., Oeltermann A., Logothetis N.K. Negative functional MRI response correlates with decreases in neuronal activity in monkey visual area V1. Nature Neuroscience 2006, 9:569-577.
97. Sirotin Y.B., Das A. Anticipatory haemodynamic signals in sensory cortex not predicted by local neuronal activity. Nature 2009, 457:475-479.
98. Soon C.S., Brass M., Heinze H.J., Haynes J.D. Unconscious determinants of free decisions in the human brain. Nature Neuroscience 2008, 11:543-545.
99. Swisher J.D., Gatenby J.C., Gore J.C., Wolfe B.A., Moon C.H., Kim S.G., et al. Multiscale pattern analysis of orientation-selective activity in the primary visual cortex. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2010, 30:325-330.
100. Teller D.Y. Linking propositions. Vision Research 1984, 24:1233-1246.
101. Theunissen F.E., Sen K., Doupe A.J. Spectral-temporal receptive fields of nonlinear auditory neurons obtained using natural sounds. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2000, 20:2315-2331.
102. Thirion B., Duchesnay E., Hubbard E., Dubois J., Poline J.B., Lebihan D., et al. Inverse retinotopy: Inferring the visual content of images from brain activation patterns. Neuroimage 2006, 33:1104-1116.
103. Treue S., Martinez Trujillo J.C. Feature-based attention influences motion processing gain in macaque visual cortex. Nature 1999, 399:575-579.
104. Treue S., Maunsell J.H. Attentional modulation of visual motion processing in cortical areas MT and MST. Nature 1996, 382:539-541.
105. Treue S., Maunsell J.H. Effects of attention on the processing of motion in macaque middle temporal and medial superior temporal visual cortical areas. Journal of Neuroscience 1999, 19:7591-7602.
106. Vapnik V. The nature of statistical learning theory 1995, Springer-Verlag.
107. Wade A.R., Rowland J. Early suppressive mechanisms and the negative blood oxygenation level-dependent response in human visual cortex. The Journal of Neuroscience: The Official Journal of the Society for Neuroscience 2010, 30:5008-5019.
108. Wandell B.A. Computational neuroimaging of human visual cortex. Annual Review of Neuroscience 1999, 22:145-173.
109. Weil R.S., Rees G. Decoding the neural correlates of consciousness. Current Opinion in Neurology 2010, 23:649-655.
110. Wu M.C., David S.V., Gallant J.L. Complete functional characterization of sensory neurons by system identification. Annual Review of Neuroscience 2006, 29:477-505.
111. Yantis S. The neural basis of selective attention: Cortical sources and targets of attentional modulation. Current Directions in Psychological Science: A Journal of the American Psychological Society 2008, 17:86-90.