Pattern-information fMRI: New questions which it opens up and challenges which face it

International Journal of Imaging Systems and Technology

Volumn 20, Issue 1, 2010, Pages 31-41

  Raizada, Rajeev D S ^a   Kriegeskorte, Nikolaus ^b  

^a Lamont Doherty Earth Observatory   (United States)

^b MEDICAL RESEARCH COUNCIL   (United Kingdom)

Author keywords

FMRI; Pattern information

Indexed keywords

BRAIN ACTIVITY; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUTURE DIRECTIONS; HIGH-DIMENSIONAL; INDIVIDUAL DIFFERENCES; MULTIVARIATE APPROACH; NEURAL ACTIVITY PATTERNS; NEURAL PATTERNS; NEURONAL POPULATIONS; PATTERN INFORMATION; STRONG GROWTH;

MAGNETIC RESONANCE IMAGING; NEUROPHYSIOLOGY; RESONANCE;

BRAIN;

EID: 77449104567     PISSN: 08999457     EISSN: 10981098     Source Type: Journal    
DOI: 10.1002/ima.20225     Document Type: Article

References (116)

1. M. Balasubramanian and E.L. Schwartz, The isomap algorithm and topological stability, Science 295 (2002), 7.
2. M. Belkin and P. Niyogi, Laplacian eigenmaps for dimensionality reduction and data representation, Neural Comput 15 (2003), 1373-1396.
3. S. Bray, C. Chang, and F. Hoeft, Applications of multivariate pattern classification analyses in developmental neuroimaging of healthy and clinical populations, Front Hum Neurosci 3 (2009), 32.
4. G.J. Brouwer and D.J. Heeger, Decoding and reconstructing color from responses in human visual cortex, J Neurosci 29 (2009), 13992-14003.
5. T.A. Carlson, P. Schrater, and S. He, Patterns of activity in the categorical representations of objects, J Cogn Neurosci 15 (2003), 704-717.
6. J. Carroll and J. Chang, Analysis of individual differences in multidimensional scaling via an N-way generalization of "Eckart-Young" decomposition, Psychometrika 35 (1970), 283-319.
7. S.G. Costafreda, C. Chu, J. Ashburner, and C.H.Y. Fu, Prognostic and diagnostic potential of the structural neuroanatomy of depression, PLoS One 4 (2009), e6353.
8. T. Cover, Geometrical and statistical properties of systems of linear inequalities with applications in pattern recognition, IEEE Trans Electron Comput 14 (1965), 326-334.
9. D.D. Cox and R.L. Savoy, Functional magnetic resonance imaging (fMRI) "brain reading": Detecting and classifying distributed patterns of fMRI activity in human visual cortex, Neuroimage 19 (2 Part 1) (2003), 261-270.
10. J. Crinion and C.J. Price, Right anterior superior temporal activation predicts auditory sentence comprehension following aphasic stroke, Brain 128 (2005), 2858-2871.
11. C. Davatzikos, S.M. Resnick, X. Wu, P. Parmpi, and C.M. Clark, Individual patient diagnosis of AD and FTD via high-dimensional pattern classification of MRI, Neuroimage 41 (2008), 1220-1227.
12. C. Davatzikos, D. Shen, R.C. Gur, X. Wu, D. Liu, Y. Fan, P. Hughett, B.I. Turetsky, and R.E. Gur, Whole-brain morphometric study of schizophrenia revealing a spatially complex set of focal abnormalities, Arch Gen Psychiatry 62 (2005), 1218-1227.
13. R.C. deCharms, Applications of real-time fMRI, Nat Rev Neurosci 9 (2008), 720-729.
14. J.B. Demb, G.M. Boynton, and D.J. Heeger, Brain activity in visual cortex predicts individual differences in reading performance, Proc Natl Acad Sci USA 94 (1997), 13363-13366.
15. O. Demirci, V.P. Clark, and V.D. Calhoun, A projection pursuit algorithm to classify individuals using fMRI data: Application to schizophrenia, Neuroimage 39 (2008a), 1774-1782.
16. O. Demirci, V. Clark, V. Magnotta, N. Andreasen, J. Lauriello, K. Kiehl, G. Pearlson, and V.D. Calhoun, A review of challenges in the use of fMRI for disease classification/characterization and a projection pursuit application from multi-site fMRI schizophrenia study, Brain Imaging Behav 2 (2008b), 147-226.
17. P.E. Downing, A.J. Wiggett, and M.V. Peelen, Functional magnetic resonance imaging investigation of overlapping lateral occipitotemporal activations using multi-voxel pattern analysis, J Neurosci 27 (2007), 226-233.
18. S. Edelman, Representation is representation of similarities, Behav Brain Sci 21 (1998), 449-467; discussion 467-498.
19. Y. Fan, N. Batmanghelich, C.M. Clark, and C. Davatzikos; Alzheimer's Disease Neuroimaging Initiative, Spatial patterns of brain atrophy in MCI patients, identified via high-dimensional pattern classification, predict subsequent cognitive decline, Neuroimage 39 (2008b), 1731-1743.
20. Y. Fan, R.E. Gur, R.C. Gur, X. Wu, D. Shen, M.E. Calkins, and C. Davatzikos, Unaffected family members and schizophrenia patients share brain structure patterns: A high-dimensional pattern classification study, Biol Psychiatry 63 (2008c), 118-124.
21. Y. Fan, S.M. Resnick, X. Wu, and C. Davatzikos, Structural and functional biomarkers of prodromal Alzheimer's disease: A high-dimensional pattern classification study, Neuroimage 41 (2008a), 277-285.
22. E. Formisano, F. De Martino, M. Bonte, and R. Goebel, "Who" is saying "what?" Brain-based decoding of human voice and speech, Science 322 (2008), 970-973.
23. I. Frank and J. Friedman, A statistical view of some chemometrics regression tools, Technometrics 35 (1993), 109-135.
24. K. Friston, C. Chu, J. Mourão-Miranda, O. Hulme, G. Rees, W. Penny, and J. Ashburner, Bayesian decoding of brain images, Neuroimage 39 (2008), 181-205.
25. K.J. Friston, L. Harrison, and W. Penny, Dynamic causal modelling, Neuroimage 19 (2003), 1273-1302.
26. G. Ganesh, E. Burdet, M. Haruno, and M. Kawato, Sparse linear regression for reconstructing muscle activity from human cortical fMRI, Neuroimage 42 (2008), 1463-1472.
27. J.L. Gardner, Is cortical vasculature functionally organized? NeuroImage 49 (2010), 1953-1956.
28. A.P. Georgopoulos, A.B. Schwartz, and R.E. Kettner, Neuronal population coding of movement direction, Science 233 (1986), 1416-1419.
29. J.S. Guntupalli and J.V. Haxby, Inter-subject hyperalignment of neural representational space for objects, Soc Neurosci(2009), Abstract 262.20.
30. S.J. Hanson, T. Matsuka, and J.V. Haxby, Combinatorial codes in ventral temporal lobe for object recognition: Haxby (2001) revisited: Is there a "face" area?, Neuroimage 23 (2004), 156-166.
31. U. Hasson, Y. Nir, I. Levy, G. Fuhrmann, and R. Malach, Intersubject synchronization of cortical activity during natural vision, Science 303 (2004), 1634-1640.
32. T. Hastie, R. Tibshirani, and J.H. Friedman, The elements of statistical learning: Data mining, inference, and prediction, 2nd ed, Springer, New York, 2009.
33. J.V. Haxby, M.I. Gobbini, M.L. Furey, A. Ishai, J.L. Schouten, and P. Pietrini, Distributed and overlapping representations of faces and objects in ventral temporal cortex, Science 293 (2001), 2425-2430.
34. J. Haynes and G. Rees, Predicting the orientation of invisible stimuli from activity in human primary visual cortex, Nat Neurosci 8 (2005), 686- 691. (Pubitemid 40594212)
35. J.-D. Haynes and G. Rees, Decoding mental states from brain activity in humans, Nat Rev Neurosci 7 (2006), 523-534.
36. F. Hoeft, A.A. Lightbody, H.C. Hazlett, S. Patnaik, J. Piven, and A.L. Reiss, Morphometric spatial patterns differentiating boys with fragile X syndrome, typically developing boys, and developmentally delayed boys aged 1 to 3 years, Arch Gen Psychiatry 65 (2008), 1087-1097.
37. I.D. Holloway, G.R. Price, and D. Ansari, Common and segregated neural pathways for the processing of symbolic and nonsymbolic numerical magnitude: An fMRI study, Neuroimage 49 (2010), 1006-1017.
38. J.D. Howard, J. Plailly, M. Grueschow, J.-D. Haynes, and J.A. Gottfried, Odor quality coding and categorization in human posterior piriform cortex, Nat Neurosci 12 (2009), 932-938.
39. P. Howland, J. Wang, and H. Park, Solving the small sample size problem in face recognition using generalized discriminant analysis, Pattern Recognit 39 (2006), 277-287.
40. C.P. Hung, G. Kreiman, T. Poggio, and J.J. DiCarlo, Fast readout of object identity from macaque inferior temporal cortex, Science 310 (2005), 863- 866.
41. S.J. Johnston, S.G. Boehm, D. Healy, R. Goebel, and D.E.J. Linden, Neurofeedback: A promising tool for the self-regulation of emotion networks, Neuroimage 49 (2010), 1066-1072.
42. Y. Kamitani and Y. Sawahata, Spatial smoothing hurts localization but not information: Pitfalls for brain mappers, NeuroImage 49 (2010), 1949-1952.
43. Y. Kamitani and F. Tong, Decoding the visual and subjective contents of the human brain, Nat Neurosci 8 (2005), 679-685. (Pubitemid 40594211)
44. N. Kanwisher, J. McDermott, and M.M. Chun, The fusiform face area: A module in human extrastriate cortex specialized for face perception, J Neurosci 17 (1997), 4302-4311.
45. K.N. Kay, T. Naselaris, R.J. Prenger, and J.L. Gallant, Identifying natural images from human brain activity, Nature 452 (2008), 352-355.
46. P. Khurd, R. Verma, and C. Davatzikos, Kernel-based manifold learning for statistical analysis of diffusion tensor images, Inf Process Med Imaging: Proc Conf 20 (2007), 581-593.
47. R. Kiani, H. Esteky, K. Mirpour, and K. Tanaka, Object category structure in response patterns of neuronal population in monkey inferior temporal cortex, J Neurophysiol 97 (2007), 4296-4309.
48. S. Klöppel, Brain morphometry and functional imaging techniques in dementia: Methods, findings and relevance in forensic neurology, Curr Opin Neurol 22 (2009), 612-616.
49. A. Knops, B. Thirion, E. Hubbard, V. Michel, and S. Dehaene, Recruitment of an area involved in eye movements during mental arithmetic, Science 324 (2009), 1583-1585.
50. N. Koutsouleris, E.M. Meisenzahl, C. Davatzikos, R. Bottlender, T. Frodl, J. Scheuerecker, G. Schmitt, T. Zetzsche, P. Decker, M. Reiser, H.-J. Möller, and C. Gaser, Use of neuroanatomical pattern classification to identify subjects in at-risk mental states of psychosis and predict disease transition, Arch Gen Psychiatry 66 (2009), 700-712.
51. N. Kriegeskorte and P. Bandettini, Intersubject-information-based brain mapping reveals cortical representations canonically driven by a movie presentation, Soc Neurosci (2006b), Abstract 309.10.
52. N. Kriegeskorte and P. Bandettini, Analyzing for information, not activation, to exploit high-resolution fMRI, Neuroimage 38 (2007), 649- 662.
53. N. Kriegeskorte, R. Cusack, and P. Bandettini, How does an fMRI voxel sample the neuronal activity pattern: Compact-kernel or complex spatiotemporal filter?, NeuroImage 49 (2010), 1965-1976.
54. N. Kriegeskorte, E. Formisano, B. Sorger, and R. Goebel, Individual faces elicit distinct response patterns in human anterior temporal cortex, Proc Natl Acad Sci USA 104 (2007), 20600-20605.
55. N. Kriegeskorte, R. Goebel, and P. Bandettini, Information-based functional brain mapping, Proc Natl Acad Sci USA 103 (2006), 3863-3868.
56. N. Kriegeskorte, M. Mur, and P. Bandettini, Representational similarity analysis-Connecting the branches of systems neuroscience, Front Syst Neurosci 2 (2008b), 4.
57. N. Kriegeskorte, M. Mur, D.A. Ruff, R. Kiani, J. Bodurka, H. Esteky, K. Tanaka, and P.A. Bandettini, Matching categorical object representations in inferior temporal cortex of man and monkey, Neuron 60 (2008a), 1126-1141.
58. N. Kriegeskorte, W.K. Simmons, P.S.F. Bellgowan, and C.I. Baker, Circular analysis in systems neuroscience: The dangers of double dipping, Nat Neurosci 12 (2009), 535-540.
59. J. Kruskal, Multidimensional scaling by optimizing goodness of fit to a nonmetric hypothesis, Psychometrika 29 (1964), 1-27.
60. S.M. LaConte, S.J. Peltier, and X.P. Hu, Real-time fMRI using brain-state classification, Hum Brain Mapp 28 (2007), 1033-1044.
61. J.-H. Lee, J. Ryu, F.A. Jolesz, Z.-H. Cho, and S.-S. Yoo, Brain-machine interface via real-time fMRI: Preliminary study on thought-controlled robotic arm, Neurosci Lett 450 (2009), 1-6.
62. W. Li, J.D. Howard, T.B. Parrish, and J.A. Gottfried, Aversive learning enhances perceptual and cortical discrimination of indiscriminable odor cues, Science 319 (2008), 1842-1845.
63. S. Li, S.D. Mayhew, and Z. Kourtzi, Learning shapes the representation of behavioral choice in the human brain, Neuron 62 (2009), 441-452.
64. T. Li, C. Zhang, and M. Ogihara, A comparative study of feature selection and multiclass classification methods for tissue classification based on gene expression, Bioinformatics 20 (2004), 2429-2437.
65. H. Liu, Y. Agam, J.R. Madsen, and G. Kreiman, Timing, timing, timing: Fast decoding of object information from intracranial field potentials in human visual cortex, Neuron 62 (2009), 281-290.
66. F. Lotte, M. Congedo, A. Lecuyer, F. Lamarche, and B. Arnaldi, A review of classification algorithms for EEG-based brain-computer interfaces, J Neural Eng 4 (2007), R1-R13.
67. W.-L. Luo and T.E. Nichols, Diagnosis and exploration of massively univariate neuroimaging models, Neuroimage 19 (2003), 1014-1032.
68. A.F. Marquand, M. Howard, M.J. Brammer, C. Chu, S. Coen, and J. Mourao-Miranda, Quantitative prediction of subjective pain intensity from whole-brain fMRI data using gaussian processes, NeuroImage 49 (2010), 2178-2189.
69. D.L. Medin, Concepts and conceptual structure, Am Psychol 44 (1989), 1469-1481.
70. N. Mesgarani, S.V. David, J.B. Fritz, and S.A. Shamma, Phoneme representation and classification in primary auditory cortex, J Acoust Soc Am 123 (2008), 899-909.
71. E.M. Meyers, D.J. Freedman, G. Kreiman, E.K. Miller, and T. Poggio, Dynamic population coding of category information in inferior temporal and prefrontal cortex, J Neurophysiol 100 (2008), 1407-1419.
72. C. Misra, Y. Fan, and C. Davatzikos, Baseline and longitudinal patterns of brain atrophy in MCI patients, and their use in prediction of short-term conversion to ad: Results from adni, Neuroimage 44 (2009), 1415-1422.
73. T.M. Mitchell, R. Hutchinson, R.S. Niculescu, F. Pereira, X. Wang, M. Just, and S. Newman, Learning to decode cognitive states from brain images, Mach Learn 57 (2004), 145-175.
74. T.M. Mitchell, S.V. Shinkareva, A. Carlson, K.-M. Chang, V.L. Malave, R.A. Mason, and M.A. Just, Predicting human brain activity associated with the meanings of nouns, Science 320 (2008), 1191-1195.
75. J. Mourão-Miranda, A.L.W. Bokde, C. Born, H. Hampel, and M. Stetter, Classifying brain states and determining the discriminating activation patterns: Support vector machine on functional MRI data, Neuroimage 28 (2005), 980-995.
76. K.-R. Muller, M. Tangermann, G. Dornhege, M. Krauledat, G. Curio, and B. Blankertz, Machine learning for real-time single-trial EEG-analysis: From brain-computer interfacing to mental state monitoring, J Neurosci Methods 167 (2008), 82-90.
77. M. Mur, P. Bandettini, and N. Kriegeskorte, Revealing representational content with pattern-information fMRI-An introductory guide, Soc Cogn Affect Neurosci 4 (2009), 101-109.
78. M.A.L. Nicolelis and M.A. Lebedev, Principles of neural ensemble physiology underlying the operation of brain-machine interfaces, Nat Rev Neurosci 10 (2009), 530-540.
79. K.A. Norman, S.M. Polyn, G.J. Detre, and J.V. Haxby, Beyond mind-reading: Multi-voxel pattern analysis of fMRI data, Trends Cogn Sci 10 (2006), 424-430.
80. R. Nosofsky, Similarity, frequency, and category representations, J Exp Psychol Learn Mem Cogn 14 (1988), 54-65.
81. H.P. Op de Beeck, Against hyperacuity in brain reading: Spatial smoothing does not hurt multivariate fMRI analyses? NeuroImage 49 (2010), 1943-1948.
82. H.P. Op de Beeck, C.I. Baker, J.J. DiCarlo, and N.G. Kanwisher, Discrimination training alters object representations in human extrastriate cortex, J Neurosci 26 (2006), 13025-13036.
83. H.P. Op de Beeck, K. Torfs, and J. Wagemans, Perceived shape similarity among unfamiliar objects and the organization of the human object vision pathway, J Neurosci 28 (2008), 10111-10123.
84. H. Op de Beeck, J. Wagemans, and R. Vogels, Inferotemporal neurons represent low-dimensional configurations of parameterized shapes, Nat Neurosci 4 (2001), 1244-1252.
85. A.J. O'Toole, F. Jiang, H. Abdi, N. Pénard, J.P. Dunlop, and M.A. Parent, Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data, J Cogn Neurosci 19 (2007), 1735-1752.
86. A.J. Parker and W.T. Newsome, Sense and the single neuron: Probing the physiology of perception, Annu Rev Neurosci 21 (1998), 227-277.
87. M.V. Peelen and P.E. Downing, Using multi-voxel pattern analysis of fMRI data to interpret overlapping functional activations, Trends Cogn Sci 11 (2007), 4-5.
88. M.V. Peelen, L. Fei-Fei, and S. Kastner, Neural mechanisms of rapid natural scene categorization in human visual cortex, Nature 460 (2009), 94-97.
89. F. Pereira, T. Mitchell, and M. Botvinick, Machine learning classifiers and fMRI: A tutorial overview, Neuroimage 45 (1 Suppl)(2009), S199-S209.
90. R.A. Poldrack, Y. Halchenko, and S.K. Hanson, Decoding the large-scale structure of brain function by classifying mental states across individuals, Psychol Sci 20 (2009), 1364-1372.
91. R.Q. Quiroga, L. Reddy, C. Koch, and I. Fried, Decoding visual inputs from multiple neurons in the human temporal lobe, J Neurophysiol 98 (2007), 1997-2007.
92. J. Racine and Q. Li, Nonparametric estimation of regression functions with both categorical and continuous data, J Econom 119 (2004), 99-130.
93. R.D.S. Raizada, F.M. Tsao, H.M. Liu, I.D. Holloway, D. Ansari, and P.K. Kuhl, Linking brain-wide multivoxel activation patterns to behaviour: Examples from language and math (accepted for publication in NeuroImage).
94. R.D.S. Raizada, F.M. Tsao, H.M. Liu, and P.K. Kuhl, Quantifying the adequacy of neural representations for a cross-language phonetic discrimination task: Prediction of individual differences, Cereb Cortex 20 (2010), 1-12; DOI: 10.1093/cercor/bhp076.
95. J.D. Ramsey, S.J. Hanson, C. Hanson, Y.O. Halchenko, R.A. Poldrack, and C. Glymour, Six problems for causal inference from fMRI, NeuroImage 49 (2010), 1545-1558.
96. S. Raudys and A. Jain, Small sample-size effects in statistical pattern-recognition- Recommendations for practitioners, IEEE Trans Pattern Anal Mach Intell 13 (1991), 252-264.
97. A.C. Rencher, Methods of multivariate analysis, 2nd ed., Wiley, New York, (2002).
98. A. Roebroeck, E. Formisano, and R. Goebel, Mapping directed influence over the brain using Granger causality and fMRI, Neuroimage 25 (2005), 230-242.
99. G. Rota, R. Sitaram, R. Veit, M. Erb, N. Weiskopf, G. Dogil, and N. Birbaumer, Self-regulation of regional cortical activity using real-time fMRI: The right inferior frontal gyrus and linguistic processing, Hum Brain Mapp 30 (2009), 1605-1614.
100. L.K. Saul, K.Q. Weinberger, J.H. Ham, F. Sha, and D.D. Lee, "Spectral methods for dimensionality reduction, " In Semisupervised learning, O. Chapelle, B. Schoelkopf, and A. Zien (Editors), MIT Press, Cambridge, MA, 2006, 293-308.
101. A. Schurger, F. Pereira, A. Treisman, and J. Cohen, Reproducibility distinguishes conscious from nonconscious neural representations, Science 327 (2010), 97-99.
102. J.T. Serences and G.M. Boynton, Feature-based attentional modulations in the absence of direct visual stimulation, Neuron 55 (2007), 301-312.
103. R.N. Shepard, The analysis of proximities-Multidimensional-scaling with an unknown distance function I, Psychometrika 27 ( 1962), 125- 140.
104. R.N. Shepard, Toward a universal law of generalization for psychological science, Science 237 (1987), 1317-1323.
105. S.V. Shinkareva, R.A. Mason, V.L. Malave, W. Wang, T.M. Mitchell, and M.A. Just, Using fMRI brain activation to identify cognitive states associated with perception of tools and dwellings, PLoS One 3 (2008), e1394.
106. A. Shmuel, D. Chaimow, G. Raddatz, K. Ugurbil, and E. Yacoub, Mechanisms underlying decoding at 7 T: Ocular dominance columns, broad structures, and macroscopic blood vessels in V1 convey information on the stimulated eye, NeuroImage 49 (2010), 1957-1964.
107. R. Sitaram, A. Caria, and N. Birbaumer, Hemodynamic brain-computer interfaces for communication and rehabilitation, Neural Netw 22 (2009), 1320-1328.
108. C.S. Soon, M. Brass, H.-J. Heinze, and J.-D. Haynes, Unconscious determinants of free decisions in the human brain, Nat Neurosci 11 (2008), 543-545.
109. D. Sun, T.G.M. van Erp, P.M. Thompson, C. Bearden, M. Daley, L. Kushan, M. Hardt, K. Nuechterlein, A.W. Toga, and T.D. Cannon, Elucidating a magnetic resonance imaging-based neuroanatomic biomarker for psychosis: Classification analysis using probabilistic brain atlas and machine learning algorithms, Biol Psychiatry 66 (2009), 1055-1060.
110. J.B. Tenenbaum, V. de Silva, and J.C. Langford, A global geometric framework for nonlinear dimensionality reduction, Science 290 (2000), 2319-2323.
111. A. Tversky, Features of similarity, Psychol Rev 84 (1977), 327-352.
112. E. Vul, C. Harris, P. Winkielman, and H. Pashler, Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition (formerly titled "voodoo correlations in social neuroscience"), Perspect Psychol Sci 4 (2009), 274-290.
113. D.B. Walther, E. Caddigan, L. Fei-Fei, and D.M. Beck, Natural scene categories revealed in distributed patterns of activity in the human brain, J Neurosci 29 (2009), 10573-10581.
114. M. Weber, S.L. Thompson-Schill, D. Osherson, J. Haxby, and L. Parsons, Predicting judged similarity of natural categories from their neural representations, Neuropsychologia 47 (2009), 859-868.
115. M.A. Williams, S. Dang, and N.G. Kanwisher, Only some spatial patterns of fMRI response are read out in task performance, Nat Neurosci 10 (2007), 685-686.
116. K. Worsley, J. Poline, K. Friston, and A. Evans, Characterizing the response of PET and fMRI data using multivariate linear models, Neuroimage 6 (1997), 305-319.