Multi-voxel pattern analysis of fMRI data predicts clinical symptom severity

NeuroImage

Volumn 57, Issue 1, 2011, Pages 113-123

  Coutanche, Marc N ^a   Thompson Schill, Sharon L ^a   Schultz, Robert T ^b  

^a UNIVERSITY OF PENNSYLVANIA   (United States)

^b CHILDREN S HOSPITAL OF PHILADELPHIA   (United States)

Author keywords

Autism; FMRI; Multivariate; MVPA; Patient; Pattern

Indexed keywords

ADOLESCENT; ADULT; ARTICLE; AUTISM; BRAIN REGION; CHILD; CLINICAL ARTICLE; CONTROLLED STUDY; DATA ANALYSIS; DISEASE SEVERITY; FACE PROFILE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; FUSIFORM GYRUS; HUMAN; IMAGE ANALYSIS; INFORMATION PROCESSING; MALE; MULTI VOXEL PATTERN ANALYSIS; PREDICTION; PRIORITY JOURNAL; RECOGNITION; RELIABILITY; SCHOOL CHILD; TEMPORAL LOBE;

ADOLESCENT; AUTISTIC DISORDER; BRAIN; BRAIN MAPPING; CHILD; HUMANS; IMAGE INTERPRETATION, COMPUTER-ASSISTED; MAGNETIC RESONANCE IMAGING; MALE; YOUNG ADULT;

EID: 79956201846     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2011.04.016     Document Type: Article

References (75)

1. Benton A.L., Sivan A.B., Hamsher K., Varney N.R., Spreen O. Contributions to Neuropsychological Assessment 1994, Oxford University Press, New York.
2. Bookheimer S.Y., Wang A.T., Scott A., Sigman M., Dapretto M. Frontal contributions to face processing differences in autism: evidence from fMRI of inverted face processing. J. Int. Neuropsychol. Soc. 2008, 14(6):922-932.
3. Boucher J., Lewis V. Unfamiliar face recognition in relatively able autistic children. J. Child Psychol. Psychiatry 1992, 33:843-859.
4. Cohen J.D., MacWhinney B., Flatt M., Provost J. PsyScope: a new graphic interactive environment for designing psychology experiments. Behav. Res. Methods 1993, 25:257-271.
5. Costafreda S.G., Khanna A., Mourao-Miranda J., Fu C.H.Y. Neural correlates of sad faces predict clinical remission to cognitive behavioural therapy in depression. Neuroreport 2009, 20(7):637-641.
6. Cox R.W. AFNI: software for analysis and visualization of functional magnetic resonance neuroimages. Comput. Biomed. Res. 1996, 29:162-173.
7. Cox R.W., Jesmanowicz A. Real-time 3D image registration for functional MRI. Magn. Reson. Med. 1999, 42:1014-1018.
8. Cox D.D., Savoy R.L. Functional magnetic resonance imaging (fMRI) "brain reading": detecting and classifying distributed patterns of fMRI activity in human visual cortex. Neuroimage 2003, 19(2 Pt 1):261-270.
9. Critchley H.D., Daly E.M., Bullmore E.T., Williams S.C., Van Amelsvoort T., Robertson D.M., Rowe A., Phillips M., McAlonan G., Howlin P., et al. The functional neuroanatomy of social behaviour: changes in cerebral blood flow when people with autistic disorder process facial expressions. Brain 2000, 123:2203-2212.
10. Dailey M.N., Cottrell G.W., Reilly J. CAlifornia Facial Expressions (CAFE) 2001, Computer Science and Engineering Department, UCSD, La Jolla, CA.
11. Dalton K.M., Nacewicz B.M., Johnstone T., Schaefer H.S., Gernsbacher M.A., Goldsmith H.H., Alexander A.L., et al. Gaze fixation and the neural circuitry of face processing in autism. Nat. Neurosci. 2005, 8(4):519-526.
12. Deeley Q., Daly E.M., Surguladze S., Page L., Toal F., Robertson D., Curran S., Giampietro V., Seal M., Brammer M.J., et al. An event related functional magnetic resonance imaging study of facial emotion processing in Asperger syndrome. Biol. Psychiatry 2007, 62:207-217.
13. Detre G.J., Polyn S.M., Moore C.D., Natu V.S., Singer B.D., Cohen J.D., Haxby J.V., Norman K.A. The Multi-Voxel Pattern Analysis (MVPA) toolbox. Poster presented at the Annual Meeting of the Organization for Human Brain Mapping (Florence, Italy) 2006.
14. Diana R.A., Yonelinas A.P., Ranganath C. High-resolution multi-voxel pattern analysis of category selectivity in the medial temporal lobes. Hippocampus 2008, 18:536-541.
15. Ekman P., Friesen W.V. Pictures of Facial Affect 1976, Consulting Psychologists Press, Palo Alto, CA.
16. Endl W., Walla P., Lindinger G., Lalouscheck W., Barth F.G., Deecke L., Lang W. Early cortical activation indicates preparation for retrieval of memory for faces: an event-related potential study. Neurosci. Lett. 1998, 240:58-60.
17. Epstein R., Kanwisher N. A cortical representation of the local visual environment. Nature 1998, 392:598-601.
18. Fu C.H.Y., Mourao-Miranda J., Costafreda S.G., Khanna A., Marquand A.F., Williams S.C.R., Brammer M.J. Pattern classification of sad facial processing: toward the development of neurobiological markers in depression. Biol. Psychiatry 2008, 63(7):656-662.
19. Gadow K.D., Sprafkin J. Child Symptom Inventories Manual 1994, Checkmate Plus, Stony Brook, NY.
20. Gadow K.D., Sprafkin J., Weiss M.D. Adult Self-Report Inventory-4 Manual Stony Brook 1999, Checkmate Plus, NY.
21. Gadow K.D., Sprafkin J., Carlson G.A., Schneider J., Nolan E.E., Mattison R.E., Rundberg-Rivera V.A. DSM-IV-referenced, adolescent self-report rating scale. J. Am. Acad. Child Adolesc. Psychiatry 2002, 41(6):671-679.
22. Gauthier I., Tarr M.J., Anderson A.W., Skudlarski P., Gore J.C. Activation of the middle fusiform 'face area' increases with expertise in recognizing novel objects. Nat. Neurosci. 1999, 2:568-573.
23. Gilbert S.J., Meuwese J.D.I., Towgood K.J., Frith C.D., Burgess P.W. Abnormal functional specialization within medial prefrontal cortex in high-functioning autism: a multi-voxel similarity analysis. Brain 2009, 132:869-878.
24. Golland P., Fischl B. Permutation tests for classification: towards statistical significance in image-based studies. Inf. Process. Med. Imaging 2003, 330-341.
25. Grelotti D., Klin A., Gauthier I., Skudlarski P., Cohen D., Gore J., Volkmar F., et al. fMRI activation of the fusiform gyrus and amygdala to cartoon characters but not to faces in a boy with autism. Neuropsychologia 2005, 43(3):373-385.
26. Gur R.C., Sara R., Hagendoorn M., Marom O., Hughett O., Macy L., Turner T., Bajcsy R., Posner A., Gur R.E. A method for obtaining 3-dimensional facial expressions and its standardization for use in neurocognitive studies. J. Neurosci. Methods 2002, 115:137-143.
27. Hadjikhani N., Joseph R.M., Snyder J., Chabris C.F., Clark J., Steele S., McGrath L., Vangel M., Aharon I., Feczko E., et al. Activation of the fusiform gyrus when individuals with autism spectrum disorder view faces. Neuroimage 2004, 22:1141-1150.
28. Hadjikhani N., Joseph R.M., Snyder J., Tager-Flusberg H. Abnormal activation of the social brain during face perception in autism. Hum. Brain Mapp. 2007, 28:441-449.
29. Hall G.B.C., Szechtman H., Nahmias C. Enhanced salience and emotion recognition in Autism: a PET study. Am. J. Psychiatry 2003, 160:1439-1441.
30. Haxby J.V., Gobbini M.I., Furey M.L., Ishai A., Schouten J.L., Pietrini P. Distributed and overlapping representations of faces and objects in ventral temporal cortex. Science 2001, 293:2425-2430.
31. Haynes J., Rees G. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 2006, 7(7):523-534.
32. Hubl D., Bölte S., Feineis-Matthews S., Lanfermann H., Federspiel A., Strik W., Poustka F., Dierks T. Functional imbalance of visual pathways indicates alternative face processing strategies in autism. Neurology 2003, 61:1232-1237.
33. Humphreys K., Hasson U., Avidan G., Minshew N., Behrmann M. Cortical patterns of category-selective activation for faces, places and objects in adults with autism. Autism Res. 2008, 1:52-63.
34. Kamitani Y., Tong F. Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 2005, 8:679-685.
35. Kanwisher N., Yovel G. The fusiform face area: a cortical region specialized for the perception of faces. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2006, 361:2109-2128.
36. Kanwisher N., McDermott J., Chun M.M. The fusiform face area: a module in human extrastriate cortex specialized for face perception. J. Neurosci. 1997, 17:4302-4311.
37. Kim M.A., Tura E., Potkin S.G., Fallon J.H., Manoach D.S., Calhoun V.D., Turner J.A. Working memory circuitry in schizophrenia shows widespread cortical inefficiency and compensation. Schizophr. Res. 2010, 117:42-51.
38. Klin A. Three things to remember if you are a functional magnetic resonance imaging researcher of face processing in autism spectrum disorders. Biol. Psychiatry 2008, 64(7):549-551.
39. Koshino H., Kana R.K., Keller T.A., Cherkassky V.L., Minshew N.J., Just M.A. fMRI investigation of working memory for faces in autism: visual coding and underconnectivity with frontal areas. Cereb. Cortex 2008, 18:289-300.
40. Kriegeskorte N., Goebel R., Bandettini P. Information-based functional brain mapping. Proc. Natl. Acad. Sci. U. S. A. 2006, 103:3863-3868.
41. Lancaster J.L., Woldorff M.G., Parsons L.M., Liotti M., Freitas C.S., Rainey L., Kochunov P.V., Nickerson D., Mikiten S.A., Fox P.T. Automated Talairach atlas labels for functional brain mapping. Hum. Brain Mapp. 2000, 10:120-131.
42. Le Couteur A., Rutter M., Lord C., Rios P., Robertson S., Holdgrafer M., McLennan J. Autism diagnostic interview: a standardized investigator-based instrument. J. Autism Dev. Disord. 1989, 19:363-387.
43. Lord C., Rutter M., Goode S., Heemsbergen J., Jordan H., Mawhood L., Schopler E. Autism diagnostic observation schedule: a standardized observation of communicative and social behavior. J. Autism Dev. Disord. 1989, 19:185-212.
44. Lord C., Rutter M., Couteur A. Autism Diagnostic Interview-Revised: a revised version of a diagnostic interview for caregivers of individuals with possible pervasive developmental disorders. J. Autism Dev. Disord. 1994, 24(5):659-685.
45. Lord C., Risi S., Lambrecht L., Cook E.H., Leventhal B.L., DiLavore P.C., Pickles A., Rutter M. The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J. Autism Dev. Disord. 2000, 30:205-223.
46. Lundqvist D., Litton J.E. The Averaged Karolinska Directed Emotional Faces - AKDEF. AKDEF CDROM 1998, Psychology section, Karolinska Institute, Stockholm, USA.
47. Matsumoto D., Ekman P. Japanese and Caucasian Facial Expressions of Emotion (JACFEE) [Slides] 1988, Intercultural and Emotion Research Laboratory, Department of Psychology, San Francisco State University, San Francisco, CA.
48. McDuff S.G.R., Frankel H.C., Norman K.A. Multivoxel pattern analysis reveals increased memory targeting and reduced use of retrieved details during single-agenda source monitoring. J. Neurosci. 2009, 29:508-516.
49. Norman K.A., Polyn S.M., Detre G.J., Haxby J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 2006, 10:424-430.
50. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 1971, 9:97-113.
51. O'Toole A.J., Jiang F., Abdi H., Haxby J.V. Partially distributed representations of objects and faces in ventral temporal cortex. J. Cogn. Neurosci. 2005, 17:580-590.
52. O'Toole A.J., Jiang F., Abdi H., Pénard N., Dunlop J.P., Parent M.A. Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data. J. Cogn. Neurosci. 2007, 19:1735-1752.
53. Pereira F., Mitchell T., Botvinick M. Machine learning classifiers and fMRI: a tutorial overview. Neuroimage 2009, 45(Suppl. 1):S199-S209.
54. Perlman S.B., Hudac C.M., Pegors T., Minshew N.J., Pelphrey K.A. Experimental manipulation of face-evoked activity in the fusiform gyrus of individuals with autism. Soc. Neurosci. 2010, 1-9.
55. Pierce K., Redcay E. Fusiform function in children with an autism spectrum disorder is a matter of "who". Biol. Psychiatry 2008, 64(7):552-560.
56. Pierce K., Müller R.A., Ambrose J., Allen G., Courchesne E. Face processing occurs outside the fusiform 'face area' in autism: evidence from functional MRI. Brain 2001, 124:2059-2073.
57. Pierce K., Haist F., Sedaghat F., Courchesne E. The brain response to personally familiar faces in autism: findings of fusiform activity and beyond. Brain 2004, 127(12):2703-2716.
58. Piggot J., Kwon H., Mobbs D., Blasey C., Lotspeich L., Menon V., Bookheimer S., Reiss A.L. Emotional attribution in high-functioning individuals with autistic spectrum disorder: a functional imaging study. J. Am. Acad. Child Adolesc. Psychiatry 2004, 43:473-480.
59. Polyn S.M., Natu V.S., Cohen J.D., Norman K.A. Category-specific cortical activity precedes retrieval during memory search. Science 2005, 310:1963-1966.
60. Quamme J.R., Weiss D.J., Norman K.A. Listening for recollection: a multi-voxel pattern analysis of recognition memory retrieval strategies. Front. Hum. Neurosci. 2010, 4:61.
61. Rizk-Jackson A., Stoffers D., Sheldon S., Kuperman J., Dale A., Goldstein J., Corey-Bloom J., et al. Evaluating imaging biomarkers for neurodegeneration in pre-symptomatic Huntington's disease using machine learning techniques. Neuroimage 2010.
62. Scherf K.S., Luna B., Minshew N., Behrmann M. Location, location, location: alterations in the functional topography of face- but not object- or place-related cortex in adolescents with autism. Front. Hum. Neurosci. 2010, 4:26.
63. Schultz R.T., Gauthier I., Klin A., Fulbright R.K., Anderson A.W., Volkmar F., Skudlarski P., Lacadie C., Cohen D.J., Gore J.C. Abnormal ventral temporal cortical activity during face discrimination among individuals with autism and Asperger syndrome. Arch. Gen. Psychiatry 2000, 57:331-340.
64. Schultz R.T., Grelotti D.J., Klin A., Kleinman J., Van der Gaag C., Marois R., Skudlarski P. The role of the fusiform face area in social cognition: implications for the pathobiology of autism. Philos. Trans. R. Soc. Lond. B Biol. Sci. 2003, 358(1430):415-427.
65. Schultz R.T., Grupe D.W., Hunyadi E., Jones W., Wolf J., Hoyt E.G., Lin D., Herlihy L.E. The effect of task differences on FFA activity in autism spectrum disorders. Paper presented at the International Meeting for Autism Research, London, England 2008, May.
66. Spiridon M., Kanwisher N. How distributed is visual category information in human occipito-temporal cortex? An fMRI study. Neuron 2002, 35:1157-1165.
67. Talairach J., Tournoux P. Co-Planar Stereotaxic Atlas of the Human Brain 1988, Thieme, Stuttgart, Germany.
68. Tottenham N., Borscheid A., Ellertsen K., Marcu D.J., Nelson C.A. Categorization of facial expressions in children and adults: establishing a larger stimulus set. J. Cogn. Neurosci. 2002, 14:S74.
69. Vul E., Harris C., Winkielman P., Pashler H. Puzzlingly high correlations in fMRI studies of emotion, personality, and social cognition. Perspect. Psychol. Sci. 2009, 4(3):274-290.
70. Wang A.T., Dapretto M., Hariri A.R., Sigman M., Bookheimer S.Y. Neural correlates of facial affect processing in children and adolescents with autism spectrum disorder. J. Am. Acad. Child Adolesc. Psychiatry 2004, 43:481-490.
71. Winston J.S., Henson R.N.A., Fine-Goulden M.R., Dolan R.J. fMRI-adaptation reveals dissociable neural representations of identity and expression in face perception. J. Neurophysiol. 2004, 92:1830-1839.
72. Wolf J.M., Tanaka J.W., Klaiman C., Cockburn J., Herlihy L., Brown C., South M., McPartland J., Kaiser M.D., Phillips R., et al. Specific impairment of face-processing abilities in children with autism spectrum disorder using the Let's Face It! skills battery. Autism Res. 2008, 1:329-340.
73. Yoon J.H., Tamir D., Minzenberg M.J., Ragland J.D., Ursu S., Carter C.S. Multivariate pattern analysis of functional magnetic resonance imaging data reveals deficits in distributed representations in schizophrenia. Biol. Psychiatry 2008, 64:1035-1041.
74. Zhang J., Yang Y. Robustness of regularized linear classification methods in text categorization. Proceedings of SIGIR-2003, 26st ACM International Conference on Research and Development in Information Retrieval 2003, 190-197.
75. Zhang L., Samaras D., Tomasi D., Alia-Klein N., Cottone L., Leskovjan A., Volkow N., et al. Exploiting temporal information in functional magnetic resonance imaging brain data. Medical Image Computing and Computer-Assisted Intervention: MICCAI International Conference on Medical Image Computing and Computer-Assisted Intervention 2005, 8(Pt 1):679-687.