Multivariate pattern analysis reveals common neural patterns across individuals during touch observation

NeuroImage

Volumn 60, Issue 1, 2012, Pages 204-212

  Kaplan, Jonas T ^a   Meyer, Kaspar ^a  

^a UNIVERSITY OF SOUTHERN CALIFORNIA   (United States)

Author keywords

FMRI; Multisensory; MVPA; Pattern analysis; Perception; Touch observation

Indexed keywords

ACCURACY; ADULT; ANALYTIC METHOD; ARTICLE; CONTROLLED STUDY; DISCRIMINATIVE STIMULUS; ELECTROENCEPHALOGRAM; EVOKED SOMATOSENSORY RESPONSE; FEMALE; HUMAN; HUMAN EXPERIMENT; INTRAPARIETAL SULCUS; MALE; MENTAL TASK; MULTIVARIATE PATTERN ANALYSIS; NERVE CELL NETWORK; NEUROIMAGING; OCCIPITAL CORTEX; POSTCENTRAL GYRUS; PREDICTION; PRIMARY SOMATOSENSORY CORTEX; PRIORITY JOURNAL; SECONDARY SOMATOSENSORY CORTEX; SOMATOSENSORY STIMULATION; TACTILE DISCRIMINATION; TACTILE STIMULATION; TASK PERFORMANCE; VISUAL STIMULATION;

BRAIN MAPPING; FEMALE; HUMANS; MAGNETIC RESONANCE IMAGING; MALE; MULTIVARIATE ANALYSIS; SOMATOSENSORY CORTEX; TOUCH PERCEPTION;

EID: 84856004707     PISSN: 10538119     EISSN: 10959572     Source Type: Journal    
DOI: 10.1016/j.neuroimage.2011.12.059     Document Type: Article

References (66)

1. Amedi A., Malach R., Hendler T., Peled S., Zohary E. Visuo-haptic object-related activation in the ventral visual pathway. Nat. Neurosci. 2001, 4:324-330.
2. Amedi A., Stern W.M., Camprodon J.A., Bermpohl F., Merabet L., Rotman S., Hemond C., Meijer P., Pascual-Leone A. Shape conveyed by visual-to-auditory sensory substitution activates the lateral occipital complex. Nat. Neurosci. 2007, 10:687-689.
3. Binkofski F., Buccino G., Stephan K.M., Rizzolatti G., Seitz R.J., Freund H.J. A parieto-premotor network for object manipulation: evidence from neuroimaging. Exp. Brain Res. 1999, 128:210-213.
4. Blakemore S.-J., Bristow D., Bird G., Frith C., Ward J. Somatosensory activations during the observation of touch and a case of vision-touch synaesthesia. Brain 2005, 128:1571-1583.
5. Brainard D.H. The psychophysics toolbox. Spat. Vis. 1997, 10:433-436.
6. Clithero J.A., Smith D.V., Carter R.M., Huettel S.A. Within- and cross-participant classifiers reveal different neural coding of information. NeuroImage 2011, 56:699-708.
7. Damasio A., Meyer K. Behind the looking-glass. Nature 2008, 454:167-168.
8. Davatzikos C., Ruparel K., Fan Y., Shen D.G., Acharyya M., Loughead J.W., Gur R.C., Langleben D.D. Classifying spatial patterns of brain activity with machine learning methods: application to lie detection. Neuroimage 2005, 28:663-668.
9. Deibert E., Kraut M., Kremen S., Hart J. Neural pathways in tactile object recognition. Neurology 1999, 52:1413-1417.
10. Dijkerman H.C., de Haan E.H. Somatosensory processes subserving perception and action. Behav. Brain Sci. 2007, 30:189-201. discussion 201-139.
11. Dinstein I., Gardner J.L., Jazayeri M., Heeger D.J. Executed and observed movements have different distributed representations in human aIPS. J. Neurosci. 2008, 28:11231-11239.
12. Ebisch S.J.H., Perrucci M.G., Ferretti A., Del Gratta C., Romani G.L., Gallese V. The sense of touch: embodied simulation in a visuotactile mirroring mechanism for observed animate or inanimate touch. J. Cogn. Neurosci. 2008, 20:1611-1623.
13. Eger E., Ashburner J., Haynes J.-D., Dolan R.J., Rees G. fMRI activity patterns in human LOC carry information about object exemplars within category. J. Cogn. Neurosci. 2008, 20:356-370.
14. Etzel J.A., Valchev N., Keysers C. The impact of certain methodological choices on multivariate analysis of fMRI data with support vector machines. Neuroimage 2011, 54:1159-1167.
15. Grefkes C., Fink G.R. The functional organization of the intraparietal sulcus in humans and monkeys. J. Anat. 2005, 207:3-17.
16. Grefkes C., Weiss P.H., Zilles K., Fink G.R. Crossmodal processing of object features in human anterior intraparietal cortex: an fMRI study implies equivalencies between humans and monkeys. Neuron 2002, 35:173-184.
17. Grill-Spector K., Kushnir T., Edelman S., Avidan G., Itzchak Y., Malach R. Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron 1999, 24:187-203.
18. Guillot A., Collet C., Nguyen V.A., Malouin F., Richards C., Doyon J. Brain activity during visual versus kinesthetic imagery: an fMRI study. Hum. Brain Mapp. 2009, 30:2157-2172.
19. Habas C., Cabanis E.A. The neural network involved in a bimanual tactile-tactile matching discrimination task: a functional imaging study at 3 T. Neuroradiology 2007, 49:681-688.
20. Hanke M., Halchenko Y.O., Sederberg P.B., Hanson S.J., Haxby J.V., Pollmann S. PyMVPA: A python toolbox for multivariate pattern analysis of fMRI data. Neuroinformatics 2009, 7:37-53.
21. Haynes J.-D., Rees G. Predicting the orientation of invisible stimuli from activity in human primary visual cortex. Nat. Neurosci. 2005, 8:686-691.
22. Haynes J.-D., Rees G. Decoding mental states from brain activity in humans. Nat. Rev. Neurosci. 2006, 7:523-534.
23. Hsu C.W., Lin C.J. A comparison of methods for multiclass support vector achines. IEEE Trans. Neural Netw. 2002, 13:415-425.
24. James T.W., Kim S. Dorsal and ventral cortical pathways for visuo-haptic shape integration revealed using fMRI. Multisensory Object Perception in the Primate Brain 2010, Springer, New York. M.J. Naumer, J. Kaiser (Eds.).
25. James T.W., Humphrey G.K., Gati J.S., Servos P., Menon R.S., Goodale M.A. Haptic study of three-dimensional objects activates extrastriate visual areas. Neuropsychologia 2002, 40:1706-1714.
26. James T., Kim S., Fisher J. The neural basis of haptic object processing. Can. J. Exp. Psychol. 2007, 61:219-229.
27. James T.W., Kim S., Fisher J.S. The neural basis of haptic object processing. Can. J. Exp. Psychol. 2007, 61:219-229.
28. Jenkinson M., Smith S. A global optimisation method for robust affine registration of brain images. Med. Image Anal. 2001, 5:143-156.
29. Jenkinson M., Bannister P., Brady M., Smith S. Improved optimization for the robust and accurate linear registration and motion correction of brain images. Neuroimage 2002, 17:825-841.
30. Kamitani Y., Tong F. Decoding the visual and subjective contents of the human brain. Nat. Neurosci. 2005, 8:679-685.
31. Keysers C., Wicker B., Gazzola V., Anton J.-L., Fogassi L., Gallese V. A touching sight: SII/PV activation during the observation and experience of touch. Neuron 2004, 42:335-346.
32. Kim J.G., Biederman I., Lescroart M.D., Hayworth K.J. Adaptation to objects in the lateral occipital complex (LOC): shape or semantics?. Vision Res. 2009, 49:2297-2305.
33. Kosslyn S.M., Thompson W.L., Kim I.J., Alpert N.M. Topographical representations of mental images in primary visual cortex. Nature 1995, 378:496-498.
34. Kosslyn S.M., Pascual-Leone A., Felician O., Camposano S., Keenan J.P., Thompson W.L., Ganis G., Sukel K.E., Alpert N.M. The role of area 17 in visual imagery: convergent evidence from PET and rTMS. Science 1999, 284:167-170.
35. Kourtzi Z., Kanwisher N. Cortical regions involved in perceiving object shape. J. Neurosci. 2000, 20:3310-3318.
36. Kraemer D.J., Macrae C.N., Green A.E. Sound of silence activates auditory cortex. Nature 2005, 434:158.
37. Kriegeskorte N., Goebel R., Bandettini P. Information-based functional brain mapping. Proc. Natl. Acad. Sci. U. S. A. 2006, 103:3863-3868.
38. Kriegeskorte N., Cusack R., Bandettini P. How does an fMRI voxel sample the neuronal activity pattern: compact-kernel or complex spatiotemporal filter?. Neuroimage 2010, 49:1965-1976.
39. Lee S., Halder S., Kubler A., Birbaumer N., Sitaram R. Effective functional mapping of fMRI data with support-vector machines. Hum. Brain Mapp. 2010, 31:1502-1511.
40. Malach R., Reppas J.B., Benson R.R., Kwong K.K., Jiang H., Kennedy W.A., Ledden P.J., Brady T.J., Rosen B.R., Tootell R.B. Object-related activity revealed by functional magnetic resonance imaging in human occipital cortex. Proc. Natl. Acad. Sci. U. S. A. 1995, 92:8135-8139.
41. Meyer K., Damasio A. Convergence and divergence in a neural architecture for recognition and memory. Trends Neurosci. 2009, 32:376-382.
42. Meyer K., Kaplan J.T., Essex R., Webber C., Damasio H., Damasio A. Predicting visual stimuli on the basis of activity in auditory cortices. Nat. Neurosci. 2010, 1-2.
43. Meyer K., Kaplan J.T., Essex R., Damasio H., Damasio A. Seeing touch is correlated with content-specific activity in primary somatosensory cortex. Cereb. Cortex 2011, 21:2113-2121.
44. Mitchell T.M., Hutchinson R., Niculescu R.S., Pereira F., Wang X., Just M.A., Newman S. Learning to decode cognitive states from brain images. Mach. Learn. 2004, 57:145-175.
45. Mourao-Miranda J., Bokde A.L.W., Born C., Hampel H., Stetter M. Classifying brain states and determining the discriminating activation patterns: support vector machine on functional MRI data. Neuroimage 2005, 28:980-995.
46. Norman K.A., Polyn S.M., Detre G.J., Haxby J.V. Beyond mind-reading: multi-voxel pattern analysis of fMRI data. Trends Cogn. Sci. 2006, 10:424-430.
47. Oosterhof N.N., Wiggett A.J., Diedrichsen J., Tipper S.P., Downing P.E. Surface-based information mapping reveals crossmodal vision-action representations in human parietal and occipitotemporal cortex. J Neurophysiology 2010, 104:1077-1089.
48. Op de Beeck H. Against hyperacuity in brain reading: spatial smoothing does not hurt multivariate fMRI analyses?. Neuroimage 2010, 49:1943-1948.
49. O'Toole A.J., Jiang F., Abdi H., Pénard N., Dunlop J.P., Parent M.A. Theoretical, statistical, and practical perspectives on pattern-based classification approaches to the analysis of functional neuroimaging data. J. Cogn. Neurosci. 2007, 19:1735-1752.
50. Peltier S., Stilla R., Mariola E., LaConte S., Hu X., Sathian K. Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception. Neuropsychologia 2007, 45:476-483.
51. Pereira F., Botvinick M. Information mapping with pattern classifiers: a comparative study. Neuroimage 2011, 56:476-496.
52. Pereira F., Mitchell T., Botvinick M. Machine learning classifiers and fMRI: a tutorial overview. Neuroimage 2009, 45:S199-S209.
53. Poldrack R.A., Halchenko Y.O., Hanson S.J. Decoding the large-scale structure of brain function by classifying mental States across individuals. Psychol. Sci. 2009, 20:1364-1372.
54. Quadflieg S., Etzel J.A., Gazzola V., Keysers C., Schubert T.W., Waiter G.D., Macrae C.N. Puddles, parties, and professors: linking word categorization to neural patterns of visuospatial coding. J. Cogn. Neurosci. 2011, 23:2636-2649.
55. Reed C.L., Shoham S., Halgren E. Neural substrates of tactile object recognition: an fMRI study. Hum. Brain Mapp. 2004, 21:236-246.
56. Rizzolatti G., Craighero L. The mirror-neuron system. Annu. Rev. Neurosci. 2004, 27:169-192.
57. Rorden C., Karnath H.O., Bonilha L. Improving lesion-symptom mapping. J. Cogn. Neurosci. 2007, 19:1081-1088.
58. Schaefer M., Xu B., Flor H., Cohen L.G. Effects of different viewing perspectives on somatosensory activations during observation of touch. Hum. Brain Mapp. 2009, 30:2722-2730.
59. Shinkareva S.V., Mason R.A., Malave V.L., Wang W., Mitchell T.M., Just M.A. Using FMRI brain activation to identify cognitive states associated with perception of tools and dwellings. PLoS One 2008, 3:e1394.
60. Shinkareva S.V., Malave V.L., Mason R.A., Mitchell T.M., Just M.A. Commonality of neural representations of words and pictures. Neuroimage 2011, 54:2418-2425.
61. Stoeckel M.C., Weder B., Binkofski F., Choi H.-J., Amunts K., Pieperhoff P., Shah N.J., Seitz R.J. Left and right superior parietal lobule in tactile object discrimination. Eur. J. Neurosci. 2004, 19:1067-1072.
62. Tal N., Amedi A. Multisensory visual-tactile object related network in humans: insights gained using a novel crossmodal adaptation approach. Exp. Brain Res. 2009, 198:165-182.
63. Valenza N., Ptak R., Zimine I., Badan M., Lazeyras F., Schnider A. Dissociated active and passive tactile shape recognition: a case study of pure tactile apraxia. Brain 2001, 124:2287-2298.
64. Wandell B.A., Dumoulin S.O., Brewer A.A. Visual field maps in human cortex. Neuron 2007, 56:366-383.
65. Yoo S.-S., Lee C.U., Choi B.G. Human brain mapping of auditory imagery: event-related functional MRI study. Neuroreport 2001, 12:3045-3049.
66. Yoo S.-S., Freeman D.K., McCarthy J.J., Jolesz F.A. Neural substrates of tactile imagery: a functional MRI study. Neuroreport 2003, 14:581-585.