FMRI-based multivariate pattern analyses reveal imagery modality and imagery content specific representations in primary somatosensory, motor and auditory cortices

Cerebral Cortex

Volumn 27, Issue 8, 2017, Pages 3994-4009

  De Borst, Aline W ^a   De Gelder, Beatrice ^a,b  

^a MAASTRICHT UNIVERSITY   (Netherlands)

^b UNIVERSITY OF CAPE TOWN   (South Africa)

Author keywords

Auditory cortex; Decoding; Mental imagery; MVPA; Somatosensory cortex

Indexed keywords

ADULT; ARTICLE; BRAIN REGION; CLINICAL ARTICLE; ELECTROENCEPHALOGRAM; EMOTION; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HEARING; HUMAN; IMAGERY; INTRAPARIETAL SULCUS; MALE; NORMAL HUMAN; PERCEPTION; PRIMARY AUDITORY CORTEX; PRIMARY MOTOR CORTEX; PRIMARY SOMATOSENSORY CORTEX; PRIORITY JOURNAL; SOMATOSENSORY CORTEX; VISUAL AREA V3; BRAIN CORTEX; BRAIN MAPPING; DIAGNOSTIC IMAGING; IMAGINATION; MIDDLE AGED; MULTIVARIATE ANALYSIS; NEUROPSYCHOLOGICAL TEST; NUCLEAR MAGNETIC RESONANCE IMAGING; PERCEPTIVE DISCRIMINATION; PHYSIOLOGY; PROCEDURES; SUPPORT VECTOR MACHINE; TOUCH; YOUNG ADULT;

ADULT; AUDITORY PERCEPTION; BRAIN MAPPING; CEREBRAL CORTEX; DISCRIMINATION (PSYCHOLOGY); EMOTIONS; FEMALE; HUMANS; IMAGINATION; MAGNETIC RESONANCE IMAGING; MALE; MIDDLE AGED; MULTIVARIATE ANALYSIS; NEUROPSYCHOLOGICAL TESTS; SOCIAL PERCEPTION; SUPPORT VECTOR MACHINE; TOUCH PERCEPTION; YOUNG ADULT;

EID: 85026524339     PISSN: 10473211     EISSN: 14602199     Source Type: Journal    
DOI: 10.1093/cercor/bhw211     Document Type: Article

References (97)

1. Aboitiz F, Garcia VR. 1997. The evolutionary origin of the language areas in the human brain. A neuroanatomical perspective. Brain Res Brain Res Rev. 25:381-396.
2. Albers AM, Kok P, Toni I, Dijkerman HC, de Lange FP. 2013. Shared representations for working memory and mental imagery in early visual cortex. Curr Biol. 23:1427-1431.
3. Amedi A, Malach R, Pascual-Leone A. 2005. Negative BOLD differentiates visual imagery and perception. Neuron. 48:859-872.
4. Amunts K, Malikovic A, Mohlberg H, Schormann T, Zilles K. 2000. Brodmann's areas 17 and 18 brought into stereotaxic space-where and how variable? Neuroimage. 11:66-84.
5. Azulay H, Striem E, Amedi A. 2009. Negative BOLD in sensory cortices during verbal memory: a component in generating internal representations? Brain Topogr. 21:221-231.
6. Benjamini Y, Hochberg Y. 1995. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc. 57:289-300.
7. Berkes P, Orban G, Lengyel M, Fiser J. 2011. Spontaneous cortical activity reveals hallmarks of an optimal internal model of the environment. Science. 331:83-87.
8. Blanke O, Mohr C, Michel CM, Pascual-Leone A, Brugger P, Seeck M, Landis T, Thut G. 2005. Linking out-of-body experience and self processing to mental own-body imagery at the temporoparietal junction. J Neurosci. 25:550-557.
9. Bonte M, Hausfeld L, Scharke W, Valente G, Formisano E. 2014. Task-dependent decoding of speaker and vowel identity from auditory cortical response patterns. J Neurosci. 34:4548-4557.
10. Bunzeck N, Wuestenberg T, Lutz K, Heinze HJ, Jancke L. 2005. Scanning silence: mental imagery of complex sounds. Neuroimage. 26:1119-1127.
11. Cazzato V, Mian E, Serino A, Mele S, Urgesi C. 2015. Distinct contributions of extrastriate body area and temporoparietal junction in perceiving one's own and others' body. Cogn Affect Behav Neurosci. 15:211-228.
12. Cohen MS, Kosslyn SM, Breiter HC, DiGirolamo GJ, Thompson WL, Anderson AK, Brookheimer SY, Rosen BR, Belliveau JW. 1996. Changes in cortical activity during mental rotation. A mapping study using functional MRI. Brain. 119(Pt 1): 89-100.
13. Daselaar SM, Porat Y, Huijbers W, Pennartz CM. 2010. Modalityspecific and modality-independent components of the human imagery system. Neuroimage. 52:677-685.
14. de Borst AW, Sack AT, Jansma BM, Esposito F, de Martino F, Valente G, Roebroeck A, di Salle F, Goebel R, Formisano E. 2012. Integration of "what" and "where" in frontal cortex during visual imagery of scenes. Neuroimage. 60:47-58.
15. de Borst AW, Valente G, Jaaskelainen IP, Tikka P. 2016. Brainbased decoding of mentally imagined film clips and sounds reveals experience-based information patterns in film professionals. Neuroimage. 129:428-438.
16. de Gelder B. 2006. Towards the neurobiology of emotional body language. Nat Rev Neurosci. 7:242-249.
17. Dijkstra K, Brunner P, Gunduz A, Coon W, Ritaccio AL, Farquhar J, Schalk G. 2015. Identifying the attended speaker using Electrocorticographic (ECoG) signals. Brain Comput Interfaces (Abingdon). 2:161-173.
18. Eickhoff SB, Heim S, Zilles K, Amunts K. 2006. Testing anatomically specified hypotheses in functional imaging using cytoarchitectonic maps. Neuroimage. 32:570-582.
19. Eickhoff SB, Stephan KE, Mohlberg H, Grefkes C, Fink GR, Amunts K, Zilles K. 2005. A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data. Neuroimage. 25:1325-1335.
20. Evans S, Davis MH. 2015. Hierarchical organization of auditory and motor representations in speech perception: evidence from searchlight similarity analysis. Cereb Cortex. 25:4772-4788.
21. Ferri S, Kolster H, Jastorff J, Orban GA. 2013. The overlap of the EBA and the MT/V5 cluster. Neuroimage. 66:412-425.
22. Formisano E, De Martino F, Bonte M, Goebel R. 2008. "Who" is saying "what"? Brain-based decoding of human voice and speech. Science. 322:970-973.
23. Formisano E, Linden DE, Di Salle F, Trojano L, Esposito F, Sack AT, Grossi D, Zanella FE, Goebel R. 2002. Tracking the mind's image in the brain I: time-resolved fMRI during visuospatial mental imagery. Neuron. 35:185-194.
24. Friston K. 2012. Predictive coding, precision and synchrony. Cogn Neurosci. 3:238-239.
25. Ganesh S, van Schie HT, Cross ES, de Lange FP, Wigboldus DH. 2015. Disentangling neural processes of egocentric and allocentric mental spatial transformations using wholebody photos of self and other. Neuroimage. 116:30-39.
26. Ganis G, Thompson WL, Kosslyn SM. 2004. Brain areas underlying visual mental imagery and visual perception: an fMRI study. Brain Res Cogn Brain Res. 20:226-241.
27. Gerardin E, Sirigu A, Lehericy S, Poline JB, Gaymard B, Marsault C, Agid Y, Le Bihan D. 2000. Partially overlapping neural networks for real and imagined hand movements. Cereb Cortex. 10:1093-1104.
28. Geyer S, Ledberg A, Schleicher A, Kinomura S, Schormann T, Burgel U, Klingberg T, Larsson J, Zilles K, Roland PE. 1996. Two different areas within the primary motor cortex of man. Nature. 382:805-807.
29. Geyer S, Schormann T, Mohlberg H, Zilles K. 2000. Areas 3a, 3b, and 1 of human primary somatosensory cortex. Part 2. Spatial normalization to standard anatomical space. Neuroimage. 11:684-696.
30. Goebel R, Esposito F, Formisano E. 2006. Analysis of functional image analysis contest (FIAC) data with brainvoyager QX: from single-subject to cortically aligned group general linear model analysis and self-organizing group independent component analysis. Hum Brain Mapp. 27:392-401.
31. Good PI. 2005. Permutation, Parametric, and Bootstrap Tests of Hypotheses. New York: Springer-Verlag.
32. Grefkes C, Geyer S, Schormann T, Roland P, Zilles K. 2001. Human somatosensory area 2: observer-independent cytoarchitectonic mapping, interindividual variability, and population map. Neuroimage. 14:617-631.
33. Guillot A, Collet C, Nguyen VA, Malouin F, Richards C, Doyon J. 2008. Functional neuroanatomical networks associated with expertise in motor imagery. Neuroimage. 41:1471-1483.
34. Halpern AR, Zatorre RJ. 1999. When that tune runs through your head: a PET investigation of auditory imagery for familiar melodies. Cereb Cortex. 9:697-704.
35. Halpern AR, Zatorre RJ, Bouffard M, Johnson JA. 2004. Behavioral and neural correlates of perceived and imagined musical timbre. Neuropsychologia. 42:1281-1292.
36. Harrison SA, Tong F. 2009. Decoding reveals the contents of visual working memory in early visual areas. Nature. 458:632-635.
37. Hickok G, Poeppel D. 2000. Towards a functional neuroanatomy of speech perception. Trends Cogn Sci. 4:131-138.
38. Ionta S, Heydrich L, Lenggenhager B, Mouthon M, Fornari E, Chapuis D, Gassert R, Blanke O. 2011. Multisensory mechanisms in temporo-parietal cortex support self-location and first-person perspective. Neuron. 70:363-374.
39. Iredale JM, Rushby JA, McDonald S, Dimoska-Di Marco A, Swift J. 2013. Emotion in voice matters: neural correlates of emotional prosody perception. Int J Psychophysiol. 89:483-490.
40. Ishai A, Haxby JV, Ungerleider LG. 2002. Visual imagery of famous faces: effects of memory and attention revealed by fMRI. Neuroimage. 17:1729-1741.
41. Ishai A, Ungerleider LG, Haxby JV. 2000. Distributed neural systems for the generation of visual images. Neuron. 28:979-990.
42. Jackson PL, Brunet E, Meltzoff AN, Decety J. 2006. Empathy examined through the neural mechanisms involved in imagining how I feel versus how you feel pain. Neuropsychologia. 44:752-761.
43. Kaffenberger T, Baumgartner T, Koeneke S, Jancke L, Herwig U. 2008. Chronometric features of processing unpleasant stimuli: a functional MRI-based transcranial magnetic stimulation study. Neuroreport. 19:777-781.
44. Kareken DA, Unverzagt F, Caldemeyer K, Farlow MR, Hutchins GD. 1998. Functional brain imaging in apraxia. Arch Neurol. 55:107-113.
45. Kasess CH, Windischberger C, Cunnington R, Lanzenberger R, Pezawas L, Moser E. 2008. The suppressive influence of SMA on M1 in motor imagery revealed by fMRI and dynamic causal modeling. Neuroimage. 40:828-837.
46. Kleber B, Birbaumer N, Veit R, Trevorrow T, Lotze M. 2007. Overt and imagined singing of an Italian aria. Neuroimage. 36:889-900.
47. Klein I, Paradis AL, Poline JB, Kosslyn SM, Le Bihan D. 2000. Transient activity in the human calcarine cortex during visual-mental imagery: an event-related fMRI study. J Cogn Neurosci. 12(Suppl. 2):15-23.
48. Knauff M, Kassubek J, Mulack T, Greenlee MW. 2000. Cortical activation evoked by visual mental imagery as measured by fMRI. Neuroreport. 11:3957-3962.
49. Kosslyn SM, Alpert NM, Thompson WL, Maljkovic V, Weise SB, Chabris CF, Hamilton SE, Rauch SL, Buonanno FS. 1993. Visual Mental Imagery Activates Topographically Organized Visual Cortex: PET Investigations. J Cogn Neurosci. 5:263-287.
50. Kosslyn SM, Behrmann M, Jeannerod M. 1995. The cognitive neuroscience of mental imagery. Neuropsychologia. 33:1335-1344.
51. Kosslyn SM, Pascual-Leone A, Felician O, Camposano S, Keenan JP, Thompson WL, Ganis G, Sukel KE, Alpert NM. 1999. The role of area 17 in visual imagery: convergent evidence from PET and rTMS. Science. 284:167-170.
52. Kosslyn SM, Thompson WL. 2003. When is early visual cortex activated during visual mental imagery? Psychol Bull. 129:723-746.
53. Kriegeskorte N, Goebel R, Bandettini P. 2006. Information-based functional brain mapping. Proc Natl Acad Sci USA. 103:3863-3868.
54. Kuehn E, Mueller K, Turner R, Schutz-Bosbach S. 2014. The functional architecture of S1 during touch observation described with 7 T fMRI. Brain Struct Funct. 219:119-140.
55. Lewandowski KE, DePaola J, Camsari GB, Cohen BM, Ongür D. 2009. Tactile, olfactory, and gustatory hallucinations in psychotic disorders: a descriptive study. Ann Acad Med Singapore. 38:383-385.
56. Linden DE, Thornton K, Kuswanto CN, Johnston SJ, van de Ven V, Jackson MC. 2011. The brain's voices: comparing nonclinical auditory hallucinations and imagery. Cereb Cortex. 21:330-337.
57. Malikovic A, Amunts K, Schleicher A, Mohlberg H, Eickhoff SB, Wilms M, Palomero-Gallagher N, Armstrong E, Zilles K. 2007. Cytoarchitectonic analysis of the human extrastriate cortex in the region of V5/MT+: a probabilistic, stereotaxic map of area hOc5. Cereb Cortex. 17:562-574.
58. McCann IL, Pearlman LA. 1990. Psychological trauma and the adult survivor: Theory, therapy and transformation. New York (NY): Brunner-Routledge.
59. Mechelli A, Price CJ, Friston KJ, Ishai A. 2004. Where bottom-up meets top-down: neuronal interactions during perception and imagery. Cereb Cortex. 14:1256-1265.
60. Mellet E, Briscogne S, Tzourio-Mazoyer N, Ghaem O, Petit L, Zago L, Etard O, Berthoz A, Mazoyer B, Denis M. 2000. Neural correlates of topographic mental exploration: the impact of route versus survey perspective learning. Neuroimage. 12:588-600.
61. Mellet E, Tzourio-Mazoyer N, Bricogne S, Mazoyer B, Kosslyn SM, Denis M. 2000. Functional anatomy of high-resolution visual mental imagery. J Cogn Neurosci. 12:98-109.
62. Mellet E, Tzourio N, Crivello F, Joliot M, Denis M, Mazoyer B. 1996. Functional anatomy of spatial mental imagery generated from verbal instructions. J Neurosci. 16:6504-6512.
63. Morosan P, Rademacher J, Schleicher A, Amunts K, Schormann T, Zilles K. 2001. Human primary auditory cortex: cytoarchitectonic subdivisions and mapping into a spatial reference system. Neuroimage. 13:684-701.
64. Naselaris T, Olman CA, Stansbury DE, Ugurbil K, Gallant JL. 2015. A voxel-wise encoding model for early visual areas decodes mental images of remembered scenes. Neuroimage. 105:215-228.
65. O'Craven KM, Kanwisher N. 2000. Mental imagery of faces and places activates corresponding stiimulus-specific brain regions. J Cogn Neurosci. 12:1013-1023.
66. Oh J, Kwon JH, Yang PS, Jeong J. 2013. Auditory imagery modulates frequency-specific areas in the human auditory cortex. J Cogn Neurosci. 25:175-187.
67. Ozdemir E, Norton A, Schlaug G. 2006. Shared and distinct neural correlates of singing and speaking. Neuroimage. 33:628-635.
68. Peltier S, Stilla R, Mariola E, LaConte S, Hu X, Sathian K. 2007. Activity and effective connectivity of parietal and occipital cortical regions during haptic shape perception. Neuropsychologia. 45:476-483.
69. Pietrini P, Furey ML, Ricciardi E, Gobbini MI, Wu WH, Cohen L, Guazzelli M, Haxby JV. 2004. Beyond sensory images: objectbased representation in the human ventral pathway. Proc Natl Acad Sci USA. 101:5658-5663.
70. Pihko E, Nangini C, Jousmaki V, Hari R. 2010. Observing touch activates human primary somatosensory cortex. Eur J Neurosci. 31:1836-1843.
71. Pilgramm S, de Haas B, Helm F, Zentgraf K, Stark R, Munzert J, Kruger B. 2016. Motor imagery of hand actions: decoding the content of motor imagery from brain activity in frontal and parietal motor areas. Hum Brain Mapp. 37:81-93.
72. Rama P, Poremba A, Sala JB, Yee L, Malloy M, Mishkin M, Courtney SM. 2004. Dissociable functional cortical topographies for working memory maintenance of voice identity and location. Cereb Cortex. 14:768-780.
73. Rao RP, Ballard DH. 1999. Predictive coding in the visual cortex: a functional interpretation of some extra-classical receptive-field effects. Nat Neurosci. 2:79-87.
74. Reddy L, Tsuchiya N, Serre T. 2010. Reading the mind's eye: decoding category information during mental imagery. Neuroimage. 50:818-825.
75. Reed CL, Caselli RJ. 1994. The nature of tactile agnosia: a case study. Neuropsychologia. 32:527-539.
76. Roth M, Decety J, Raybaudi M, Massarelli R, Delon-Martin C, Segebarth C, Morand S, Gemignani A, Decorps M, Jeannerod M. 1996. Possible involvement of primary motor cortex in mentally simulated movement: a functional magnetic resonance imaging study. Neuroreport. 7:1280-1284.
77. Sanchez-Panchuelo RM, Besle J, Beckett A, Bowtell R, Schluppeck D, Francis S. 2012. Within-digit functional parcellation of Brodmann areas of the human primary somatosensory cortex using functional magnetic resonance imaging at 7 tesla. J Neurosci. 32:15815-15822.
78. Sathian K, Zangaladze A, Hoffman JM, Grafton ST. 1997. Feeling with the mind's eye. Neuroreport. 8:3877-3881.
79. Savini N, Brunetti M, Babiloni C, Ferretti A. 2012. Working memory of somatosensory stimuli: an fMRI study. Int J Psychophysiol. 86:220-228.
80. Saxe R, Kanwisher N. 2003. People thinking about thinking people. The role of the temporo-parietal junction in "theory of mind". Neuroimage. 19:1835-1842.
81. Schmidt TT, Ostwald D, Blankenburg F. 2014. Imaging tactile imagery: changes in brain connectivity support perceptual grounding of mental images in primary sensory cortices. Neuroimage. 98:216-224.
82. Sharma N, Baron JC. 2013. Does motor imagery share neural networks with executed movement: a multivariate fMRI analysis. Front Hum Neurosci. 7:564.
83. Sharma N, Jones PS, Carpenter TA, Baron JC. 2008. Mapping the involvement of BA 4a and 4p during Motor Imagery. Neuroimage. 41:92-99.
84. Sinke CB, Sorger B, Goebel R, de Gelder B. 2010. Tease or threat? Judging social interactions from bodily expressions. Neuroimage. 49:1717-1727.
85. Stokes M, Saraiva A, Rohenkohl G, Nobre AC. 2011. Imagery for shapes activates position-invariant representations in human visual cortex. Neuroimage. 56:1540-1545.
86. Tagaris GA, Kim SG, Strupp JP, Andersen P, Ugurbil K, Georgopoulos AP. 1996. Quantitative relations between parietal activation and performance in mental rotation. Neuroreport. 7:773-776.
87. Talairach J, Tournoux P. 1988. Co-Planar Stereotaxic Atlas of the Human Brain: 3-D Proportional System: An Approach to Cerebral Imaging. New York: Thieme.
88. Trojano L, Grossi D, Linden DE, Formisano E, Hacker H, Zanella FE, Goebel R, Di Salle F. 2000. Matching two imagined clocks: the functional anatomy of spatial analysis in the absence of visual stimulation. Cereb Cortex. 10:473-481.
89. Ungerleider LG, Haxby JV. 1994. "What" and "where" in the human brain. Curr Opin Neurobiol. 4:157-165.
90. Vetter P, Smith FW, Muckli L. 2014. Decoding sound and imagery content in early visual cortex. Curr Biol. 24:1256-1262.
91. Weeks RA, Aziz-Sultan A, Bushara KO, Tian B, Wessinger CM, Dang N, Rauschecker JP, Hallett M. 1999. A PET study of human auditory spatial processing. Neurosci Lett. 262:155-158.
92. Wildgruber D, Pihan H, Ackermann H, Erb M, Grodd W. 2002. Dynamic brain activation during processing of emotional intonation: influence of acoustic parameters, emotional valence, and sex. Neuroimage. 15:856-869.
93. Wilms M, Eickhoff SB, Specht K, Amunts K, Shah NJ, Malikovic A, Fink GR. 2005. Human V5/MT+: comparison of functional and cytoarchitectonic data. Anat Embryol (Berl). 210:485-495.
94. Xing Y, Ledgeway T, McGraw PV, Schluppeck D. 2013. Decoding working memory of stimulus contrast in early visual cortex. J Neurosci. 33:10301-10311.
95. Yoo SS, Freeman DK, McCarthy JJ 3rd, Jolesz FA. 2003. Neural substrates of tactile imagery: a functional MRI study. Neuroreport. 14:581-585.
96. Yoo SS, Lee CU, Choi BG. 2001. Human brain mapping of auditory imagery: event-related functional MRI study. Neuroreport. 12:3045-3049.
97. Zvyagintsev M, Clemens B, Chechko N, Mathiak KA, Sack AT, Mathiak K. 2013. Brain networks underlyingmental imagery of auditory and visual information. Eur J Neurosci. 37:1421-1434.