A meta-analytic review of multisensory imagery identifies the neural correlates of modality-specific and modality-general imagery

Frontiers in Human Neuroscience

Volumn , Issue SEPTEMBER, 2012, Pages

  McNorgan, Chris ^a  

^a NORTHWESTERN UNIVERSITY   (United States)

Author keywords

Embodied Cognition; Imagery; Imagination; Modality independent; Modality specific; Semantic memory

Indexed keywords

ARTICLE; AUDITORY DISCRIMINATION; BRAIN REGION; COLOR DISCRIMINATION; EXECUTIVE FUNCTION; HUMAN; IMAGE PROCESSING; IMAGERY; MENTAL TASK; NERVE CELL NETWORK; NERVE CONDUCTION; NEUROIMAGING; PERCEPTIVE DISCRIMINATION; RETINA IMAGE; SOMATOSENSORY STIMULATION; SYSTEMATIC REVIEW; TACTILE DISCRIMINATION; TASK PERFORMANCE; TASTE DISCRIMINATION; THEORY OF MIND; VISUAL DISCRIMINATION; VISUOMOTOR COORDINATION;

EID: 84933676908     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2012.00285     Document Type: Article

References (90)

1. Alivisatos, B., and Petrides, M. (1997). Functional activation of the human brain during mental rotation. Neuropsychologia 35, 111-118.
2. Arnott, S.R., Grady, C.L., Hevenor, S.J., Graham, S., and Alain, C. (2005). The Functional Organization of Auditory Working Memory as Revealed by fMRI. Journal of Cognitive Neuroscience 17, 819-831.
3. Barnes, J., Howard, R.J., Senior, C., Brammer, M., Bullmore, E.T., Simmons, A., Woodruff, P., and David, A.S. (2000). Cortical activity during rotational and linear transformations. Neuropsychologia 38, 1148-1156.
4. Barsalou, L.W. (1999). Perceptual symbol systems. Behavioral and Brain Sciences 22, 577-660.
5. Beauchamp, M.S., Haxby, J.V., Jennings, J.E., and Deyoe, E.A. (1999). An fMRI Version of the Farnsworth-Munsell 100-Hue Test Reveals Multiple Color-selective Areas in Human Ventral Occipitotemporal Cortex. Cerebral Cortex 9, 257-263.
6. Belardinelli, M.O., Palmiero, M., Sestieri, C., Nardo, D., Di Matteo, R., Londei, A., D'ausilio, A., Ferretti, A., Del Gratta, C., and Romani, G.L. (2009). An fMRI investigation on image generation in different sensory modalities: The influence of vividness. Acta Psychologica 132, 190-200.
7. Binder, J.R., and Desai, R.H. (2011). The neurobiology of semantic memory. Trends in Cognitive Sciences 15, 527-536.
8. Binder, J.R., Desai, R.H., Graves, W.W., and Conant, L.L. (2009). Where Is the Semantic System? A Critical Review and Meta-Analysis of 120 Functional Neuroimaging Studies. Cerebral Cortex 19, 2767-2796.
9. Bottini, G., Corcoran, R., Sterzi, R., Paulesu, E., Schenone, P., Scarpa, P., Frackowiak, R.S.J., and Frith, D. (1994). The role of the right hemisphere in the interpretation of figurative aspects of language A positron emission tomography activation study. Brain 117, 1241-1253.
10. Bramão, I., Faísca, L., Forkstam, C., Reis, A., and Petersson, K.M. (2010). Cortical Brain Regions Associated with Color Processing: An FMRi Study. The Open Neuroimaging Journal 4, 164-173.
11. Buchsbaum, B.R., and D'esposito, M. (2008). The Search for the Phonological Store: From Loop to Convolution. Journal of Cognitive Neuroscience 20, 762-778.
12. Bunzeck, N., Wuestenberg, T., Lutz, K., Heinze, H.-J., and Jancke, L. (2005). Scanning silence: Mental imagery of complex sounds. NeuroImage 26, 1119-1127.
13. Canessa, N., Borgo, F., Cappa, S.F., Perani, D., Falini, A., Buccino, G., Tettamanti, M., and Shallice, T. (2007). The Different Neural Correlates of Action and Functional Knowledge in Semantic Memory: An fMRI Study. Cerebral Cortex 18, 740-751.
14. Chein, J.M., Fissell, K., Jacobs, S., and Fiez, J.A. (2002). Functional heterogeneity within Broca's area during verbal working memory. Physiology & Behavior 77, 635-639.
15. Chouinard, P.A., and Goodale, M.A. (2010). Category-specific neural processing for naming pictures of animals and naming pictures of tools: An ALE meta-analysis. Neuropsychologia 48, 409-418.
16. Craik, F.I.M., and Lockhart, R.S. (1972). Levels of processing: A framework for memory research. Journal of Verbal Learning and Verbal Behavior 11, 671-684.
17. Creem-Regehr, S.H., Neil, J.A., and Yeh, H.J. (2007). Neural correlates of two imagined egocentric transformations. Neuroimage 35, 916-927.
18. D'esposito, M., Detre, J.A., Aguirre, G.K., Stallcup, M., Alsop, D.C., Tippet, L.J., and Farah, M.J. (1997). A functional MRI study of mental image generation. Neuropsychologia 35, 725-730.
19. Daselaar, S.M., Porat, Y., Huijbers, W., and Pennartz, C.M.A. (2010). Modality-specific and modality-independent components of the human imagery system. Neuroimage 52, 677-685.
20. De Lange, F.P., Hagoort, P., and Toni, I. (2005). Neural Topography and Content of Movement Representations. Journal of Cognitive Neuroscience 17, 97-112.
21. Dechent, P. (2004). Is the human primary motor cortex involved in motor imagery? Cognitive Brain Research 19, 138-144.
22. Djordjevic, J., Zatorre, R.J., Petrides, M., Boyle, J.A., and Jones-Gotman, M. (2005). Functional neuroimaging of odor imagery. NeuroImage 24, 791-801.
23. Eickhoff, S.B., Bzdok, D., Laird, A.R., Kurth, F., and Fox, P.T. (2012). Activation likelihood estimation meta-analysis revisited. Neuroimage 59, 2349-2361.
24. Farnsworth, D. (1957). The Farnsworth-Munsell 100-Hue test for the examination of color vision. Baltimore, MD: Munsell Color Company.
25. Friston, K.J., Price, C.J., Fletcher, P., Moore, C., Frackowiak, R.S.J., and Dolan, R.J. (1996). The Trouble with Cognitive Subtraction. Neuroimage 4, 97-104.
26. Ganis, G. (2004). Brain areas underlying visual mental imagery and visual perception: an fMRI study. Cognitive Brain Research 20, 226-241.
27. Goebel, R., Khorram-Sefat, D., Muckli, L., Hacker, H., and Singer, W. (1998). The constructive nature of vision: direct evidence from functional magnetic resonance imaging studies of apparent motion and motion imagery. European Journal of Neuroscience 10, 1563-1573.
28. Gottfried, J.A., and Dolan, R.J. (2004). Human orbitofrontal cortex mediates extinction learning while accessing conditioned representations of value. Nature Neuroscience 7, 1144-1152.
29. Grèzes, J. (2001). Does Perception of Biological Motion Rely on Specific Brain Regions? NeuroImage 13, 775-785.
30. Guillot, A., Collet, C., Nguyen, V.A., Malouin, F., Richards, C., and Doyon, J. (2009). Brain activity during visual versus kinesthetic imagery: An fMRI study. Human Brain Mapping 30, 2157-2172.
31. Gulyás, B. (2001). Neural networks for internal reading and visual imagery of reading: a PET study. Brain Research Bulletin 54, 319-328.
32. Halpern, A.R., and Zatorre, R.J. (1999). When that tune runs through your head: A PET investigation of auditory imagery for familiar melodies. Cerebral Cortex 9, 697-704.
33. Hanakawa, T. (2002). Functional Properties of Brain Areas Associated With Motor Execution and Imagery. Journal of Neurophysiology 89, 989-1002.
34. Harnad, S. (1990). The symbol grounding problem. Physica D: Nonlinear Phenomena 42, 335-346.
35. Hauk, O., Johnsrude, I., and Pulvermüller, F. (2004). Somatotopic Representation of Action Words in Human Motor and Premotor Cortex. Neuron 41, 301-307.
36. Hsu, N.S., Frankland, S.M., and Thompson-Schill, S.L. (2012). Chromaticity of color perception and object color knowledge. Neuropsychologia 50, 327-333.
37. Hsu, N.S., Kraemer, D.J.M., Oliver, R.T., Schlichting, M.L., and Thompson-Schill, S.L. (2011). Color, Context, and Cognitive Style: Variations in Color Knowledge Retrieval as a Function of Task and Subject Variables. Journal of Cognitive Neuroscience 23, 2544-2557.
38. Ishai, A., Ungerleider, L.G., and Haxby, J.V. (2000). Distributed Neural Systems for the Generation of Visual Images. Neuron 28, 979-990.
39. Johnson, S. (2002). Selective Activation of a Parietofrontal Circuit during Implicitly Imagined Prehension. NeuroImage 17, 1693-1704.
40. Jordan, K., Heinze, H.J., Lutz, K., Kanowski, M., and Jancke, L. (2001). Cortical activations during the mental rotation of different visual objects. Neuroimage 13, 143-152.
41. Kaas, A., Weigelt, S., Roebroeck, A., Kohler, A., and Muckli, L. (2010). Imagery of a moving object: The role of occipital cortex and human MT/V5+. NeuroImage 49, 794-804.
42. Kellenbach, M.L., Brett, M., and Patterson, K. (2001). Large, colorful, or noisy? Attribute-and modality-specific activations during retrieval of perceptual attribute knowledge. Cognitive, Affective, & Behavioral Neuroscience 1, 207-221.
43. Kiefer, M., Sim, E.J., Herrnberger, B., Grothe, J., and Hoenig, K. (2008). The Sound of Concepts: Four Markers for a Link between Auditory and Conceptual Brain Systems. Journal of Neuroscience 28, 12224-12230.
44. Kikuchi, S., Kubota, F., Nisijima, K., Washiya, S., and Kato, S. (2005). Cerebral activation focusing on strong tasting food: a functional magnetic resonance imaging study. NeuroReport 18, 281-283.
45. Kobayashi, M., Takeda, M., Hattori, N., Fukunaga, M., Sasabe, T., Inoue, N., Nagai, Y., Sawada, T., Sadato, N., and Watanabe, Y. (2004). Functional imaging of gustatory perception and imagery: top-down processing of gustatory signals. NeuroImage 23, 1271-1282.
46. Kosslyn, S.M., Alpert, N.M., Thompson, W.L., Maljkovic, V., Weise, S.B., Chabris, C.F., Hamilton, S.E., Rauch, S.L., and Buonanno, F.S. (1993). Visual Mental Imagery Activates Topographically Organized Visual Cortex: PET Investigations. Journal of Cognitive Neuroscience 5, 263-287.
47. Kosslyn, S.M., Ganis, G., and Thompson, W.L. (2001). Neural Foundations of Imagery. Nature Reviews Neuroscience 2, 635-642.
48. Kosslyn, S.M., and Thompson, W.L. (2003). When is early visual cortex activated during visual mental imagery? Psychological Bulletin 129, 723-746.
49. Kosslyn, S.M., Thompson, W.L., and Alpert, N.M. (1997). Neural Systems Shared by Visual Imagery and Visual Perception: A Positron Emission Tomography Study. Neuroimage 6, 320-334.
50. Kosslyn, S.M., Thompson, W.L., Klm, I.J., and Alpert, N.M. (1995). Topographical representations of mental images in primary visual cortex. Nature 378, 496-498.
51. Laird, A.R., Fox, P.M., Price, C.J., Glahn, D.C., Uecker, A.M., Lancaster, J.L., Turkeltaub, P.E., Kochunov, P., and Fox, P.T. (2005). ALE meta-analysis: controlling the false discovery rate and performing statistical contrasts. Human Brain Mapping 25, 155-164.
52. Mcnorgan, C., Reid, J., and Mcrae, K. (2011). Integrating conceptual knowledge within and across representational modalities. Cognition 118, 211-233.
53. Mellet, E., Tzourio, N., Crivello, F., Joliot, M., Denis, M., and Mazoyer, B. (1996). Functional anatomy of spatial mental imagery generated from verbal instructions. Journal of Neuroscience 16, 6504-6512.
54. Newman, S.D., Klatzky, R.L., Lederman, S.J., and Just, M.A. (2005). Imagining material versus geometric properties of objects: an fMRI study. Cognitive Brain Research 23, 235-246.
55. Nyberg, L. (2001). Reactivation of Motor Brain Areas during Explicit Memory for Actions. NeuroImage 14, 521-528.
56. Nyberg, L., Habib, R., Mcintosh, A.R., and Tulving, E. (2000). Reactivation of encoding-related brain activity during memory retrieval. Proc Natl Acad Sci U S A 97, 11120-11124.
57. Ohbayashi, M., Ohki, K., and Miyashita, Y. (2003). Conversion of working memory to motor sequence in the monkey premotor cortex. Science 301, 233-236.
58. Oliver, R.T., Geiger, E.J., Lewandowski, B.C., and Thompson-Schill, S.L. (2009). Remembrance of things touched: how sensorimotor experience affects the neural instantiation of object form. Neuropsychologia 47, 239-247.
59. Paivio, A. (1971). Imagery and verbal processes. New York: Holt, Rinehart and Winston.
60. Plailly, J., Delon-Martin, C., and Royet, J.-P. (2012). Experience induces functional reorganization in brain regions involved in odor imagery in perfumers. Human Brain Mapping 33, 224-234.
61. Poldrack, R.A. (2006). Can cognitive processes be inferred from neuroimaging data? Trends Cogn Sci 10, 59-63.
62. Pylyshyn, Z.W. (1973). What the mind's eye tells the mind's brain: A critique of mental imagery. Psychological Bulletin;PsychologicalBulletin 80, 1-24.
63. Roland, P.E., and Gulyás, B. (1995). Visual Memory, Visual Imagery, and Visual Recognition of Large Field Patterns by the Human Brain: Functional Anatomy by Positron Emission Tomography. Cerebral Cortex 5, 79-93.
64. Ruby, P., and Decety, J. (2001). Effect of subjective perspective taking during simulation of action: a PET investigation of agency. Nature Neuroscience 4, 546-550.
65. Sack, A.T., Sperling, J.M., Prvulovic, D., Formisano, E., Goebel, R., Di Salle, F., Dierks, T., and Linden, D.E.J. (2002). Tracking the Mind's Image in the Brain II: Transcranial Magnetic Stimulation Reveals Parietal Asymmetry in Visuospatial Imagery. Neuron 35, 195-204.
66. Sathian, K. (2005). Visual cortical activity during tactile perception in the sighted and the visually deprived. Developmental Psychobiology 46, 279-286.
67. Servos, P., Osu, R., Santi, A., and Kawato, M. (2002). The Neural Substrates of Biological Motion Perception: an fMRI Study. Cerebral Cortex 12, 772-782.
68. Simmons, W.K., and Barsalou, L.W. (2003). The Similarity-in-Topography Principle: Reconciling Theories of Conceptual Deficits. Cognitive Neuropsychology 20, 451-486.
69. Simmons, W.K., Ramjee, V., Beauchamp, M.S., Mcrae, K., Martin, A., and Barsalou, L.W. (2007). A common neural substrate for perceiving and knowing about color. Neuropsychologia 45, 2802-2810.
70. Slotnick, S.D., Thompson, W.L., and Kosslyn, S.M. (2005). Visual mental imagery induces retinotopically organized activation of early visual areas. Cerebral Cortex 15, 1570-1583.
71. Slotnick, S.D., Thompson, W.L., and Kosslyn, S.M. (2011). Visual memory and visual mental imagery recruit common control and sensory regions of the brain. Cognitive Neuroscience 3, 14-20.
72. Small, D.M., Gregory, M.D., Mak, Y.E., Gitelman, D., Mesulam, M.M., and Parrish, T. (2003). Dissociation of Neural Representation of Intensity and Affective Valuation in Human Gustation. Neuron 39, 701-711.
73. Thompson-Schill, S.L. (2003). Neuroimaging studies of semantic memory: inferring "how" from "where". Neuropsychologia 41, 280-292.
74. Thompson, W.L., Kosslyn, S.M., Sukel, K.E., and Alpert, N.M. (2001). Mental imagery of high-and low-resolution gratings activates area 17. Neuroimage 14, 454-464.
75. Trojano, L., Grossi, D., Linden, D.E., Formisano, E., Hacker, H., Zanella, F.E., Goebel, R., and Di Salle, F. (2000). Matching two imagined clocks: the functional anatomy of spatial analysis in the absence of visual stimulation. Cerebral Cortex 10, 473-481.
76. Turkeltaub, P.E., Eden, G.F., Jones, K.M., and Zeffiro, T.A. (2002). Meta-Analysis of the Functional Neuroanatomy of Single-Word Reading: Method and Validation. Neuroimage 16, 765-780.
77. Tyler, L.K., and Moss, H.E. (2001). Towards a distributed account of conceptual knowledge. Trends in Cognitive Sciences 5, 244-252.
78. Veldhuizen, M.G., Bender, G., Constable, R.T., and Small, D.M. (2007). Trying to Detect Taste in a Tasteless Solution: Modulation of Early Gustatory Cortex by Attention to Taste. Chemical Senses 32, 569-581.
79. Vingerhoets, G., Delange, F., Vandemaele, P., Deblaere, K., and Achten, E. (2002). Motor Imagery in Mental Rotation: An fMRI Study. NeuroImage 17, 1623-1633.
80. Wager, T.D., Lindquist, M., and Kaplan, L. (2007). Meta-analysis of functional neuroimaging data: current and future directions. Social Cognitive and Affective Neuroscience 2, 150-158.
81. Warrington, E.K., and Mccarthy, R.A. (1987). Categories of knowledge. Further fractionations and an attempted integration. Brain 110 (Pt 5), 1273-1296.
82. Wheeler, M.E., Petersen, S.E., and Buckner, R.L. (2000). Memory's echo: vivid remembering reactivates sensory-specific cortex. Proc Natl Acad Sci U S A 97, 11125-11129.
83. Wolpert, D.M., Goodbody, S.J., and Husain, M. (1998). Maintaining internal representations: the role of the human superior parietal lobe. Nature Neuroscience 1, 529-533.
84. Yágüez, L., Nagel, D., Hoffman, H., Canavan, A.G.M., Wist, E., and Hömberg, V. (1998). A mental route to motor learning: Improving trajectorial kinematics through imagery training. Behavioural Brain Research 90, 95-106.
85. Yarkoni, T., Poldrack, R.A., Nichols, T.E., Van Essen, D.C., and Wager, T.D. (2011). Large-scale automated synthesis of human functional neuroimaging data. NatMeth 8, 665-670.
86. Yeshurun, Y., Lapid, H., Dudai, Y., and Sobel, N. (2009). The Privileged Brain Representation of First Olfactory Associations. Current biology: CB 19, 1869-1874.
87. Yomogida, Y. (2004). Mental Visual Synthesis is Originated in the Fronto-temporal Network of the Left Hemisphere. Cerebral Cortex 14, 1376-1383.
88. Yoo, S.-S., Freeman, D.K., Mccarthy, J.J.I., and Jolesz, F.A. (2003). Neural substrates of tactile imagery: a functional MRI study. Neuroreport 14, 581-585.
89. Yoo, S.-S., Kee, C.U., and Choi, B.G. (2001). Human Brain Mapping of Auditory Imagery: Event-Related Functional MRI Study. NeuroReport 12, 3045-3049.
90. Zatorre, R.J., and Halpern, A.R. (1996). Hearing in the Mind's Ear: A PET Investigation of Musical Imagery and Perception. Journal of Cognitive Neuroscience 8, 29-46.