Imagery or meaning? Evidence for a semantic origin of category-specific brain activity in metabolic imaging

European Journal of Neuroscience

Volumn 27, Issue 7, 2008, Pages 1856-1866

  Hauk, Olaf ^a   Davis, Matthew H ^a   Kherif, Ferath ^b   Pulvermüller, Friedemann ^a  

^a MEDICAL RESEARCH COUNCIL   (United Kingdom)

^b UNIVERSITY COLLEGE LONDON   (United Kingdom)

Author keywords

Action relatedness; Cell assemblies; Imageability; Multiple regression; Visual word recognition; Word frequency

Indexed keywords

ADULT; ARTICLE; BRAIN REGION; CONTROLLED STUDY; ELECTROENCEPHALOGRAM; FEMALE; FUNCTIONAL MAGNETIC RESONANCE IMAGING; HUMAN; HUMAN EXPERIMENT; IMAGERY; LANGUAGE PROCESSING; MALE; METABOLISM; NERVE POTENTIAL; NEUROIMAGING; NORMAL HUMAN; PRIORITY JOURNAL; SEMANTICS; WORD RECOGNITION;

ADULT; BRAIN; FEMALE; HUMANS; IMAGINATION; MAGNETIC RESONANCE SPECTROSCOPY; MALE; MENTAL PROCESSES; PHOTIC STIMULATION; READING; SEMANTICS; WORD ASSOCIATION TESTS;

EID: 41549156912     PISSN: 0953816X     EISSN: 14609568     Source Type: Journal    
DOI: 10.1111/j.1460-9568.2008.06143.x     Document Type: Article

References (104)

1. Allen, P.A., Smith, A.F., Lien, M.C., Grabbe, J. Murphy, M.D. (2005) Evidence for an activation locus of the word-frequency effect in lexical decision. J. Exp. Psychol.-Hum. Percept. Perform., 31, 713 721.
2. Assadollahi, R. Pulvermüller, F. (2003) Early influences of word length and frequency: a group study using MEG. Neuroreport, 14, 1183 1187.
3. Aziz-Zadeh, L., Iacoboni, M., Zaidel, E., Wilson, S. Mazziotta, J. (2004) Left hemisphere motor facilitation in response to manual action sounds. Eur. J. Neurosci., 19, 2609 2612.
4. Aziz-Zadeh, L., Koski, L., Zaidel, E., Mazziotta, J. Iacoboni, M. (2006) Lateralization of the human mirror neuron system. J. Neurosci., 26, 2964 2970.
5. Aziz-Zadeh, L., Wilson, S.M., Rizzolatti, G. Iacoboni, M. (2006) Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Curr. Biol., 16, 1818 1823.
6. Baayen, R.H., Piepenbrock, R. van Rijn, H. (1993) The CELEX Lexical Database (CD-ROM). Linguistic Data Consortium, University of Pennsylvania, Philadelphia, PA.
7. Balota, D.A. Chumbley, J.I. (1984) Are lexical decisions a good measure of lexical access? The role of word frequency in the neglected decision stage. J. Exp. Psychol.: Hum. Percept. Perform., 10, 340 357.
8. Barber, H.A. Kutas, M. (2007) Interplay between computational models and cognitive electrophysiology in visual word recognition. Brain Res. Brain Res. Rev., 53, 98 123.
9. Barsalou, L.W. (1999) Perceptual symbol systems. Behav. Brain Sci., 22, 577 609 Discussion 610 560.
10. Barsalou, L.W., Kyle Simmons, W., Barbey, A.K. Wilson, C.D. (2003) Grounding conceptual knowledge in modality-specific systems. Trends Cogn. Sci., 7, 84 91.
11. Binder, J.R., Westbury, C.F., McKiernan, K.A., Possing, E.T. Medler, D.A. (2005) Distinct brain systems for processing concrete and abstract concepts. J. Cogn. Neurosci., 17, 905 917.
12. Boulenger, V., Roy, A.C., Paulignan, Y., Deprez, V., Jeannerod, M. Nazir, T.A. (2006) Cross-talk between language processes and overt motor behavior in the first 200 msec of processing. J. Cogn. Neurosci., 18, 1607 1615.
13. Brett, M., Anton, J.L., Valabregue, R. Poline, J.B. (2002) Region of interest analysis using an SPM toolbox. Paper presented at the 8th International Conference on Functional Mapping of the Human Brain, Sendai, Japan.
14. Buccino, G., Binkofski, F., Fink, G.R., Fadiga, L., Fogassi, L., Gallese, V., Seitz, R.J., Zilles, K., Rizzolatti, G. Freund, H.J. (2001) Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur. J. Neurosci., 13, 400 404.
15. Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V. Rizzolatti, G. (2005) Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. Brain Res. Cogn. Brain Res., 24, 355 363.
16. Buchel, C., Holmes, A.P., Rees, G. Friston, K.J. (1998) Characterizing stimulus-response functions using nonlinear regressors in parametric fMRI experiments. Neuroimage, 8, 140 148.
17. Caramazza, A. Mahon, B.Z. (2003) The organization of conceptual knowledge: the evidence from category-specific semantic deficits. Trends Cogn. Sci., 7, 354 361.
18. Carreiras, M., Mechelli, A. Price, C.J. (2006) Effect of word and syllable frequency on activation during lexical decision and reading aloud. Hum. Brain Mapp., 27, 963 972.
19. Chao, L.L., Haxby, J.V. Martin, A. (1999) Attribute-based neural substrates in temporal cortex for perceiving and knowing about objects. Nat. Neurosci., 2, 913 919.
20. Chee, M.W., Lee, H.L., Soon, C.S., Westphal, C. Venkatraman, V. (2003) Reproducibility of the word frequency effect: comparison of signal change and voxel counting. Neuroimage, 18, 468 482.
21. Cleland, A.A., Gaskell, M.G., Quinlan, P.T. Tamminen, J. (2006) Frequency effects in spoken and visual word recognition: evidence from dual-task methodologies. J. Exp. Psychol. Hum. Percept. Perform., 32, 104 119.
22. Cusack, R., Brett, M. Osswald, K. (2003) An evaluation of the use of magnetic field maps to undistort echo-planar images. Neuroimage, 18, 127 142.
23. Dale, A.M., Liu, A.K., Fischl, B.R., Buckner, R.L., Belliveau, J.W., Lewine, J.D. Halgren, E. (2000) Dynamic statistical parametric mapping: combining fMRI and MEG for high-resolution imaging of cortical activity. Neuron, 26, 55 67.
24. Dambacher, M., Kliegl, R., Hofmann, M. Jacobs, A.M. (2006) Frequency and predictability effects on event-related potentials during reading. Brain Res., 1084, 89 103.
25. Davis, M.H., Meunier, F. Marslen-Wilson, W.D. (2004) Neural responses to morphological, syntactic, and semantic properties of single words: an fMRI study. Brain Lang., 89, 439 449.
26. Dehaene, S. (1995) Electrophysiological evidence for category-specific word processing in the normal human brain. Neuroreport, 6, 2153 2157.
27. Devlin, J.T., Moore, C.J., Mummery, C.J., Gorno-Tempini, M.L., Phillips, J.A., Noppeney, U., Frackowiak, R.S., Friston, K.J. Price, C.J. (2002) Anatomic constraints on cognitive theories of category specificity. Neuroimage, 15, 675 685.
28. Fadiga, L., Fogassi, L., Pavesi, G. Rizzolatti, G. (1995) Motor facilitation during action observation: a magnetic stimulation study. J. Neurophysiol., 73, 2608 2611.
29. Fiebach, C.J. Friederici, A.D. (2004) Processing concrete words: fMRI evidence against a specific right-hemisphere involvement. Neuropsychologia, 42, 62 70.
30. Fiebach, C.J., Friederici, A.D., Muller, K. von Cramon, D.Y. (2002) fMRI evidence for dual routes to the mental lexicon in visual word recognition. J. Cogn. Neurosci., 14, 11 23.
31. Floel, A., Ellger, T., Breitenstein, C. Knecht, S. (2003) Language perception activates the hand motor cortex: implications for motor theories of speech perception. Eur. J. Neurosci., 18, 704 708.
32. Friston, K.J., Fletcher, P., Josephs, O., Holmes, A., Rugg, M.D. Turner, R. (1998) Event-related fMRI: characterizing differential responses. Neuroimage, 7, 30 40.
33. Gernsbacher, M.A. (1984) Resolving 20 years of inconsistent interactions between lexical familiarity and orthography, concreteness, and polysemy. J. Exp. Psychol. - Gen., 113, 256 281.
34. Glenberg, A.M. Kaschak, M.P. (2002) Grounding language in action. Psychon. Bull. Rev., 9, 558 565.
35. Gold, B.T., Balota, D.A., Jones, S.J., Powell, D.K., Smith, C.D. Andersen, A.H. (2006) Dissociation of automatic and strategic lexical-semantics: functional magnetic resonance imaging evidence for differing roles of multiple frontotemporal regions. J. Neurosci., 26, 6523 6532.
36. Grainger, J. Jacobs, A.M. (1996) Orthographic processing in visual word recognition: a multiple read-out model. Psychol. Rev., 103, 518 565.
37. Grezes, J., Armony, J.L., Rowe, J. Passingham, R.E. (2003) Activations related to 'mirror' and 'canonical' neurones in the human brain: an fMRI study. Neuroimage, 18, 928 937.
38. Grezes, J. Decety, J. (2001) Functional anatomy of execution, mental simulation, observation, and verb generation of actions: a meta-analysis. Hum. Brain Mapp., 12, 1 19.
39. Grossman, E.D. Blake, R. (2001) Brain activity evoked by inverted and imagined biological motion. Vision Res., 41, 1475 1482.
40. Harnad, S. (1990) The symbol grounding problem. Physica D, 42, 335 346.
41. Hauk, O., Johnsrude, I. Pulvermüller, F. (2004) Somatotopic representation of action words in human motor and premotor cortex. Neuron, 41, 301 307.
42. Hauk, O. Pulvermüller, F. (2004a) Effects of word length and frequency on the human event-related potential. Clin. Neurophysiol., 115, 1090 1103.
43. Hauk, O. Pulvermüller, F. (2004b) Neurophysiological distinction of action words in the fronto-central cortex. Hum. Brain Mapp., 21, 191 201.
44. Hauk, O., Davis, M.H., Ford, M., Pulvermüller, F. Marslen-Wilson, W.D. (2006) The time course of visual word recognition as revealed by linear regression analysis of ERP data. Neuroimage., 30, 1383 1400.
45. Henson, R. (2006) Forward inference using functional neuroimaging: dissociations versus associations. Trends Cogn. Sci., 10, 64 69.
46. Jeannerod, M., Arbib, M.A., Rizzolatti, G. Sakata, H. (1995) Grasping objects: the cortical mechanisms of visuomotor transformation. Trends Neurosci., 18, 314 320.
47. Jellema, T. Perrett, D.I. (2003) Cells in monkey STS responsive to articulated body motions and consequent static posture: a case of implied motion? Neuropsychologia, 41, 1728 1737.
48. Jescheniak, J.D. Levelt, W.J.M. (1994) Word-frequency effects in speech production - retrieval of syntactic information and of phonological form. J. Exp. Psychol.-Learn. Mem. Cogn., 20, 824 843.
49. Jessen, F., Heun, R., Erb, M., Granath, D.O., Klose, U., Papassotiropoulos, A. Grodd, W. (2000) The concreteness effect: evidence for dual coding and context availability. Brain Lang., 74, 103 112.
50. Jezzard, P. Balaban, R.S. (1995) Correction for geometric distortion in echo planar images from B0 field variations. Magn. Reson. Med., 34, 65 73.
51. Kiefer, M., Sim, E.J., Liebich, S., Hauk, O. Tanaka, J. (2007) Experience-dependent plasticity of conceptual representations in human sensory-motor areas. J. Cogn. Neurosci., 19, 525 542.
52. Kiefer, M. Spitzer, M. (2001) The limits of a distributed account of conceptual knowledge. Trends Cogn. Sci., 5, 469 471.
53. Kronbichler, M., Hutzler, F., Wimmer, H., Mair, A., Staffen, W. Ladurner, G. (2004) The visual word form area and the frequency with which words are encountered: evidence from a parametric fMRI study. Neuroimage, 21, 946 953.
54. Kuo, W.J., Yeh, T.C., Lee, C.Y., Wu, Y.T., Chou, C.C., Ho, L.T., Hung, D.L., Tzeng, O.J. Hsieh, J.C. (2003) Frequency effects of Chinese character processing in the brain: an event-related fMRI study. Neuroimage, 18, 720 730.
55. Lakoff, G. Johnson, M. (1999) Philosophy in the Flesh: the Embodied Mind and its Challenge to Western Thought. Basic Books, New York.
56. Liu, A.K., Dale, A.M. Belliveau, J.W. (2002) Monte Carlo simulation studies of EEG and MEG localization accuracy. Hum. Brain Mapp., 16, 47 62.
57. Loftus, G. Masson, M. (1994) Using confidence-intervals in within-subject designs. Psychon. Bull. Rev., 1, 476 490.
58. Logothetis, N.K. (2002) The neural basis of the blood-oxygen-level- dependent functional magnetic resonance imaging signal. Philosoph. Trans. Royal Soc. Lond. B Biol. Sci., 357, 1003 1037.
59. Lorch, R.F. Jr. Myers, J.L. (1990) Regression analyses of repeated measures data in cognitive research. J. Exp. Psychol.: Learn., Mem. Cogn., 16, 149 157.
60. Maes, F., Collignon, A., Vandermeulen, D., Marchal, G. Suetens, P. (1997) Multimodality image registration by maximization of mutual information. IEEE Trans. Med. Imaging, 16, 187 198.
61. Martin, A. (2007) The representation of object concepts in the brain. Annu. Rev. Psychol., 58, 25 45.
62. Martin, A. Chao, L.L. (2001) Semantic memory and the brain: structure and processes. Curr. Opin. Neurobiol., 11, 194 201.
63. Martin, A., Haxby, J.V., Lalonde, F.M., Wiggs, C.L. Ungerleider, L.G. (1995) Discrete cortical regions associated with knowledge of color and knowledge of action. Science, 270, 102 105.
64. Martin, A., Wiggs, C.L., Ungerleider, L.G. Haxby, J.V. (1996) Neural correlates of category-specific knowledge. Nature, 379, 649 652.
65. Mccann, R.S., Besner, D. Davelaar, E. (1988) Word recognition and identification - do word-frequency effects reflect lexical access. J. Exp. Psychol.-Hum. Percept. Perform., 14, 693 706.
66. McCann, R.S., Remington, R.W. Van Selst, M. (2000) A dual-task investigation of automaticity in visual word processing. J. Exp. Psychol. Hum. Percept. Perform., 26, 1352 1370.
67. Mechelli, A., Gorno-Tempini, M.L. Price, C.J. (2003) Neuroimaging studies of word and pseudoword reading: consistencies, inconsistencies, and limitations. J. Cogn. Neurosci., 15, 260 271.
68. Meister, I.G., Boroojerdi, B., Foltys, H., Sparing, R., Huber, W. Topper, R. (2003) Motor cortex hand area and speech: implications for the development of language. Neuropsychologia, 41, 401 406.
69. Morrison, C.M. Ellis, A.W. (2000) Real age of acquisition effects in word naming and lexical decision. Br. J. Psychol., 91, 167 180.
70. Noppeney, U. Price, C.J. (2002) Retrieval of visual, auditory, and abstract semantics. Neuroimage, 15, 917 926.
71. Oldfield, R.C. (1971) The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia, 9, 97 113.
72. Paap, K.R. Johansen, L.S. (1994) The case of the vanishing frequency effect - a retest of the verification model. J. Exp. Psychol.-Hum. Percept. Perform., 20, 1129 1157.
73. Paivio, A. (1986) Mental Representations - a Dual Coding Approach. Oxford University Press, New York.
74. Paivio, A. (1991) Dual coding theory: retrospect and current status. Can. J. Psychol., 45, 255 287.
75. Pelphrey, K.A., Morris, J.P., Michelich, C.R., Allison, T. McCarthy, G. (2005) Functional anatomy of biological motion perception in posterior temporal cortex: an FMRI study of eye, mouth and hand movements. Cereb. Cortex, 15, 1866 1876.
76. Perani, D., Cappa, S.F., Schnur, T., Tettamanti, M., Collina, S., Rosa, M.M. Fazio, F. (1999) The neural correlates of verb and noun processing. A PET study. Brain, 122, 2337 2344.
77. Perrett, D.I., Harries, M.H., Bevan, R., Thomas, S., Benson, P.J., Mistlin, A.J., Chitty, A.J., Hietanen, J.K. Ortega, J.E. (1989) Frameworks of analysis for the neural representation of animate objects and actions. J. Exp. Biol., 146, 87 113.
78. Puce, A. Perrett, D. (2003) Electrophysiology and brain imaging of biological motion. Philos. Trans. R. Soc. Lond. B Biol. Sci., 358, 435 445.
79. Pulvermüller, F. (1999) Words in the brain's language. Behav. Brain Sci., 22, 253 279 Discussion 280 336.
80. Pulvermüller, F. (2005) Brain mechanisms linking language and action. Nat. Rev. Neurosci., 6, 576 582.
81. Pulvermüller, F. Hauk, O. (2006) Category-specific conceptual processing of color and form in left fronto-temporal cortex. Cereb. Cortex, 16, 1193 1201.
82. Pulvermüller, F., Hauk, O., Nikulin, V.V. Ilmoniemi, R.J. (2005) Functional links between motor and language systems. Eur. J. Neurosci., 21, 793 797.
83. Pulvermüller, F., Lutzenberger, W. Birbaumer, N. (1995) Electrocortical distinction of vocabulary types. Electroencephalogr. Clin. Neurophysiol., 94, 357 370.
84. Pulvermüller, F., Preissl, H., Lutzenberger, W. Birbaumer, N. (1996) Brain rhythms of language: nouns versus verbs. Eur. J. Neurosci., 8, 937 941.
85. Pylyshyn, Z.W. (2002) Mental imagery: in search of a theory. Behav. Brain Sci., 25, 157 182 Discussion 182 237.
86. Rizzolatti, G. Craighero, L. (2004) The mirror-neuron system. Annu. Rev. Neurosci., 27, 169 192.
87. Rizzolatti, G. Luppino, G. (2001) The cortical motor system. Neuron, 31, 889 901.
88. Rogers, T.T., Lambon Ralph, M.A., Garrard, P., Bozeat, S., McClelland, J.L., Hodges, J.R. Patterson, K. (2004) Structure and deterioration of semantic memory: a neuropsychological and computational investigation. Psychol. Rev., 111, 205 235.
89. Sabsevitz, D.S., Medler, D.A., Seidenberg, M. Binder, J.R. (2005) Modulation of the semantic system by word imageability. Neuroimage, 27, 188 200.
90. Scott, S.K. (2004) The neural representation of concrete nouns: what's right and what's left? Trends Cogn. Sci., 8, 151 153.
91. Sereno, S.C. Rayner, K. (2003) Measuring word recognition in reading: eye movements and event-related potentials. Trends Cogn. Sci., 7, 489 493.
92. Sereno, S.C., Rayner, K. Posner, M.I. (1998) Establishing a time-line of word recognition: evidence from eye movements and event-related potentials. Neuroreport, 9, 2195 2200.
93. Seyal, M., Mull, B., Bhullar, N., Ahmad, T. Gage, B. (1999) Anticipation and execution of a simple reading task enhance corticospinal excitability. Clin. Neurophysiol., 110, 424 429.
94. Shmuel, A., Augath, M., Oeltermann, A. Logothetis, N.K. (2006) Negative functional MRI response correlates with decreases in neuronal activity in monkey visual area V1. Nat. Neurosci., 9, 569 577.
95. Shtyrov, Y., Hauk, O. Pulvermüller, F. (2004) Distributed neuronal networks for encoding category-specific semantic information: the mismatch negativity to action words. Eur. J. Neurosci., 19, 1083 1092.
96. Smith, S.M. (2002) Fast robust automated brain extraction. Hum. Brain Mapp., 17, 143 155.
97. Strafella, A.P. Paus, T. (2000) Modulation of cortical excitability during action observation: a transcranial magnetic stimulation study. Neuroreport, 11, 2289 2292.
98. Tettamanti, M., Buccino, G., Saccuman, M.C., Gallese, V., Danna, M., Scifo, P., Fazio, F., Rizzolatti, G., Cappa, S.F. Perani, D. (2005) Listening to action-related sentences activates fronto-parietal motor circuits. J. Cogn. Neurosci., 17, 273 281.
99. Tranel, D., Martin, C., Damasio, H., Grabowski, T.J. Hichwa, R. (2005) Effects of noun-verb homonymy on the neural correlates of naming concrete entities and actions. Brain Lang., 92, 288 299.
100. Tzourio-Mazoyer, N., Landeau, B., Papathanassiou, D., Crivello, F., Etard, O., Delcroix, N., Mazoyor, B. Joliot, M. (2002) Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage, 15, 273 289.
101. Whaley, C. (1978) Word-nonword classification time. J. Verbal Learning Verbal Behavior, 17, 143 154.
102. Wheatley, T., Weisberg, J., Beauchamp, M.S. Martin, A. (2005) Automatic priming of semantically related words reduces activity in the fusiform gyrus. J. Cogn. Neurosci., 17, 1871 1885.
103. Wise, R., Chollet, F., Hadar, U., Friston, K., Hoffner, E. Frackowiak, R. (1991) Distribution of cortical neural networks involved in word comprehension and word retrieval. Brain, 114, 1803 1817.
104. Wise, R.J., Howard, D., Mummery, C.J., Fletcher, P., Leff, A., Buchel, C. Scott, S.K. (2000) Noun imageability and the temporal lobes. Neuropsychologia, 38, 985 994.