The time course of action and action-word comprehension in the human brain as revealed by neurophysiology

Journal of Physiology Paris

Volumn 102, Issue 1-3, 2008, Pages 50-58

  Hauk, O ^a   Shtyrov, Y ^a   Pulvermuller F ^a  

^a MRC COGNITION AND BRAIN SCIENCES UNIT   (United Kingdom)

Author keywords

Action; Action words; EEG; MEG; TMS; Word recognition

Indexed keywords

ARTICLE; AUDITORY STIMULATION; BODY MOVEMENT; BRAIN FUNCTION; COMPREHENSION; ELECTROENCEPHALOGRAM; ELECTROENCEPHALOGRAPHY; EVENT RELATED POTENTIAL; HUMAN; LANGUAGE ABILITY; MAGNETOENCEPHALOGRAPHY; MISMATCH NEGATIVITY; MOTOR CORTEX; NEUROPHYSIOLOGY; SEMANTICS; TRANSCRANIAL MAGNETIC STIMULATION; VISUAL STIMULATION; WORD RECOGNITION;

BRAIN; COMPREHENSION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS, VISUAL; HUMANS; LANGUAGE; NEUROPHYSIOLOGY; PHOTIC STIMULATION; REACTION TIME; TIME FACTORS;

EID: 44949257962     PISSN: 09284257     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.jphysparis.2008.03.013     Document Type: Article

References (101)

1. Avikainen S., Forss N., and Hari R. Modulated activation of the human SI and SII cortices during observation of hand actions. Neuroimage 15 3 (2002) 640-646
2. Aziz-Zadeh L., Iacoboni M., Zaidel E., Wilson S., and Mazziotta J. Left hemisphere motor facilitation in response to manual action sounds. Eur. J. Neurosci. 19 9 (2004) 2609-2612
3. Aziz-Zadeh L., Maeda F., Zaidel E., Mazziotta J., and Iacoboni M. Lateralization in motor facilitation during action observation: a TMS study. Exp. Brain. Res. 144 1 (2002) 127-131
4. Aziz-Zadeh L., Wilson S.M., Rizzolatti G., and Iacoboni M. Congruent embodied representations for visually presented actions and linguistic phrases describing actions. Curr. Biol. 16 18 (2006) 1818-1823
5. Bak T.H., O'Donovan D.G., Xuereb J.H., Boniface S., and Hodges J.R. Selective impairment of verb processing associated with pathological changes in Brodmann areas 44 and 45 in the motor neurone disease-dementia-aphasia syndrome. Brain 124 Pt 1 (2001) 103-120
6. Bak T.H., Yancopoulou D., Nestor P.J., Xuereb J.H., Spillantini M.G., Pulvermuller F., et al. Clinical, imaging and pathological correlates of a hereditary deficit in verb and action processing. Brain 129 Pt 2 (2006) 321-332
7. Barber H.A., and Kutas M. Interplay between computational models and cognitive electrophysiology in visual word recognition. Brain Res. Brain Res. Rev. 53 1 (2007) 98-123
8. Barraclough N.E., Xiao D., Baker C.I., Oram M.W., and Perrett D.I. Integration of visual and auditory information by superior temporal sulcus neurons responsive to the sight of actions. J. Cogn. Neurosci. 17 3 (2005) 377-391
9. Barsalou L.W. Perceptual symbol systems. Behav. Brain Sci. 22 4 (1999) 577-609 discussion 610-560
10. Barsalou L.W., Kyle Simmons W., Barbey A.K., and Wilson C.D. Grounding conceptual knowledge in modality-specific systems. Trends Cogn. Sci. 7 2 (2003) 84-91
11. Boulenger V., Mechtouff L., Thobois S., Broussolle E., Jeannerod M., and Nazir T.A. Word processing in Parkinson's disease is impaired for action verbs but not for concrete nouns. Neuropsychologia (2007)
12. Boulenger V., Roy A.C., Paulignan Y., Deprez V., Jeannerod M., and Nazir T.A. Cross-talk between language processes and overt motor behavior in the first 200 ms of processing. J. Cogn. Neurosci. 18 10 (2006) 1607-1615
13. Braitenberg V., and Pulvermüller F. Model of a neurological theory of speech. Naturwissenschaften 79 3 (1992) 103-117
14. Buccino G., Binkofski F., Fink G.R., Fadiga L., Fogassi L., Gallese V., et al. Action observation activates premotor and parietal areas in a somatotopic manner: an fMRI study. Eur. J. Neurosci. 13 2 (2001) 400-404
15. Buccino G., Riggio L., Melli G., Binkofski F., Gallese V., and Rizzolatti G. Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. Brain Res. Cogn. Brain Res. 24 3 (2005) 355-363
16. Cochin S., Barthelemy C., Roux S., and Martineau J. Observation and execution of movement: similarities demonstrated by quantified electroencephalography. Eur. J. Neurosci. 11 5 (1999) 1839-1842
17. Dale A.M., and Sereno M.I. Improved localization of cortical activity by combining EEG and MEG with MRI cortical surface reconstruction: A linear approach. J. Cogn. Neurosci. 5 2 (1993) 162-176
18. Dambacher M., Kliegl R., Hofmann M., and Jacobs A.M. Frequency and predictability effects on event-related potentials during reading. Brain Res. 1084 1 (2006) 89-103
19. Devlin J.T., and Watkins K.E. Stimulating language: insights from TMS. Brain (2006)
20. Fadiga L., Craighero L., Buccino G., and Rizzolatti G. Speech listening specifically modulates the excitability of tongue muscles: a TMS study. Eur. J. Neurosci. 15 2 (2002) 399-402
21. Fadiga L., Craighero L., and Olivier E. Human motor cortex excitability during the perception of others' action. Curr. Opin. Neurobiol. 15 2 (2005) 213-218
22. Fadiga L., Fogassi L., Pavesi G., and Rizzolatti G. Motor facilitation during action observation: a magnetic stimulation study. J. Neurophysiol. 73 6 (1995) 2608-2611
23. Feldman J. From molecule to metaphor: a neural theory of language (2006), MIT Press, Cambridge, MA
24. Floel A., Ellger T., Breitenstein C., and Knecht S. Language perception activates the hand motor cortex: implications for motor theories of speech perception. Eur. J. Neurosci. 18 3 (2003) 704-708
25. Friston K.J., Fletcher P., Josephs O., Holmes A., Rugg M.D., and Turner R. Event-related fMRI: characterizing differential responses. Neuroimage 7 1 (1998) 30-40
26. Fuchs M., Wagner M., Kohler T., and Wischmann H.A. Linear and nonlinear current density reconstructions. J. Clin. Neurophysiol. 16 3 (1999) 267-295
27. Fuster J.M. Network memory. Trends Neurosci. 20 10 (1997) 451-459
28. Fuster J.M. Cortex and Mind: Unifying Cognition (2003), Oxford University Press, Oxford
29. Gangitano M., Mottaghy F.M., and Pascual-Leone A. Phase-specific modulation of cortical motor output during movement observation. Neuroreport 12 7 (2001) 1489-1492
30. Gangitano M., Mottaghy F.M., and Pascual-Leone A. Modulation of premotor mirror neuron activity during observation of unpredictable grasping movements. Eur. J. Neurosci. 20 8 (2004) 2193-2202
31. Gentilucci M. Object motor representation and language. Exp. Brain Res. 153 2 (2003) 260-265
32. Glenberg A.M., and Kaschak M.P. Grounding language in action. Psychon. Bull. Rev. 9 3 (2002) 558-565
33. Goldberg R.F., Perfetti C.A., and Schneider W. Perceptual knowledge retrieval activates sensory brain regions. J. Neurosci. 26 18 (2006) 4917-4921
34. Grezes J., Armony J.L., Rowe J., and Passingham R.E. Activations related to "mirror" and "canonical" neurones in the human brain: an fMRI study. Neuroimage 18 4 (2003) 928-937
35. Hämäläinen M.S., Hari R., Ilmoniemi R.J., Knuutila J., and Lounasmaa O.V. Magnetoencephalography - theory, instrumentation, and applications to noninvasive studies of the working human brain. Rev. Modern Phys. 65 (1993) 413-497
36. Hämäläinen M.S., and Ilmoniemi R.J. Interpreting magnetic fields of the brain: minimum norm estimates. Med. Biol. Eng. Comp. 32 1 (1994) 35-42
37. Hari R., Forss N., Avikainen S., Kirveskari E., Salenius S., and Rizzolatti G. Activation of human primary motor cortex during action observation: a neuromagnetic study. Proc. Natl. Acad. Sci. USA 95 25 (1998) 15061-15065
38. Hauk O. Keep it simple: a case for using classical minimum norm estimation in the analysis of EEG and MEG data. Neuroimage 21 4 (2004) 1612-1621
39. Hauk O., Davis M.H., Ford M., Pulvermüller F., and Marslen-Wilson W.D. The time course of visual word recognition as revealed by linear regression analysis of ERP data. Neuroimage 30 4 (2006) 1383-1400
40. Hauk O., Davis M.H., Ford M., Pulvermüller F., and Marslen-Wilson W.D. The time course of visual word recognition as revealed by linear regression analysis of ERP data. Neuroimage (2006)
41. Hauk O., Johnsrude I., and Pulvermüller F. Somatotopic representation of action words in human motor and premotor cortex. Neuron 41 2 (2004) 301-307
42. Hauk O., Keil A., Elbert T., and Muller M.M. Comparison of data transformation procedures to enhance topographical accuracy in time-series analysis of the human EEG. J. Neurosci. Methods 113 2 (2002) 111-122
43. Hauk O., Patterson K., Woollams A., Cooper-Pye E., Pulvermuller F., and Rogers T.T. How the camel lost its hump: the impact of object typicality on event-related potential signals in object decision. J. Cogn. Neurosci. 19 8 (2007) 1338-1353
44. Hauk O., Patterson K., Woollams A., Watling L., Pulvermüller F., and Rogers T.T. [Q:] When would you prefer a SOSSAGE to a SAUSAGE? [A:] At about 100 ms. ERP correlates of orthographic typicality and lexicality in written word recognition. J. Cogn. Neurosci. 18 5 (2006) 818-832
45. Hauk O., and Pulvermüller F. Effects of word length and frequency on the human event-related potential. Clin. Neurophysiol. 115 5 (2004) 1090-1103
46. Hauk O., and Pulvermüller F. Neurophysiological distinction of action words in the fronto-central cortex. Human Brain Mapping 21 3 (2004) 191-201
47. Hauk O., Shtyrov Y., and Pulvermüller F. The sound of actions as reflected by mismatch negativity: rapid activation of cortical sensory-motor networks by sounds associated with finger and tongue movements. Eur. J. Neurosci. 23 3 (2006) 811-821
48. Hebb D.O. The organization of behavior. A Neuropsychological Theory (1949), John Wiley, New York
49. Iacoboni M., and Dapretto M. The mirror neuron system and the consequences of its dysfunction. Nat. Rev. Neurosci. 7 12 (2006) 942-951
50. Jarvelainen J., Schurmann M., and Hari R. Activation of the human primary motor cortex during observation of tool use. Neuroimage 23 1 (2004) 187-192
51. Jeannerod M. Neural simulation of action: a unifying mechanism for motor cognition. Neuroimage 14 1 Pt 2 (2001) S103-S109
52. Johnson J.S., and Olshausen B.A. The earliest EEG signatures of object recognition in a cued-target task are postsensory. J. Vis. 5 4 (2005) 299-312
53. Junghöfer M., Elbert T., Leiderer P., Berg P., and Rockstroh B. Mapping EEG-potentials on the surface of the brain: a strategy for uncovering cortical sources. Brain Topogr. 9 3 (1997) 203-217
54. Keysers C., Kohler E., Umilta M.A., Nanetti L., Fogassi L., and Gallese V. Audiovisual mirror neurons and action recognition. Exp. Brain Res. 153 4 (2003) 628-636
55. Kohler E., Keysers C., Umilta M.A., Fogassi L., Gallese V., and Rizzolatti G. Hearing sounds, understanding actions: action representation in mirror neurons. Science 297 5582 (2002) 846-848
56. Marslen-Wilson W.D. Functional parallelism in spoken word-recognition. Cognition 25 1-2 (1987) 71-102
57. Meister I.G., Boroojerdi B., Foltys H., Sparing R., Huber W., and Topper R. Motor cortex hand area and speech: implications for the development of language. Neuropsychologia 41 4 (2003) 401-406
58. Michel C.M., Seeck M., and Murray M.M. The speed of visual cognition. Clin. Neurophysiol. 57 (2004) 617-627
59. Mottonen R., Jarvelainen J., Sams M., and Hari R. Viewing speech modulates activity in the left SI mouth cortex. Neuroimage 24 3 (2005) 731-737
60. Näätänen R. The mismatch negativity: a powerful tool for cognitive neuroscience. Ear Hear 16 1 (1995) 6-18
61. Näätänen R., Pakarinen S., Rinne T., and Takegata R. The mismatch negativity (MMN): towards the optimal paradigm. Clin. Neurophysiol. 115 1 (2004) 140-144
62. Neininger B., and Pulvermüller F. The right hemisphere's role in action word processing: a double case study. Neurocase 7 4 (2001) 303-317
63. Neininger B., and Pulvermüller F. Word-category specific deficits after lesions in the right hemisphere. Neuropsychologia 41 1 (2003) 53-70
64. Nishio Y., Kazui H., Hashimoto M., Shimizu K., Onouchi K., Mochio S., et al. Actions anchored by concepts: defective action comprehension in semantic dementia. J. Neurol. Neurosurg. Psychiatry (2006)
65. Nishitani N., and Hari R. Temporal dynamics of cortical representation for action. Proc. Natl. Acad. Sci. USA 97 2 (2000) 913-918
66. Pascual-Leone A., Walsh V., and Rothwell J. Transcranial magnetic stimulation in cognitive neuroscience-virtual lesion, chronometry, and functional connectivity. Curr. Opin. Neurobiol. 10 2 (2000) 232-237
67. Picton T.W., Lins O.G., and Scherg M. The recording and analysis of event-related potentials. In: Boller F., and Grafman J. (Eds). Handbook of Neuropsychology 10 (1995), Elsevier Science B.V
68. Pizzamiglio L., Aprile T., Spitoni G., Pitzalis S., Bates E., D'Amico S., et al. Separate neural systems for processing action- or non-action-related sounds. Neuroimage 24 3 (2005) 852-861
69. Preissl H., Pulvermuller F., Lutzenberger W., and Birbaumer N. Evoked potentials distinguish between nouns and verbs. Neurosci. Lett. 197 1 (1995) 81-83
70. Pulvermüller F. Words in the brain's language. Behav. Brain Sci. 22 2 (1999) 253-279 discussion 280-336
71. Pulvermüller F. Brain mechanisms linking language and action. Nat. Rev. Neurosci. 6 7 (2005) 576-582
72. Pulvermüller F., Härle M., and Hummel F. Neurophysiological distinction of verb categories. Neuroreport 11 12 (2000) 2789-2793
73. Pulvermüller F., Härle M., and Hummel F. Walking or talking? Behavioral and neurophysiological correlates of action verb processing. Brain Lang. 78 2 (2001) 143-168
74. Pulvermüller F., and Hauk O. Category-specific conceptual processing of color and form in left fronto-temporal cortex. Cereb. Cortex 16 8 (2006) 1193-1201
75. Pulvermüller F., Hauk O., Nikulin V.V., and Ilmoniemi R.J. Functional links between motor and language systems. Eur. J. Neurosci. 21 3 (2005) 793-797
76. Pulvermüller F., Lutzenberger W., and Birbaumer N. Electrocortical distinction of vocabulary types. Electroencephalogr. Clin. Neurophysiol. 94 5 (1995) 357-370
77. Pulvermüller F., Lutzenberger W., and Preissl H. Nouns and verbs in the intact brain: evidence from event-related potentials and high-frequency cortical responses. Cereb. Cortex 9 5 (1999) 497-506
78. Pulvermüller F., Mohr B., and Schleichert H. Semantic or lexico-syntactic factors: what determines word-class specific activity in the human brain?. Neurosci. Lett. 275 2 (1999) 81-84
79. Pulvermüller F., Preissl H., Lutzenberger W., and Birbaumer N. Brain rhythms of language: nouns versus verbs. Eur. J. Neurosci. 8 5 (1996) 937-941
80. Pulvermüller F., and Shtyrov Y. Language outside the focus of attention: the mismatch negativity as a tool for studying higher cognitive processes. Prog. Neurobiol. 79 1 (2006) 49-71
81. Pulvermüller F., Shtyrov Y., and Ilmoniemi R. Brain signatures of meaning access in action word recognition. J Cogn Neurosci 17 6 (2005) 884-892
82. Rizzolatti G., and Arbib M.A. Language within our grasp. Trends Neurosci. 21 5 (1998) 188-194
83. Rizzolatti G., and Craighero L. The mirror-neuron system. Annu. Rev. Neurosci. 27 (2004) 169-192
84. Rizzolatti G., Fadiga L., Gallese V., and Fogassi L. Premotor cortex and the recognition of motor actions. Brain Res. Cogn. Brain Res. 3 2 (1996) 131-141
85. Sereno S.C., and Rayner K. Measuring word recognition in reading: eye movements and event-related potentials. Trends Cogn. Sci. 7 11 (2003) 489-493
86. Sereno S.C., Rayner K., and Posner M.I. Establishing a time-line of word recognition: evidence from eye movements and event-related potentials. Neuroreport 9 10 (1998) 2195-2200
87. Seyal M., Mull B., Bhullar N., Ahmad T., and Gage B. Anticipation and execution of a simple reading task enhance corticospinal excitability. Clin. Neurophysiol. 110 3 (1999) 424-429
88. Shapiro K.A., Pascual-Leone A., Mottaghy F.M., Gangitano M., and Caramazza A. Grammatical distinctions in the left frontal cortex. J. Cogn. Neurosci. 13 6 (2001) 713-720
89. Shtyrov Y., Hauk O., and Pulvermüller F. Distributed neuronal networks for encoding category-specific semantic information: the mismatch negativity to action words. Eur. J. Neurosci. 19 4 (2004) 1083-1092
90. Shtyrov Y., and Pulvermüller F. Neurophysiological evidence of memory traces for words in the human brain. Neuroreport 13 4 (2002) 521-525
91. Simmons W.K., Ramjee V., Beauchamp M.S., McRae K., Martin A., and Barsalou L.W. A common neural substrate for perceiving and knowing about color. Neuropsychologia 45 12 (2007) 2802-2810
92. Sitnikova T., Kuperberg G., and Holcomb P.J. Semantic integration in videos of real-world events: an electrophysiological investigation. Psychophysiology 40 1 (2003) 160-164
93. Strafella A.P., and Paus T. Modulation of cortical excitability during action observation: a transcranial magnetic stimulation study. Neuroreport 11 10 (2000) 2289-2292
94. Sundara M., Namasivayam A.K., and Chen R. Observation-execution matching system for speech: a magnetic stimulation study. Neuroreport 12 7 (2001) 1341-1344
95. Tanenhaus M.K., and Hare M. Phonological typicality and sentence processing. Trends Cogn. Sci. 11 3 (2007) 93-95
96. Tettamanti M., Buccino G., Saccuman M.C., Gallese V., Danna M., Scifo P., et al. Listening to action-related sentences activates fronto-parietal motor circuits. J. Cogn. Neurosci. 17 2 (2005) 273-281
97. Tokimura H., Tokimura Y., Oliviero A., Asakura T., and Rothwell J.C. Speech-induced changes in corticospinal excitability. Ann. Neurol. 40 4 (1996) 628-634
98. Urgesi C., Candidi M., Fabbro F., Romani M., and Aglioti S.M. Motor facilitation during action observation: topographic mapping of the target muscle and influence of the onlooker's posture. Eur. J. Neurosci. 23 9 (2006) 2522-2530
99. Urgesi C., Moro V., Candidi M., and Aglioti S.M. Mapping implied body actions in the human motor system. J. Neurosci. 26 30 (2006) 7942-7949
100. VanRullen R., and Thorpe S.J. The time course of visual processing: from early perception to decision-making. J. Cogn. Neurosci. 13 4 (2001) 454-461
101. Watkins K.E., Strafella A.P., and Paus T. Seeing and hearing speech excites the motor system involved in speech production. Neuropsychologia 41 8 (2003) 989-994