Neural correlates of bimodal speech and gesture comprehension

Brain and Language

Volumn 89, Issue 1, 2004, Pages 253-260

  Kelly, Spencer D ^a   Kravitz, Corinne ^a   Hopkins, Michael ^a  

^a Center for Language and Brain   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

ADULT; ARTICLE; AUDIOVISUAL EQUIPMENT; COMPREHENSION; CONTROLLED STUDY; CORRELATION ANALYSIS; EVENT RELATED POTENTIAL; FEMALE; FRONTAL LOBE; GESTURE; HAND MOVEMENT; HUMAN; HUMAN EXPERIMENT; MALE; MEDICAL RECORD; NORMAL HUMAN; OCCIPITAL LOBE; SEMANTICS; SPEECH;

ADULT; ATTENTION; CEREBRAL CORTEX; COMPREHENSION; ELECTROENCEPHALOGRAPHY; EVOKED POTENTIALS; FEMALE; GESTURES; HUMANS; MALE; PSYCHOLINGUISTICS; SEMANTICS; SPEECH PERCEPTION; VISUAL PERCEPTION;

EID: 1542358818     PISSN: 0093934X     EISSN: None     Source Type: Journal    
DOI: 10.1016/S0093-934X(03)00335-3     Document Type: Article

References (29)

1. Beauducel A., Debener S. Misallocation of variance in event-related potentials: Simulation studies of the effects of test power, topography, and baseline-to-peak versus principal component quantifications. Journal of Neuroscience Methods. 124:2003;103-124.
2. Cassell J., McNeill D., McCullough K.E. Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics and Cognition. 7(1):1999;1-34.
3. Clark H.H. Using language. 1996;Cambridge University Press, Cambridge, GB.
4. Curran T. The electrophysiology of incidental and intentional retrieval: ERP old/new effects in lexical decision and recognition memory. Neuropsychologia. 37(7):1999;771-785.
5. Dorman M.F. Auditory evoked potential correlates of speech sound discrimination. Perception and Psychophysics. 15(2):1974;215-220.
6. Eimer M., Driver J. Crossmodal links in endogenous and exogenous spatial attention: Evidence from event-related brain potential studies. Neuroscience and Biobehavioral Reviews. 25(6):2001;497-511.
7. Goldin-Meadow S., Nusbaum H., Kelly S.D., Wagner S. Explaining math: Gesture lightens the load. Psychological Science. 12:2001;516-522.
8. Hadar U., Wenkert-Olenik D., Krauss R.M., Soroker N. Gesture and the processing of speech: Neuropsychological evidence. Brain & Language. 62(1):1998;107-126.
9. Haxby J.V., Hoffman E.A., Gobbini M.I. Human neural systems for face recognition and social communication. Biological Psychiatry. 51(1):2002;59-67.
10. Holcomb P. Semantic priming and stimulus degradation: Implications for the role of N400 in language processing. Psychophysiology. 30(1):1993;47-61.
11. Holcomb P.J., Neville H.J. Natural speech processing: An analysis using event-related brain potentials. Psychobiology. 19(4):1991;286-300.
12. Iverson J.M., Goldin-Meadow S. Why people gesture when they speak. Nature. 396:1998;228.
13. Kelly S.D., Barr D., Church R.B., Lynch K. Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language. 40:1999;577-592.
14. Kelly S.D., Church R.B. A comparison between children's and adults' ability to detect children's representational gestures. Child Development. 69:1998;85-93.
15. Kiefer M., Weisbrod M., Kern I., Maier S., Spitzer M. Right hemisphere activation during indirect semantic priming: Evidence from event-related potentials. Brain and Language. 64(3):1998;377-408.
16. Kita S., Özyürek A. What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language. 48(1):2003;16-32.
17. Krauss R.M. Why do we gesture when we speak? Current Directions in Psychological Science. 7(2):1998;54-60.
18. Krauss R.M., Morrel-Samuels P., Colasante C. Do conversational hand gestures communicate? Journal of Personality & Social Psychology. 61(5):1991;743-754.
19. Kutas M., Hillyard S.A. The lateral distribution of event-related potentials during sentence processing. Neuropsychologia. 20(5):1982;579-590.
20. Kutas M., Hillyard S.A. Brain potentials during reading reflect word expectancy and semantic association. Nature. 307(5947):1984;161-163.
21. Mangun G.R., Hillyard S.A. Modulations of sensory-evoked brain potentials indicate changes in perceptual processing during visual-spatial priming. Journal of Experimental Psychology: Human Perception and Performance. 17(4):1991;1057-1074.
22. McNeill D. Hand and mind: What gesture reveals about thought. 1992;University of Chicago Press, Chicago, IL.
23. Morrel-Samuels P., Krauss R.M. Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology: Learning, Memory, & Cognition. 18(3):1992;615-622.
24. Näätänen R., Picton T.W. The N1 wave of the human electric and magnetic response to sound: A review and analysis of the component structure. Psychophysiology. 24(4):1987;375-425.
25. Osterhout L., Holcomb P.J. Event related potentials and language comprehension. Rugg M.D., Coles M.G.H. Electrophysiology of mind: Event-related brain potentials and cognition. 1995;171-215 Oxford University Press, London.
26. Pourtois G., de Gelder B., Vroomen J., Rossion B., Crommelinck M. The time-course of intermodal binding between seeing and hearing affective information. Neuroreport: For Rapid Communication of Neuroscience Research. 11(6):2000;1329-1333.
27. Rauscher F.H., Krauss R.M., Chen Y. Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science. 7(4):1996;226-231.
28. Rugg M.D., Coles M.G.H. Electrophysiology of mind: Event-related brain potentials and cognition. 1995;Oxford University Press, London.
29. Wood C.C., McCarthy G. Principal component analysis of event-related potentials: Simulation studies demonstrate misallocation of variance across components. Electroencephalography Clinical Neurophysiology. 59:1984;249-260.