The processing of speech, gesture, and action during language comprehension

Psychonomic Bulletin and Review

Volumn 22, Issue 2, 2015, Pages 517-523

  Kelly, Spencer ^a   Healey, Meghan ^a,e   Özyürek, Asli ^b,c,d   Holler, Judith ^c  

^a Assistant Professor in the University Libraries   (United States)

^b RADBOUD UNIVERSITY NIJMEGEN   (Netherlands)

^c MAX PLANCK INSTITUTE FOR PSYCHOLINGUISTICS   (Netherlands)

^d RADBOUD UNIVERSITY   (Netherlands)

^e UNIVERSITY OF PENNSYLVANIA   (United States)

Author keywords

Action; Embodied cognition; Gesture; Language comprehension

Indexed keywords

ADOLESCENT; ADULT; ASSOCIATION; COMPREHENSION; FEMALE; GESTURE; HUMAN; MALE; NONVERBAL COMMUNICATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; SPEECH PERCEPTION; YOUNG ADULT;

ADOLESCENT; ADULT; ASSOCIATION; COMPREHENSION; FEMALE; GESTURES; HUMANS; MALE; NONVERBAL COMMUNICATION; PSYCHOMOTOR PERFORMANCE; REACTION TIME; SPEECH PERCEPTION; YOUNG ADULT;

EID: 84939881489     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-014-0681-7     Document Type: Article

References (19)

1. Clark, H. H. (1996). Using language. Cambridge, UK: Cambridge University Press.
2. Holler, J., Kokal, I., Toni, I., Hagoort, P., Kelly, S. D., & Özyürek, A. (2014). Eye’m talking to you: Speakers’ gaze direction modulates co-speech gesture processing in the right MTG. Social Cognitive and Affective Neuroscience. doi:10.1093/scan/nsu047. Advance online publication.
3. Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137, 297–315.
4. Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15, 495–514. doi:10.3758/PBR.15.3.495
5. Hostetter, A. B., & Alibali, M. W. (2010). Language, gesture, action! A test of the Gesture as Simulated Action framework. Journal of Memory and Language, 63, 245–257.
6. Kelly, S. D., Ward, S., Creigh, P., & Bartolotti, J. (2007). An intentional stance modulates the integration of gesture and speech during comprehension. Brain and Language, 101, 222–233.
7. Kelly, S. D., Özyürek, A., & Maris, E. (2010). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21, 260–267. doi:10.1177/0956797609357327
8. Kendon, A. (1986). Current issues in the study of gesture. In J.-L. Nespoulous, P. Perron, A. Roch Lecours, & the Toronto Semiotic Circle (Eds.), The biological foundations of gestures: Motor and semiotic aspects (Vol. 1, pp. 23–47). Hillsdale, NJ: Erlbaum.
9. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press.
10. Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57, 396–414.
11. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.
12. McNeill, D. (2012). How language began: Gesture and speech in human evolution. New York, NY: Cambridge University Press.
13. Novack, M. A., Congdon, E. L., Hemani-Lopez, N., & Goldin-Meadow, S. (2014). From action to abstraction using the hands to learn math. Psychological Science, 25, 903–910.
14. Paivio, A. (1986). Mental representations: A dual coding approach. Oxford, UK: Oxford University Press.
15. Rosenbaum, D. A., Chapman, K. M., Weigelt, M., Weiss, D. J., & van der Wel, R. (2012). Cognition, action, and object manipulation. Psychological Bulletin, 138, 924–946.
16. Wagner Cook, S., & Tanenhaus, M. K. (2009). Embodied communication: Speakers’ gestures affect listeners’ actions. Cognition, 113, 98–104. doi:10.1016/j.cognition.2009.06.006
17. Willems, R. M., Özyürek, A., & Hagoort, P. (2008). Seeing and hearing meaning: ERP and fMRI evidence of word versus picture integration into a sentence context. Journal of Cognitive Neuroscience, 20, 1235–1249. doi:10.1162/jocn.2008.20085
18. Willems, R. M., Özyürek, A., & Hagoort, P. (2009). Differential roles for left inferior frontal and superior temporal cortex in multimodal integration of action and language. NeuroImage, 47, 1992–2004.
19. Wu, Y. C., & Coulson, S. (2011). Are depictive gestures like pictures? Commonalities and differences in semantic processing. Brain and Language, 119, 184–195. doi:10.1016/j.bandl.2011.07.002