Temporal synchrony between speech, action and gesture during language production

Language, Cognition and Neuroscience

Volumn 29, Issue 3, 2014, Pages 345-354

  Church, R Breckinridge ^a   Kelly, Spencer ^b   Holcombe, David ^a  

^a NORTHEASTERN ILLINOIS UNIVERSITY   (United States)

^b Assistant Professor in the University Libraries   (United States)

Author keywords

Action; Gesture; Language; Speech; Synchrony

Indexed keywords

ADULT; ARTICLE; CODING; COMPARATIVE STUDY; FEMALE; GESTURE; HUMAN; INTERPERSONAL COMMUNICATION; LANGUAGE; MALE; MENTAL FUNCTION; QUALITATIVE ANALYSIS; RELIABILITY; SPEECH; TASK PERFORMANCE; TEMPORAL SYNCHRONY;

EID: 84928984250     PISSN: 23273798     EISSN: 23273801     Source Type: Journal    
DOI: 10.1080/01690965.2013.857783     Document Type: Article

References (33)

1. Armstrong, D. F., & Wilcox, S. (2007). The gestural origin of language. Oxford: Oxford University Press.
2. Beilock, S., & Goldin-Meadow S. (2010). Gesture changes thought by grounding it in action. Psychological Science, 21, 1605-1610. doi:10.1177/0956797610385353
3. Cartmill, E. A., Beilock, S., & Goldin-Meadow, S. (2012). A word in the hand: Action, gesture and mental representation in humans and non-human primates. Philosophical Transactions of the Royal Society B: Biological Sciences, 367(1585), 129-143. doi:10.1098/rstb.2011.0162
4. Church, R. B., Garber, P., & Rogalsky, K. (2007). The role of gesture in social communication and memory. Gesture, 7, 137-157. doi:10.1075/gest.7.2.02bre
5. Church, R. B., Kelly, S. D., & Lynch, K. (2000). Multimodal processing over development: The case of speech and gesture detection. Journal of Nonverbal Behavior, 24(2), 151-174. doi:10.1023/A:1006610013873
6. Cook, S. W., & Tanenhaus, M. K. (2009). Embodied understanding: Speaker’s gestures affect listener’s actions. Cognition, 113, 98-104. doi:10.1016/j.cognition.2009.06.006
7. Goldin-Meadow, S., & Beilock, S. L. (2010). Action’s influence on thought: The case of gesture. Perspectives on Psychological Science, 5, 664-674. doi:10.1177/1745691610388764
8. Goldin-Meadow, S., McNeill, D., & Singleton, J. (1996). Silence is liberating: Removing the handcuffs on grammatical expression in the manual modality. Psychological Review, 103(1), 34-55. doi:10.1037/0033-295X.103.1.34
9. Goldin-Meadow, S., Wein, D., & Chang, C. (1992). Assessing knowledge through gesture: Using children's hands to read their minds. Cognition and Instruction, 9(3), 201-219. doi:10.1037/0033-295X.103.1.34
10. Greenfield, P. M. (1984). A theory of the teacher in the learning activities of everyday life. In B. Rogoff & J. Lave (Eds.), Everyday cognition: Its development in social context (pp. 117-138). Cambridge, MA: Harvard University Press.
11. Habets, B., Kita, S., Shao, Z., Ozyurek, A., & Hagoort, P. (2011). The role of synchrony and ambiguity in speech-gesture integration during comprehension. Journal of Cognitive Neuroscience, 23, 1845-1854. doi:10.1162/jocn.2010.21462
12. Hagoort, P., & Chu, M. (2012). The synchronization of speech and gesture. Paper presented at the International Society of Gestural Studies, Lund, Sweden.
13. Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15, 495-514. doi:10.3758/PBR.15.3.495
14. Jeannerod, M. (2001). Neural simulation of action: A unifying mechanism for motor cognition. Neuroimage, 14, S103-S109. doi:10.1006/nimg.2001.0832
15. Kelly, S. D., & Church, R. B. (1997). Can children detect conceptual information conveyed through other children’s nonverbal behaviors? Cognition and Instruction, 15(1), 107-134. doi:10.1207/s1532690xci1501_4
16. Kelly, S. D., & Church, R. B. (1998). A comparison between children’s and adult’s ability to detect conceptual information conveyed through representational gesture. Child Development, 69, 85-93.
17. Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language, 40, 577-592. doi:10.1006/jmla.1999.2634
18. Kelly, S. D., Kravitz, C., & Hopkins, M. (2004). Neural correlates of bimodal speech and gesture comprehension. Brain & Language, 89, 253-260. doi:10.1016/S0093-934X (03)00335-3
19. Kelly, S. D., Ozyurek, A., & Maris, E. (2010). Two sides of the same coin: Speech and gesture mutually interact to enhance comprehension. Psychological Science, 21, 260-267. doi:10.1177/0956797609357327
20. Kita, S., Ozurek, A., Allen, S. Brown, A. Furman, R.T. Ishizuka (2007). Relations between syntactic encoding and cospeech gestures: Implications for a model of speech and gesture production. Language and Cognitive Processes, 22, 1212-1236. doi:10.1080/01690960701461426
21. Loehr, D. (2007). Aspects of rhythm in gesture and speech. Gesture, 7(2), 179-214. doi:10.1075/gest.7.2.04loe
22. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
23. McNeill, D. (2012). How language began: Gesture and speech in human evolution. New York,NY: Cambridge University press.
24. McNeill, D., Cassell, J., & McCullough, K. (1994). Communicative effects of speech- mismatched gestures. Research on Language and Social Action, 27, 223-237.
25. McNeill, D., & Duncan, S. (2000). Growth points in thinking for speaking. In D. McNeill (Ed.), Language and gesture (pp. 141-161). Cambridge: Cambridge University Press.
26. Ping, R. M., & Goldin-Meadow, S. (2008). Hands in the air: Using ungrounded iconic gestures to teach children conservation of quantity. Developmental Psychology, 44, 1277-1287. doi:10.1037/0012-1649.44.5.1277
27. Rizzolatti, G., & Craighero, L. (2004). The mirror-neuron system. Annual Review of Neuroscience, 27, 169-192. doi:10.1146/annurev.neuro.27.070203.144230
28. Sloetjes, H., & Wittenburg, P. (2008). Annotation by category -ELAN and ISO DCR. In: Proceedings of the 6th International Conference on Language Resources and Evaluation (LREC 2008). http://www.lrec-conf.org/lrec2008/
29. The LREC is a conference that publishes it's proceedings on-line. There is no reference to a publisher, the website is the following: http://www.lrec-conf.org/lrec2008/
30. Thompson, L. A., Driscoll, D., & Markson, L. (1998). Memory for visual-spoken language in children and adults. Journal of Nonverbal Behavior, 22(3), 167-187. doi:10.1023/A:1022914521401
31. Thompson, L. A., & Massaro, D. W. (1994). Children’s integration of speech and pointing gestures in comprehension. Journal of Experimental Child Psychology, 57, 327-354. doi:10.1006/jecp.1994.1016
32. Wachsmuth, I. (2002). Communicative rhythm in gesture and speech. Amsterdam: John Benjamins Publishing Company.
33. Willems, R. M., Ozyurek, A., & Hagoort, P. (2007). When language meets action: The neural integration of gesture and speech. Cerebral Cortex, 17, 2322-2333. doi:10.1093/cercor/bhl141