Gesture gives a hand to language and learning: Perspectives from cognitive neuroscience, developmental psychology and education

Linguistics and Language Compass

Volumn 2, Issue 4, 2008, Pages 569-588

  Kelly, Spencer D ^a   Manning, Sarah M ^a   Rodak, Sabrina ^a  

^a Center for Language and Brain   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

EID: 65349088710     PISSN: None     EISSN: 1749818X     Source Type: Journal    
DOI: 10.1111/j.1749-818X.2008.00067.x     Document Type: Article

References (122)

1. Alibali, M. W. 1999. How children change their minds: Strategy change can be gradual or abrupt. Developmental Psychology 35.127-45.
2. Alibali, M. W., and S. Goldin-Meadow. 1993. Gesture-speech mismatch and mechanisms of learning: What the hands reveal about a child's state of mind. Cognitive Psychology 25.468-523.
3. Alibali, M. W., L. M. Flevares, and S. Goldin-Meadow. 1997. Assessing knowledge conveyed in gesture: Do teachers have the upper hand? Journal of Educational Psychology 89.183-93.
4. Alibali, M., S. Kita, and A. Young. 2000. Gesture and the process of speech production: We think, therefore we gesture. Language and Cognitive Processes 15.593-613
5. Allen, L. Q. 1995. The effects of emblematic gestures on the development and access of mental representations of French expressions. Modern Language Journal 79.521-9.
6. Armstrong, D. F. 1999. Original signs: Gesture, sign, and the sources of language. Washington, DC: Gallaudet University Press.
7. Azmitia, M., and M. Perlmutter. 1989. Social influences on children's cognition: State of the art and future directions. Advances in child development and behavior, ed.by H. W. Reese, Vol. 22, 89-144. New York, NY: Academic Press.
8. Ball, D. L. 1993. Halves, pieces, and twoths: Constructing and using representational contexts in teaching fractions. Rational numbers: An interaction of research, ed. by T. P. Carpenter, E. Fennema, and T. A. Romberg, 157-196. Hillsdale, NJ: Lawrence Erlbaum Associatesc.
9. Bates, E. 1976. Language and context: Studies in the acquisition of pragmatics. New York, NY: Academic Press.
10. Bates, E., and F. Dick. 2002. Language, gesture, and the developing brain. Developmental Psychobiology 40.293-310.
11. Bates, E., L. Benigni, I. Bretherton, L. Camaioni, and V. Volterra. 1979. The emergence of symbols: Cognition and communication in infancy. New York, NY: Academic Press.
12. Beattie, G., and H. Shovelton. 1999. Mapping the range of information contained in the iconic hand gestures that accompany spontaneous speech. Journal of Language and Social Psychology 18.438-62.
13. Bonda, E., M. Petrides, D. Ostry, and A. Evans. 1996. Specific involvement of human parietal systems and the amygdala in the perception of biological motion. Journal of Neuroscience 16.3737-44.
14. Brady, N. C., J. Marquis, K. Fleming, and L. McLean. 2004. Prelinguistic predictors of language growth in children with developmental disabilities. Journal of Speech, Language, and Hearing Research 47.663-77.
15. Broaders, S. C., S. W. Cook, Z. Mitchell, and S. Goldin-Meadow. 2007. Making children gesture brings out implicit knowledge and leads to learning. Journal of Experimental Psychology 136.539-50.
16. Buffington, D. M., P. J. Krantz, L. E. McClannahan, and C. L. Poulson. 1998. Procedures for teaching appropriate gestural communication skills to children with autism. Journal of Autism and Developmental Disorders 28.535-45.
17. Butcher, C., and S. Goldin-Meadow. 2000. Gesture and the transition from one- to two-word speech: When hand and mouth come together. Language and gesture, ed. by D. McNeill, 235-57. Cambridge, UK: Cambridge University Press.
18. Calculator, S. N. 2002. Use of enhanced natural gestures to foster interactions between children with Angelman syndrome and their parents. American Journal of Speech-Language Pathology 11.340-55.
19. Calvert, G. A., and T. Thesen. 2004. Multisensory integration: methodological approaches and emerging principles in the human brain. Journal of Physiology - Paris 98.191-205
20. Carpenter, T. P., E. Fennema, and M. L. Franke. 1996. Cognitively guided instruction: A knowledge base for reform in primary mathematics instruction. Elementary School Journal 97.3-20.
21. Carpenter, T. P., M. L. Franke, V. R. Jacobs, E. Fennema, and S. B. Empson. 1998. A longitudinal study of invention and understanding in children's multidigit addition and subtraction. Journal for Research in Mathematics Education 29.3-20.
22. Caselli, M. C., S. Vicari, E. Longobardi, L. Lami, C. Pizzoli, and G. Stella. 1998. Gestures and words in early development of children with Down syndrome. Journal of Speech, Language and Hearing Research 41.1125-35.
23. Cassell, J. 2007. The body in communication: Lessons from the near-human. Gesture and the dynamic dimension of language: Essays in honor of David McNeill, ed. by S. Duncan, J. Cassell, and E. Levy, 303-22. Amsterdam, The Netherlands: John Benjamins Publishing.
24. Cassell, J., T. Bickmore, L. Campbell, H. Vilhjalmsson, and H. Yan. 2001. More than just a pretty face: Conversational protocols and the aordances of embodiment. Knowledge-Based Systems 14.55-64.
25. Cassell, J., D. McNeill, and K. McCullough. 1999. Speech-gesture mismatches: Evidence for one underlying representation of linguistic and nonlinguistic information. Pragmatics & Cognition 71-34.
26. Cassell, J., St. Kopp, P. Tepper, K. Ferriman, and K. Striegnitz. 2007. Trading spaces: How humans and humanoids use speech and gesture to give directions. Conversational informatics, ed. by T. Nishida, 133-60. New York, NY: John Wiley &Sons.
27. Charman, T., A. Drew, and C. Baird. 2003. Measuring early language development in pre school children with autism spectrum disorder using the MacArthur Communicative Development Inventory (Infant Form). Journal of Child Language 30.213-36.
28. Church, R. B. 1999. Using gesture and speech to capture transitions in learning. Cognitive Development 14.313-42.
29. Church, R. B., and S. Ayman-Nolley. 1995. A microgenetic analysis of peer interaction: A bi-directional explanation of learning. Paper presented at the Biannual Meeting of the Society of Research in Child Development, Indianapolis, IN, November 2005.
30. Church, R. B., and S. Goldin-Meadow. 1986. The mismatch between gesture and speech as an index of transitional knowledge. Cognition 23.43-71.
31. Church, R. B., S. Ayman-Nolley, and M. W. Alibali. 2001. Cross-modal representation and deep learning. Paper presented at the Annual Meeting of the Cognitive Development Society, Virginia Beach, VA, October 2001.
32. Church, R. B., K. Schonert-Reichl, N. Goodman, S. D. Kelly, and S. Ayman-Nolley. 1995. The role of gesture and speech communication as reflections of cognitive understanding. Journal of Contemporary Legal Issues 6.123-54.
33. Church, R. B., S. Ayman-Nolley, and S. Mahootian. 2004. The role of gesture in bilingual education: Does gesture enhance learning? International Journal of Bilingual Education and Bilingualism 7.303-19.
34. Clark, H. H. 1996. Using language. Cambridge, UK: Cambridge University Press.
35. Cook, S. W., and S. Goldin-Meadow. 2006. The role of gesture in learning: Do children use their hands to change their minds? Journal of Cognition and Development 7(2).211-32.
36. Cook, S. W., Z. Mitchell, and S. Goldin-Meadow. 2008. Gesturing makes learning last. Cognition 106.1047-1058.
37. Corballis, M. C. 2003. From hand to mouth: The origins of language. Princeton, NJ: Princeton University Press.
38. Dapretto, M., M. S. Davies, J. H. Pfeifer, A. A. Scott, M. Sigman, S. Y. Bookheimer, and M. Iacoboni. 2006. Understanding emotions in others: mirror neuron dysfunction in children with autism spectrum disorders. Nature Neuroscience 9.28-30.
39. De Ruiter, J. P. A. 2000. The production of gesture and speech. Language and gesture: Window into thought and action, ed. by D. McNeill, 284-311. Cambridge, UK: Cambridge University Press.
40. Evans, J. L., M. W. Alibali, and N. M. McNeil. 2001. Divergence of verbal expression and embodied knowledge: Evidence from speech and gesture in children with specific language impairment. Language and Cognitive Processes 16.309-31.
41. Fernandez, E., L. M. Flevares, S. Goldin-Meadow, and T. Kurtzberg. 1996. The role of hand in teacher-student interaction. Paper presented at the Annual Meeting of the American Educational Research Association, New York, NY, April 1996.
42. Flevares, L. M., and M. Perry. 2001. How many do you see? The use of nonspoken representations in first-grade mathematics lessons. Journal of Educational Psychology 93.330-45.
43. Föel, A., T. Ellger, C. Breitenstein, and S. Knecht. 2003. Language perception activates the hand motor cortex: Implications for motor theories of speech perception. European Journal of Neuroscience 18.704-8.
44. Gallese, V., L. Fadiga, L. Fogassi, and G. Rizzolatti. 1996. Action recognition in the premotor cortex. Brain 119.593-609.
45. Gallese, V., C. Keysers, and G. Rizzolatti. 2004. A unifying view of the basis of social cognition. Trends in Cognitive Sciences 8.396-403.
46. Garber, P. 1997. Using gesture and speech to index planning in a problem-solving task: A comparative study of adults and children explaining the Tower of Hanoi. Unpublished doctoral dissertation, University of Chicago, Chicago, IL.
47. Goldin-Meadow, S. 2000. Beyond words: The importance of gesture to researchers and learners. Child Development 71.231-9.
48. Goldin-Meadow, S. 2003. Hearing gesture: How our hands help us think. Cambridge, MA: Belknap Press of Harvard University Press.
49. Goldin-Meadow, S., and C. M. Sandhofer. 1999. Gestures convey substantive information about a child's thoughts to ordinary listeners. Developmental Science 2.67-74.
50. Goldin-Meadow, S., M. Alibali, and R. B. Church. 1993. Transitions in concept acquisition: Using the hand to read the mind. Psychological Review 100.279-7.
51. Goldin-Meadow, S., H. Nusbaum, S. D. Kelly, and S. Wagner. 2001. Explaining math: Gesturing lightens the load. Psychological Science 12.516-22.
52. Goldin-Meadow, S., D. Wein, and C. Chang. 1992. Assessing knowledge through gesture: Using children's hands to read their minds. Cognition and Instruction 9.201-19.
53. Gullberg, M. 2006. Some reasons for studying gesture and second language acquisition. International Review of Applied Linguistics in Language Teaching (IRAL) 44.103-24.
54. Gunter, T. C., and P. Bach. 2004. Communicating hands: ERPs elicited by meaningful symbolic hand postures. Neuroscience Letters 372.52-6.
55. Harris, N. G. S., U. Bellugi, E. Bates, W. Jones, and M. Rossen. 1997. Contrasting profiles of language development in children with Williams and Down Syndromes. Developmental Neuropsychology 13.345-70.
56. Hickok, G., and D. Poeppel. 2000. Towards a functional neuroanatomy of speech perception. Trends in Cognitive Sciences 4.131-8.
57. Holle, H., and T. C. Gunter. 2007. The role of iconic gestures in speech disambiguation: ERP evidence. Journal of Cognitive Neuroscience 19.1175-92.
58. Holle, H., T. Gunter, S. A. Rüschemeyer, A. Hennenlotter, and M. Iacoboni. 2008. Neural correlates of the processing of co-speech gestures. NeuroImage 39.2010-24.
59. Hubbard, A. L., S. M. Wilson, and D. E. Callan. 2007. fMRI evidence of beat gesture/speech integration in non-primary auditory cortex, ISGS Abstracts 11A.91.
60. Iverson, J. M., and S. Goldin-Meadow. 1997. What's communication got to do with it? Gesture in children blind from birth. Developmental Psychology 33.453-67.
61. Iverson, J. M., and S. Goldin-Meadow. 1998. Why people gesture when they speak. Nature 396.228.
62. Iverson, J. M., O. Capirci, and M. C. Caselli. 1994. From communication to language in two modalities. Cognitive Development 9.23-43.
63. Iverson, J. M., E. Longobardi, and M. C. Caselli. 2003. Relationship between gestures and words in children with Down's syndrome and typically developing children in the early stages of communicative development. International Journal of Language and Communication Disorders 38.179-97.
64. Jancovic, M., S. Devoe, and M. Wiener. 1975. Age-related changes in hand and arm movements as nonverbal communication: Some conceptualizations and an empirical exploration. Child Development 46.922-8.
65. Kelly, S. D., and R. B. Church. 1997. Children's ability to detect nonverbal behaviors from other children. Cognition and Instruction 15.107-34.
66. Kelly, S. D., and R. B. Church. 1998. A comparison between children's and adults' ability to detect conceptual information conveyed through representational gestures. Child Development 69.85-93.
67. Kelly, S. D., D. J. Barr, R. B. Church, and K. Lynch. 1999. Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of Memory and Language 40.577-92.
68. Kelly, S. D., J. Iverson, J. Terranova, J. Niego, M. Hopkins, and L. Goldsmith. 2002a. Putting language back in the body: Speech and gesture on three timeframes. Developmental Neuropsychology 22.323-49.
69. Kelly, S. D., M. Singer, J. Hicks, and S. Goldin-Meadow. 2002b. A helping hand in assessing children's knowledge: Instructing adults to attend to gesture. Cognition and Instruction 20.1-26.
70. Kelly, S. D., C. Kravitz, and M. Hopkins. 2004. Neural correlates of bimodal speech and gesture comprehension. Brain and Language 89.253-60.
71. Kelly, S. D., M. Esch, and T. McDevitt. 2007. Neural correlates of learning Japanese words with and without iconic hand gesture. Cognitive Neuroscience Abstracts B 126.87.
72. Kelly, S. D., S. Ward, P. Creigh, and J. Bartolotti. 2007. An intentional stance modulates the integration of gesture and speech during comprehension. Brain and Language 101.222-33.
73. Kendon, A. 2004. Gesture: Visible action as utterance. Cambridge, UK: Cambridge University Press.
74. Kita, S., and A. Özyürek. 2003. What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language 48.16-32.
75. Kopp, S., and I. Wachsmuth. 2004. Synthesizing multimodal utterances for conversational agents. Computer Animation and Virtual Worlds 15.39-52.
76. Krauss, R. M. 1998. Why do we gesture when we speak? Current Directions in Psychological Science 7(2).54-60.
77. Krauss, R. M., P. Morrel-Samuels, and C. Colasante. 1991. Do conversational hand gestures communicate? Journal of Personality & Social Psychology 61(5).743-54.
78. Kutas, M., and S. A. Hillyard. 1980. Reading senseless sentences: Brain potentials reflect semantic incongruity. Science 207.203-5.
79. Luyster, R., S. Qiu, K. Lopez, and C. Lord. 2007. Predicting outcomes of children referred for autism using the MacArthur-Bates Communicative Development Inventory. Journal of Speech, Language, and Hearing Research 50.667-81.
80. Masur, E. F. 1983. Gestural development, dual-directional signaling, and the transition to words. Journal of Psycholinguistic Research 12.93-109.
81. McCathren, R. B. 2000. Teacher-implemented prelinguistic communication intervention. Focus on Autism and Other Developmental Disabilities 15.21-9.
82. McNeill, D. 1992. Hand and mind: What gestures reveal about thought. Chicago, IL: University of Chicago Press.
83. McNeill, D. 2005. Gesture and thought. Chicago, IL: University of Chicago Press.
84. McPherson, W. B., and P. J. Holcomb, 1999. An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology 36.53-65.
85. Mitchell, S., J. Brian, L. Zwaigenbaum, W. Roberts, P. Szatmari, I. Smith, and S. Bryson. 2006. Early language and communication development of infants later diagnosed with autism spectrum disorder. Journal of Development and Behavioral Pediatrics 27.69-78.
86. Montgomery, K. J., N. Isenberg, and J. V. Haxby, 2007. Communicative hand gestures and object-directed hand movements activated the mirror neuron system. Social Cognitive and Affective Neuroscience 2.114-22.
87. Morford, M., and S. Goldin-Meadow, 1992. Comprehension and production of gesture in combination with speech in one-word speakers. Journal of Child Language 19.559-80.
88. Moskowitz, G. 1976. The classroom interaction of outstanding foreign language teachers, Foreign Language Annals 9.135-57.
89. Mundy, P., C. Kasari, M. Sigman, and E. Ruskin. 1995. Nonverbal communication and early language acquisition in children with Down syndrome and in normally developing children. Journal of Speech and Hearing Research 38.157-67.
90. Nishitani, N., M. Schurmann, K. Amunts, and R. Hari. 2005. Broca's region: From action to language. Physiology 20.60-9.
91. Özyürek, A., and S. D. Kelly, 2007. Gesture, brain, and language. Brain and Language 101.181-4.
92. Özyürek, A., R. M. Willems, S. Kita, and P. Hagoort. 2007. On-line integration of semantic information from speech and gesture: insights from event-related brain potentials. Journal of Cognitive Neuroscience 19.605-16.
93. di Pellegrino, G., L. Fadiga, L. Fogassi, V. Gallese, and G. Rizzolatti. 1992. Understanding motor events: A neurophysiological study. Experimental Brain Research 91.176-80.
94. Perry, M., R. B. Church, and S. Goldin-Meadow. 1988. Transitional knowledge in the acquisition of concepts. Cognitive Development 3.359-400.
95. Perry, M., R. B. Church, and S. Goldin-Meadow. 1992. Is gesture-speech mismatch a general index of transitional knowledge? Cognitive Development 7.109-22.
96. Piaget, J. 1967. Six psychological studies. New York, NY: Random House.
97. Povinelli, D. J. 1993. Reconstructing the evolution of mind. American Psychologist 48.493-509.
98. Pozzer-Ardenghi, L., and W. M. Roth. 2007. On performing concepts during science lectures. Science Education 91.96-114.
99. Puce, A., and D. Perrett. 2003. Electrophysiology and brain imaging of biological motion. Philosophical Transactions of Royal Society of London, B. Biological Sciences 358.435-45.
100. Pulvermuller, F., O. Hauk, V. V. Nikulin, and R. J. Ilmoniemi. 2005. Functional links between motor and language systems. European Journal of Neuroscience 21.793-97.
101. Rizzolatti, G., and M. A. Arbib. 1998. Language within our grasp. Trends in Neurosciences 21.188-94.
102. Rugg, M. D., and T. Curran. 2007. Event-related potentials and recognition memory. Trends in Cognitive Sciences 11.251-7.
103. Sheehan, E., L. Namy, and D. Mills. 2007. Developmental changes in neural activity to familiar words and gestures. Brain and Language 101.246-59.
104. Singer, M. A., and S. Goldin-Meadow. 2005. Children learn when their teacher's gestures and speech differ. Psychological Science 16.85-9.
105. Skipper, J. I., S. Goldin-Meadow, H. C. Nusbaum, and S. L. Small. 2007. Speech-associated gestures, broca's area, and the human mirror system. Brain and Language 101.260-77.
106. Smith, V., P. Mirenda, and A. Zaidman-Zait. 2007. Predictors of expressive vocabulary growth in children with autism. Journal of Speech, Language, and Hearing Research 50.149-60.
107. Stefanini, S., M. C. Caselli, and V. Volterra. 2007. Spoken and gestural production in a naming task by young children with Down syndrome. Brain and Language 101.208-21.
108. Sueyoshi, A., and D. M. Hardison. 2005. The role of gestures and facial cues in second language listening comprehension. Language Learning 55.661-99.
109. Tettamanti, M., G. Buccino, M. C. Saccuman, V. Gallese, M. Danna, P. Scifo, et al. 2005. Listening to action-related sentences activates fronto-parietal motor circuits. Journal of Cognitive Neuroscience 17.273-81.
110. Thal, D. J., and E. Bates. 1988. Language and gesture in late talkers. Journal of Speech and Hearing Research 31.115-23.
111. Thal, D. J., L. O'Hanlon, M. Clemmons, and L. Fralin. 1999. Validity of a parent report measure of vocabulary and syntax for preschool children with language impairment. Journal of Speech, Language, and Hearing Research 42.482-96.
112. Wachsmuth, I. 2002. Communicative rhythm in gesture and speech. Language, vision, and music: Selected papers from the 8th International Workshop on the Cognitive Science of Natural Language Processing, Galway, Ireland 1999, ed. by C. Mulvihll, P. McKevitt, and S. Nuallain, 117-132. Amsterdam, The Netherlands: John Benjamins Publishing.
113. Wagner, S. M., H. Nusbaum, and S. Goldin-Meadow. 2004. Probing the mental representation of gesture: Is handwaving spatial? Journal of Memory and Language 50.395-407.
114. Whittaker, C. A., and J. Reynolds. 2000. Hand signaling in dyadic proximal communication: Social strengths of children with Autism who do not speak. Child Language Teaching and Therapy 16.43-57.
115. Willems, R. M., and P. Hagoort. 2007. Neural evidence for the interplay between language, gesture and action: A review. Brain and Language 101.278-98.
116. Willems, R. M., A. Özyürek, and P. Hagoort. 2007. When language meets action: The neural integration of gesture and speech. Cerebral Cortex 17.2322-33.
117. Williams, J. H. G., A. Whiten, T. Suddendorf, and D. I. Perrett. 2001. Imitation, mirror neurons and autism. Neuroscience and Biobehavioral Reviews 25.287-95.
118. Wilson, S. M., I. Molnar-Szakacs, and M. Iacoboni. 2008. Beyond superior temporal cortex: Intersubject correlations in narrative speech comprehension. Cerebral Cortex 18 230-42.
119. Wu, Y. C., and S. Coulson. 2007a. How iconic gestures enhance communication: An ERP study. Brain and Language 101.234-45.
120. Wu, Y. C., and S. Coulson. 2007b. Iconic gestures prime related concepts: An ERP study. Psychonomic Bulletin & Review 14.57-63.
121. Yoder, P. J., and S. F. Warren. 2001a. Intentional communication elicits language-facilitating maternal responses in dyads with children who have developmental disabilities. American Journal on Mental Retardation 106.327-35.
122. Yoder, P. J., and S. F. Warren. 2001b. Relative treatment effects of two prelinguistic communication interventions on language development in toddlers with developmental delays vary by maternal characteristics. Journal of Speech, Language, and Hearing Research 44.224-3.