Gesture as representational action: A paper about function

Psychonomic Bulletin and Review

Volumn 24, Issue 3, 2017, Pages 652-665

  Novack, Miriam A ^a   Goldin Meadow, Susan ^a  

^a UNIVERSITY OF CHICAGO   (United States)

Author keywords

Action; Gesture; Learning; Representations

Indexed keywords

COMPREHENSION; GESTURE; HUMAN; LEARNING; SPEECH; THINKING;

COMPREHENSION; GESTURES; HUMANS; LEARNING; SPEECH; THINKING;

EID: 84986322575     PISSN: 10699384     EISSN: 15315320     Source Type: Journal    
DOI: 10.3758/s13423-016-1145-z     Document Type: Article

References (114)

1. Acredolo, L. P., & Goodwyn, S. W. (1985). Symbolic gesturing in language development: A case study. Human Development, 28, 40–49. doi:10.1159/000272934
2. Acredolo, L., & Goodwyn, S. (1988). Symbolic gesturing in normal infants. Child Development, 59, 450–466. doi:10.2307/1130324
3. Ambrosini, E., Reddy, V., de Looper, A., Costantini, M., Lopez, B., & Sinigaglia, C. (2013). Looking ahead: Anticipatory gaze and motor ability in infancy. PLoS One, 8, e67916. doi:10.1371/journal.pone.0067916
4. Baldwin, D. A., & Baird, J. A. (2001). Discerning intentions in dynamic human action. Trends in Cognitive Sciences, 5, 171–178. doi:10.1016/S1364-6613(00)01615-6
5. Bates, E. (1976). Language and context: The acquisition of pragmatics (Vol. 13). New York: Academic Press.
6. Bates, E., Camaioni, L., & Volterra, V. (1975). The acquisition of performatives prior to speech. Merrill-qalmer Quarterly of Behavior and Development, 21, 205–226.
7. Behne, T., Carpenter, M., & Tomasello, M. (2014). Young children create iconic gestures to inform others. Developmental Psychology, 50, 2049–2060. doi:10.1037/a0037224
8. Behne, T., Liszkowski, U., Carpenter, M., & Tomasello, M. (2012). Twelve-month-olds’ comprehension and production of pointing. British Journal of Developmental Psychology, 30, 359–375. doi:10.1111/j.2044-835X.2011.02043.x
9. Beilock, S. L., & Goldin-Meadow, S. (2010). Gesture changes thought by grounding it in action. Psychological Science, 21, 1605–1610. doi:10.1177/0956797610385353
10. Beilock, S. L., Lyons, I. M., Mattarella-Micke, A., Nusbaum, H. C., & Small, S. L. (2008). Sports experience changes the neural processing of action language. Proceedings of the National Academy of Sciences of the United States of America, 105, 13269–13273. doi:10.1073/pnas.0803424105
11. Bernardis, P., & Gentilucci, M. (2006). Speech and gesture share the same communication system. Neuropsychologia, 44, 178–190. doi:10.1016/j.neuropsychologia.2005.05.007
12. Bower, G. H., & Rinck, M. (1999). Goals as generators of activation in narrative understanding. In S. R. Goldman, A. C. Graesser, & P. van den Broek (Eds.), Narrative comprehension, causality, and coherence: Essays in honor of Tom Trabasso (pp. 111–134). Mahwah: Erlbaum.
13. Brooks, N., & Goldin-Meadow, S. (2015). Moving to learn: How guiding the hands can set the stage for learning. Cognitive Science. doi:10.1111/cogs.12292
14. Cartmill, E. A., Hunsicker, D., & Goldin-Meadow, S. (2014). Pointing and naming are not redundant: Children use gesture to modify nouns before they modify nouns in speech. Developmental Psychology, 50, 1660–1666. doi:10.1037/a0036003
15. Casile, A., & Giese, M. A. (2006). Nonvisual motor training influences biological motion perception. Current Biology, 16, 69–74. doi:10.1016/j.cub.2005.10.071
16. Church, R. B., Garber, P., & Rogalski, K. (2007). The role of gesture in memory and social communication. Gesture, 7, 137–158. doi:10.1075/gest.7.2.02bre
17. Church, R. B., Kelly, S., & Holcombe, D. (2014). Temporal synchrony between speech, action and gesture during language production. Language, Cognition and Neuroscience, 29, 345–354. doi:10.1080/01690965.2013.857783
18. Clark, H. H. (1996). Using language. Cambridge, GB: Cambridge Univ. Press.
19. Congdon, E. L., & Levine, S. C. (2016) Learning to measure through action and gesture: Children’s starting state matters. Manuscript submitted for publication.
20. Congdon, E. L., Novack, M. A., Brooks, N. B., Hemani-Lopez, N., O’Keefe, L. & Goldin-Meadow, S. (2016). Better together: Simultaneous presentation of speech and gesture in math instruction supports generalization and retention. Manuscript submitted for publication.
21. Cook, S. W., Duffy, R. G., & Fenn, K. M. (2013). Consolidation and transfer of learning after observing hand gesture. Child Development, 84, 1863–1871. doi:10.1111/cdev.12097
22. Cook, S. W., Mitchell, Z., & Goldin-Meadow, S. (2008). Gesturing makes learning last. Cognition, 106, 1047–1058. doi:10.1016/j.cognition.2007.04.010
23. Cook, S. W., & Tanenhaus, M. K. (2009). Embodied communication: Speaker’s gestures affect listeners’ actions. Cognition, 113, 98–104. doi:10.1016/j.cognition.2009.06.006.Embodied
24. Cook, S. W., Yip, T. K., & Goldin-Meadow, S. (2012). Gestures, but not meaningless movements, lighten working memory load when explaining math. Language and Cognitive Processes, 27, 594–610. doi:10.1080/01690965.2011.567074
25. DeLoache, J. S. (1995). Early understanding and use of symbols: The model model. Current Directions in Psychological Science, 4, 109–113. doi:10.1111/1467-8721.ep1077240
26. Driskell, J. E., & Radtke, P. H. (2003). The effect of gesture on speech production and comprehension. Human Factors: The Journal of the Human Factors and Ergonomics Society, 45, 445–454. doi:10.1518/hfes.45.3.445.27258
27. Filippi, C., & Woodward, A. L. (2016). Action experience changes attention to kinematic cues. Frontiers in Psychology, 7, 19. doi:10.3389/fpsyg.2016.00019
28. Gerson, S. A., & Woodward, A. L. (2014). Learning from their own actions: The unique effect of producing actions on infants’ action understanding. Child Development, 85, 264–277. doi:10.1111/cdev.12115
29. Gibson, E., Piantadosi, S. T., Brink, K., Bergen, L., Lim, E., & Saxe, R. (2013). A noisy-channel account of crosslinguistic word order variation. Psychological Science, 24, 1079–1088. doi:10.1177/0956797612463705
30. Goldin-Meadow, S. (2003). Hearing gesture: How our hands help us think. Cambridge, MA: Harvard University Press.
31. Goldin-Meadow, S. (2014). How gesture helps children learn language. In I. Arnon, M. Tice, C. Kurumada, & B. Estigarribia (Eds.), Language in interaction: Studies in honor of Eve V. Clark (pp. 157–171). Amsterdam: John Benjamins.
32. Goldin-Meadow, S., & Beilock, S. L. (2010). Action’s influence on thought: The case of gesture. Perspectives on Psychological Science, 5, 664–674. doi:10.1177/1745691610388764
33. Goldin-Meadow, S., & Brentari, D. (in press). Gesture, sign and language: The coming of age of sign language and gesture studies. Behavioral and Brain Sciences. online first. doi:10.1017/S0140525X15001247
34. Goldin-Meadow, S., & Butcher, C. (2003). Pointing toward two-word speech in young children. In S. Kita (Ed.), Pointing: Where language, culture, and cognition meet (pp. 85–107). Mahwah, NJ: Earlbaum Associates.
35. Goldin-Meadow, S., Cook, S. W., & Mitchell, Z. A. (2009). Gesturing gives children new ideas about math. Psychological Science, 20, 267–272. doi:10.1111/j.1467-9280.2009.02297
36. Goldin-Meadow, S., Levine, S. L., Zinchenko, E., Yip, T. K.-Y., Hemani, N., & Factor, L. (2012). Doing gesture promotes learning a mental transformation task better than seeing gesture. Developmental Science, 15, 876–884. doi:10.1111/j.1467-7687.2012.01185.x
37. Goldin-Meadow, S., McNeill, D., & Singleton, J. (1996). Silence is liberating: Removing the handcuffs on grammatical expression in the manual modality. Psychological Review, 103, 34–55.
38. Goldin-Meadow, S., Nusbaum, H., Kelly, S. D., & Wagner, S. (2001). Explaining math: gesturing lightens the load. Psychological Science, 12, 516–522. doi:10.1111/1467-9280.00395
39. Goldin-Meadow, S., & Sandhofer, C. M. (1999). Gesture conveys substantive information about a child’s thoughts to ordinary listeners. Developmental Science, 2, 67–74. doi:10.1037/0033-295X.103.1.34
40. Goldin-Meadow, S., So, W. C., Ozyurek, A., & Mylander, C. (2008). The natural order of events: How speakers of different languages represent events nonverbally. Proceedings of the National Academy of Sciences, 105, 9163–9168. doi:10.1073/pnas.0710060105
41. Goodrich, W., & Hudson Kam, C. L. (2009). Co-speech gesture as input in verb learning. Developmental Science, 12, 81–87. doi:10.1111/j.1467-7687.2008.00735.x
42. Graham, J. A., & Heywood, S. (1975). The effects of elimination of hand gestures and of verbal codability on speech performance. European Journal of Social Psychology, 5, 189–195. doi:10.1002/ejsp.2420050204
43. Hall, M. L., Ferreira, V. S., & Mayberry, R. I. (2013). Investigating constituent order change with elicited pantomime: A functional account of SVO emergence. Cognitive Science, 38, 943–972. doi:10.1111/cogs.12105
44. Hodges, L. E., Özçalışkan, Ş., & Williamson, R. A. (2015). How early do children understand different types of iconicity in gesture? Proceedings of the 39th Boston University conference on language development. Somerville, MA: Cascadilla Press.
45. Hostetter, A. B. (2011). When do gestures communicate? A meta-analysis. Psychological Bulletin, 137, 297–315. doi:10.1037/a0022128
46. Hostetter, A. B., & Alibali, M. W. (2008). Visible embodiment: Gestures as simulated action. Psychonomic Bulletin & Review, 15, 495–514. doi:10.3758/PBR.15.3.495
47. Iverson, J. M., Capirci, O., & Caselli, M. C. (1994). From communication to language in two modalities. Cognitive Development, 9, 23–43. doi:10.1016/0885-2014(94)90018-3
48. Iverson, J. M., & Goldin-Meadow, S. (2005). Gesture paves the way for language development. Psychological Science, 16, 368–371. doi:10.1111/j.0956-7976.2005.01542.x
49. James, K. H. (2010). Sensori-motor experience leads to changes in visual processing in the developing brain. Developmental Science, 13, 279–288. doi:10.1111/j.1467-7687.2009.00883.x
50. James, K. H., & Atwood, T. P. (2009). The role of sensorimotor learning in the perception of letter-like forms: Tracking the causes of neural specialization for letters. Cognitive Neuropsychology, 26, 91–110. doi:10.1080/02643290802425914
51. James, K. H., & Swain, S. N. (2011). Only self-generated actions create sensori-motor systems in the developing brain. Developmental Science, 14, 673–678. doi:10.1111/j.1467-7687.2010.01011.x
52. Kelly, S. D. (2001). Broadening the units of analysis in communication: Speech and nonverbal behaviours in pragmatic comprehension. Journal of Child Language, 28, 325–349. doi:10.1017/S0305000901004664
53. Kelly, S. D., Barr, D. J., Church, R. B., & Lynch, K. (1999). Offering a hand to pragmatic understanding: The role of speech and gesture in comprehension and memory. Journal of memory and Language, 40, 577–592. doi:10.1006/jmla.1999.2634
54. Kelly, S. D., Özyürek, A., & Maris, E. (2010). Two sides of the same coin: Speech and gesture manually interact to enhance comprehension. Psychological Science, 21, 260–267. doi:10.1177/0956797609357327
55. Kelly, S. D., Healy, M., Özyürek, A., & Holler, J. (2014). The processing of speech, gesture, and action during language comprehension. Psychonomic Bulletin & Review, 22, 517–523. doi:10.3758/s13423-014-0681-7
56. Kendon, A. (1980). Gesticulation and speech: Two aspects of the process of utterance. In M. R. Key (Ed.), The relationship of verbal and nonverbal communication (pp. 207–227). The Hague, the Netherlands: Mouton.
57. Kendon, A. (2004). Gesture: Visible action as utterance. Cambridge: Cambridge University Press.
58. Kimura, D. (1973). Manual activity during speaking–I. Righthanders. Neuropsychologia, 11, 45–50. doi:10.1016/0028-3932(73)90063-8
59. Kirsh, D. (2010). Thinking with the body. In S. Ohlsson & R. Catrambone (Eds.), Proceedings of the 32nd annual conference of the cognitive science society (pp. 2864–2869). Austin, TX: Cognitive Science Society. doi:10.1145/2037296.2037303
60. Kirsh, D. (2011). How marking in dance constitutes thinking with the body. Versus: Quaderni di Studi Semiotici, 113–115, 179–210.
61. Kita, S. (2000). How representational gestures help speaking. In D. McNeill (Ed.), Language and gesture (pp. 162–185). Cambridge, UK: Cambridge University Press.
62. Kita, S. (2009). Cross-cultural variation of speech-accompanying gesture: A review. Language and Cognitive Processes, 24(2), 145–167. doi:10.1080/01690960802586188
63. Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal?: Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Language, 48, 16–32. doi:10.1016/S0749-596X(02)00505-3
64. Kontra, C., Goldin-Meadow, S., & Beilock, S. L. (2012). Embodied learning across the life span. Topics in Cognitive Science, 4, 731–739. doi:10.1111/j.1756-8765.2012.01221.x
65. Kontra, C., Lyons, D. J., Fischer, S. M., & Beilock, S. L. (2015). Physical experience enhances science learning. Psychological Science, 26, 737–749. doi:10.1177/0956797615569355
66. Krehm, M., Onishi, K. H., & Vouloumanos, A. (2014). I see your point: Infants under 12 months understand that pointing is communicative. Journal of Cognition and Development, 15, 527–538. doi:10.1080/15248372.2012.736112
67. Lang, J. W. (1976). Amphibious behavior of Alligator mississippiensis: Roles of a circadian rhythm and light. Science, 191, 575–577. doi:10.1126/science.1251194
68. LeBarton, E. S., Goldin-Meadow, S., & Raudenbush, S. (2015). Experimentally-induced increases in early gesture lead to increases in spoken vocabulary. Journal of Cognition and Development, 16, 199–220. doi:10.1080/15248372.2013.858041
69. Loehr, D. (2007). Aspects of rhythm in gesture and speech. Gesture, 7, 179–214.
70. Longcamp, M., Anton, J. L., Roth, M., & Velay, J. L. (2003). Visual presentation of single letters activates a premotor area involved in writing. NeuroImage, 19, 1492–1500. doi:10.1016/S1053-8119(03)00088-0
71. Lucca, K. R., & Wilborn, P. M. (2016). Communicating to learn: Infants’ pointing gestures facilitate fast mapping. Manuscript submitted for publication.
72. Macedonia, M., Muller, K., & Friederici, A. D. (2011). The impact of iconic gestures on foreign language word learning and its neural substrate. Human Brain Mapping, 32, 982–998. doi:10.1002/hbm.21084
73. Marentette, P., & Nicoladis, E. (2011). Preschoolers’ interpretations of gesture: Label or action associate? Cognition, 121, 386–399. doi:10.1016/j.cognition.2011.08.012
74. McNeil, N., Alibali, M., & Evans, J. L. (2000). The role of gesture in children's language comprehension: Now they need it, now they don't. Journal of Nonverbal Behavior, 24, 131–150. doi:10.1006/jmla.2000.2752
75. McNeil, N. M., Uttal, D. H., Jarvin, L., & Sternberg, R. J. (2009). Should you show me the money? Concrete objects both hurt and help performance on mathematics problems. Learning and Instruction, 19, 171–184. doi:10.1016/j.learninstruc.2008.03.005
76. McNeill, D. (1992). Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
77. Mix, K. S. (2010). Spatial tools for mathematical thought. In K. S. Mix, L. B. Smith, & M. Gasser (Eds.), Space and language. New York: Oxford University Press.
78. Namy, L. L. (2008). Recognition of iconicity doesn’t come for free. Developmental Science, 11, 841–846. doi:10.1111/j.1467-7687.2008.00732.x
79. Namy, L. L., Campbell, A. L., & Tomasello, M. (2004). The changing role of iconicity in non-verbal symbol learning: A U-shaped trajectory in the acquisition of arbitrary gestures. Journal of Cognition and Development, 5, 37–57. doi:10.1207/s15327647jcd0501_3
80. Newell, A., & Simon, H. A. (1972). Human problem-solving. EnglewoodCliffs, NJ: Prentice-Hall.
81. Nicoladis, E., Mayberry, R. I., & Genesee, F. (1999). Gesture and early bilingual development. Developmental Psychology, 35, 514. doi:10.1037/0012-1649.35.2.514
82. Novack, M. A., Congdon, E., Hemani-Lopez, N., & Goldin-Meadow, S. (2014). From action to abstraction: Using the hands to learn math. Psychological Science, 25, 903–910. doi:10.1177/0956797613518351
83. Novack, M. A., Filippi, C., Goldin-Meadow, S., & Woodward, A. (2016). Actions speak louder than gestures when you are 2-years-old. Mansucript submitted for publication.
84. Novack, M., & Goldin-Meadow, S. (2015). Learning from gesture: How our hands change our minds. Educational Psychology Review, 27, 205–412. doi:10.1007/s10648-015-9325-3
85. Novack, M. A., Goldin-Meadow, S., & Woodward, A. (2015). Learning from gesture: How early does it happen? Cognition, 142, 138–147. doi:10.1016/j.cognition.2015.05.018
86. Novack, M. A., Wakefield, E. M., & Goldin-meadow, S. (2016). What makes a movement a gesture? Cognition, 146, 339–348. doi:10.1016/j.cognition.2015.10.014
87. Özçalışkan, Ş., & Goldin-Meadow, S. (2005). Do parents lead their children by the hand? Journal of Child Language, 32, 481–505. doi:10.1017/S0305000905007002
88. Özçalışkan, Ş., & Goldin-Meadow, S. (2011). Is there an iconic gesture spurt at 26 months. Integrating gestures: The interdisciplinary nature of gesture. Amsterdam, NL: John Benjamins.
89. Özçalışkan, S., Lucero, C., & Goldin-Meadow, S. (2016). Does language shape silent gesture? Cognition, 148, 10–18. doi:10.1016/j.cognition.2015.12.001
90. Ping, R. M., & Goldin-Meadow, S. (2008). Hands in the air: Using ungrounded iconic gestures to teach children conservation of quantity. Developmental Psychology, 44, 1277–1287. doi:10.1037/0012-1649.44.5.1277
91. Ping, R., Goldin-Meadow, S., & Beilock, S. (2014). Understanding gesture: Is the listener’s motor system involved. Journal of Experimental Psychology: General, 143, 195–204. doi:10.1037/a0032246
92. Prinz, W. (1997). Perception and action planning. European Journal of Cognitive Psychology, 9, 129–154. doi:10.1080/713752551
93. Rauscher, F., Krauss, R. M., & Chen, Y. (1996). Gesture, speech, and lexical access: The role of lexical movements in speech production. Psychological Science, 7, 226–231. doi:10.1111/j.1467-9280.1996.tb00364.x
94. Rowe, M. L., & Goldin-Meadow, S. (2009). Differences in early gesture explain SES disparities in child vocabulary size at school entry. Science, 323, 951–953. doi:10.1126/science.1167025
95. Schachner, A., & Carey, S. (2013). Reasoning about “irrational” actions: When intentional movements cannot be explained, the movements themselves are seen as the goal. Cognition, 129, 309–327. doi:10.1016/j.cognition.2013.07.006
96. Searle, J. R. (1980). The intentionality of intention and action. Inquiry, 22, 253–280. doi:10.1080/00201747908601876
97. Singer, M. A., & Goldin-Meadow, S. (2005). Children learn when their teacher’s gestures and speech differ. Psychological Science, 16, 85–89. doi:10.1111/j.0956-7976.2005.00786.x
98. Sommerville, J. A., Woodward, A. L., & Needham, A. (2005). Action experience alters 3-month-old infants’ perception of others’ actions. Cognition, 96, B1–B11. doi:10.1016/j.cognition.2004.07.004
99. Sueyoshi, A., & Hardison, D. M. (2005). The role of gestures and facial cues in second language listening comprehension. Language Learning, 55, 661–699. doi:10.1111/j.0023-8333.2005.00320.x
100. Thomas, L. E., & Lleras, A. (2009). Swinging into thought: Directed movement guides insight in problem solving. Psychonomic Bulletin & Review, 16, 719–723. doi:10.3758/PBR.16.4.719
101. Tolar, T. D., Lederberg, A. R., Gokhale, S., & Tomasello, M. (2008). The development of the ability to recognize the meaning of iconic signs. Journal of Deaf Studies and Deaf Education, 13, 225–240. doi:10.1093/deafed/enm045
102. Tomasello, M., Carpenter, M., & Liszkowski, U. (2007). A new look at infant pointing. Child Development, 78, 705–722. doi:10.1111/j.1467-8624.2007.01025.x
103. Trabasso, T., & Nickels, M. (1992). The development of goal plans of action in the narration of a picture story. Discourse Processes, 15, 249–275. doi:10.1080/01638539209544812
104. Trofatter, C., Kontra, C., Beilock, S., & Goldin-Meadow, S. (2014). Gesturing has a larger impact on problem-solving than action, even when action is accompanied by words. Language, Cognition and Neuroscience, 30, 251–260. doi:10.1080/23273798.2014.905692
105. Uttal, D., Scudder, K., & DeLoache, J. (1997). Manipulatives as symbols: A new perspective on the use of concrete objects to teach mathematics. Journal of Applied Developmental Psychology, 18, 37–54. doi:10.1016/S0193-3973(97)90013-7
106. Valenzeno, L., Alibali, M. W., & Klatzky, R. (2003). Teachers’ gestures facilitate students’ learning: A lesson in symmetry. Contemporary Educational Psychology, 28, 187–204. doi:10.1016/S0361-476X(02)00007-3
107. Vouloumanos, A., Onishi, K. H., & Pogue, A. (2012). Twelve-month-old infants recognize that speech can communicate unobservable intentions. Proceedings of the National Academy of Sciences of the United States of America, 109, 12933–12937. doi:10.1073/pnas.112105710
108. Wagner, S., Nusbaum, H., & Goldin-Meadow, S. (2004). Probing the mental representation of gesture: Is handwaving spatial? Journal of Memory and Language, 50, 395–407. doi:10.1016/j.jml.2004.01.002
109. Wakefield, E. M., Congdon, E. L, Novack, M. A., Goldin-Meadow, S., & James, K. (2016). Learning math by hand: The neural effects of gesture-based instruction in 8-year-old children. Manuscript submitted for publication.
110. Wilson, M. (2002). Six views of embodied cognition. Psychonomic Bulletin & Review, 9, 625–636. doi:10.3758/BF03196322
111. Woodward, A. L. (1998). Infants selectively encode the goal object of an actor’s reach. Cognition, 69, 1–34. doi:10.1016/S0010-0277(98)00058-4
112. Woodward, A. L., & Guajardo, J. J. (2002). Infants’ understanding of the point gesture as an object-directed action. Cognitive Development, 17, 1061–1084. doi:10.1016/S0885-2014(02)00074-6
113. Yoon, J. M., Johnson, M. H., & Csibra, G. (2008). Communication-induced memory biases in preverbal infants. Proceedings of the National Academy of Sciences, 105, 13690–13695. doi:10.1073/pnas.0804388105
114. Zacks, J. M., Tversky, B., & Iyer, G. (2001). Perceiving, remembering, and communicating structure in events. Journal of Experimental Psychology: General, 130, 29–58. doi:10.1037/0096-3445.130.1.29