From Hands to Minds: Gestures Promote Action Understanding

Building Bridges Across Cognitive Sciences Around the World - Proceedings of the 34th Annual Meeting of the Cognitive Science Society, CogSci 2012

Volumn , Issue , 2012, Pages 551-556

  Kang, Seokmin ^a   Tversky, Barbara ^a,b   Black, John B ^a  

^a Columbia University ^*  (United States)

^b STANFORD UNIVERSITY   (United States)

Author keywords

complex systems; diagram; gesture; knowledge construction

Indexed keywords

DIAGRAM; DYNAMIC CONCEPTS; DYNAMIC INFORMATION; GESTURE; KNOWLEDGE CONSTRUCTION;

CONVEYING;

EID: 84872710521     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (31)

1. Bavelas, J. B. (1994). Gestures as part of speech: Methodological implications. Research on Language and Social Interaction, 27, 201-221.
2. Beattie, G., & Shovelton, H. (1999). Do iconic hand gestures really contribute anything to the semantic information conveyed by speech? An experimental investigation. Semiotica, 123, 1-30.
3. Becvar, A., Hollan, J., & Hutchins, E. (2008). Representational gestures as cognitive artifacts for developing theories in a scientific laboratory. In M. S. Ackerman, C. A. Halverson, T. Erickson, & W. A. Kellogg (Eds.) Resources, Co-Evolution and Artifacts: Theory in CSCW (pp. 117-143). London, England: Springer-Verlag.
4. Chu, M. & Kita, S. (2011). The nature of gestures’ beneficial role in spatial problem solving. Journal of Experimental Psychology, 140, 102-116.
5. Church, R. B., & Goldin-Meadow, S. (1986). The mismatch between gesture and speech as an index of transitional knowledge. Cognition, 23, 43-71.
6. Emmorey, K., Tversky, B., & Taylor, H. (2000). Using space to describe space: Perspective in speech, sign, and gesture. Journal of Spatial Cognition and Computation, 2, 157-180.
7. Engle, R. A. (1998). Not channels but composite signals: Speech, gesture, diagrams, and object demonstrations are integrated in multimodal explanations. In M. A. Gernsbacher & S. J. Derry (Eds.), Proceedings of the Twentieth Annual Conference of the Cognitive Science Society (pp. 321-326). Mahwah, NJ: Erlbaum.
8. Field, J. (2005). Intelligibility and the Listener: The Role of Lexical Stress. TESOL Quarterly, 39, 399-423.
9. Goldin-Meadow, S. (2003). Hearing gesture: How our hands help us think. Cambridge: Belknap Press.
10. Goldin-Meadow, S., Cook, S. W., & Mitchell, Z. A. (2009). Gesturing gives children new ideas about math. Psychological Science, 20, 267– 272.
11. Goldin-Meadow, S., Kim, S., & Singer, M. (1999). What the teacher’s hands tell the student’s mind about math. Journal of Educational Psychology, 91, 720-730.
12. Hmelo-Silver, C. E., & Pfeffer, M. G. (2004). Comparing expert and novice understanding of a complex system from the perspective of structures, behaviors, and functions. Cognitive Science, 1, 127–138.
13. Hegarty, M., Mayer, S., Kriz, S., & Keehner, M. (2005). The role of gestures in mental animation. Spatial Cognition and Computation, 5, 333-356.
14. Heiser, J., & Tversky, B. (2006). Arrows in comprehending and producing mechanical diagrams. Cognitive Science, 30, 581-592.
15. Heuven, V. J. van (1988). Effects of stress and accent on the human recognition of word fragments in spoken context: gating and shadowing, Proceedings of the 7th FASE/Speech-88 Symposium, edited by W.A. Ainsworth and J.N. Holmes, 811-818. Edinburgh: Institute of Acoustics.
16. Kessell, A. M. and Tversky, B. (2006). Gestures for thinking and explaining. Proceedings of the meetings of the Cognitive Science Society.
17. Kita, S., & Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. Journal of Memory and Cognition, 48, 16-32.
18. McGregor, K. K., Rohlfing, K. J., Bean, A., & Marschner, E. (2009). Journal of Child Language, 36, 807-828.
19. McNeill, D. (1992). Hand and mind. Chicago: University of Chicago Press.
20. Perry, M., Church, R. B. & Goldin-Meadow, S. (1988). Transitional knowledge in the acquisition of concepts. Cognitive Development, 3, 359-400.
21. Ping, R., & Goldin-Meadow, S. (2008). Hands in the air: Using ungrounded iconic gestures to teach children conservation of quantity. Developmental Psychology, 44, 1277-1287.
22. Rizzolatti, G., & Arbib, M. A. (1998) Language within our grasp, Trends in Neurosciences, 21, 188-194
23. Schwartz, D. L., & Black, J. B. (1996). Shuttling between depictive models and abstract rules. Cognitive Science, 20, 457-497.
24. Singer, M. A., & Goldin-Meadow, S. (2005). Children learn when their teachers’ gestures and speech differ. Psychological Science, 16, 85-89.
25. Suwa, M., & Tversky, B. (1997). What architects and students perceive in their sketches: A protocol analysis. Design Studies, 18, 385-403.
26. Thompson, L. A., Driscoll, D., & Markson, L. (1998). Memory for visual-spoken language in children and adults. Journal of Nonverbal Behavior, 22, 167-187.
27. Tversky, B. (2011). Visualizations of thought. Topics in Cognitive Science, 3, 499-535.
28. Tversky, B., Heiser, J., Lee, P., & Daniel, M.P. (2009). Explanations in gesture, diagram, and word. In Coventry, K. R., Tenbrink. T., & Bateman, J. (Eds.), Spatial Language and Dialogue. Oxford: Oxford University Press.
29. Tversky, B., Heiser, J., MacKenzie, R., Lozano, S., and Morrison, J. B. (2007). Enriching animations. In R. Lowe and W. Schnotz, Learning with animation: Research implications for design. NY: Cambridge University Press.
30. Tversky, B., Morrison, J. B. & Betrancourt, M (2002). Animation: Can it facilitate? International Journal of Human Computer Studies. International Journal of Human Computer Studies, 57, 247-262.
31. Valenzeno, L., Alibali, M. W., & Klatzky, R. (2003). Teachers’ gestures facilitate students’ learning: A lesson in symmetry. Contemporary Educational Psychology, 28, 187-204.