Gesturing meaning: Non-action words activate the motor system

Frontiers in Human Neuroscience

Volumn 4, Issue , 2010, Pages

  Bach, Patric ^a,b   Griffiths, Debra ^a   Weigelt, Matthias ^c   Tipper, Steven P ^a  

^a BANGOR UNIVERSITY   (United Kingdom)

^b UNIVERSITY OF PLYMOUTH   (United Kingdom)

^c SAARLAND UNIVERSITY   (Germany)

Author keywords

Affordances; Gesture; Ideomotor theories; Language; Object shape; Stimulus response compatibility

Indexed keywords

ADULT; ARTICLE; COLOR VISION; CONTROLLED STUDY; EXECUTIVE FUNCTION; FEMALE; GESTURE; HAND MOVEMENT; HUMAN; HUMAN EXPERIMENT; LOCOMOTION; MALE; MOTOR ACTIVITY; MOTOR PERFORMANCE; MOTOR SYSTEM; MOVEMENT PERCEPTION; OBJECT RELATION; SEMANTICS; VERBAL MEMORY; VISUAL SYSTEM FUNCTION;

EID: 79953020190     PISSN: 16625161     EISSN: 16625161     Source Type: Journal    
DOI: 10.3389/fnhum.2010.00214     Document Type: Article

References (73)

1. Alibali, M. W. (2005). Gesture in spatial cognition: expressing, communicating, and thinking about spatial information. Spat. Cogn. Comput. 5, 307-331.
2. Alibali, M. W., Spencer, R. C., and Kita, S. (2004). "Spontaneous gestures influence strategy choice in problem solving," in Paper presented at the Biennial Meeting of the Society for Research in Child Development, Atlanta, GA.
3. Bach, P., Peatfield, N. A., and Tipper, S. P. (2007). Focusing on body sites: the role of spatial attention in action perception. Exp. Brain Res. 178, 509-517.
4. Bach, P., and Tipper, S. P. (2006). Bend it like Beckham: embodying the motor skills of famous athletes. Q. J. Exp. Psychol. 59, 2033-2039.
5. Bach, P., and Tipper, S. P. (2007). Implicit action encoding influences personal- trait judgments. Cognition 102, 151-78.
6. Baron, R. M., and Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: conceptual, strategic and statistical considerations. J. Pers. Soc. Psychol. 51, 1173-1182.
7. Brass, M., Bekkering, H., Wohlschläger, A., and Prinz, W. (2000). Compatibility between observed and executed finger movements: comparing symbolic, spatial, and imitative cues. Brain Cogn. 143, 124-143.
8. Bub, D. N., Masson, M. E. J., and Cree, G. S. (2008). Evocation of functional and volumetric gestural knowledge by objects and words. Cognition 106, 27-58.
9. Buccino, G., Riggio, L., Melli, G., Binkofski, F., Gallese, V., and Rizzolatti, G. (2005). Listening to action-related sentences modulates the activity of the motor system: a combined TMS and behavioral study. Brain Res. Cogn. Brain Res. 24, 355-363.
10. Candidi, M., Vicario, C. M., Abreu, A. M., and Aglioti, S. M. (2010). Competing mechanisms for mapping actionrelated categorical knowledge and observed actions. Cereb. Cortex. doi:10.1093/cercor/bhq033.
11. Craighero, L., Fadiga, L., Rizzolatti, G., and Umiltà, C. (1999). Action for perception: a motor-visual attentional effect. J. Exp. Psychol. Hum. Percept. Perform. 25, 1673-1692.
12. Dehaene, S., Bossini, S., and Giraux, P. S (1993). The mental representation of sparity and numerical magnitude. J. Exp. Psychol. Gen. 122, 371-396.
13. di Pellegrino, G., Fadiga, L., Fogassi, L., Gallese, V., and Rizzolatti, G. (1992). Understanding motor events: a neurophysiological study. Exp. Brain Res. 91, 176-180.
14. Fischer, M. H., and Zwaan, R. A. (2008). Embodied language - a review of the role of the motor system in language comprehension. Q. J. Exp. Psychol. 61, 825-850.
15. Gillmeister, H., Catmur, C., Liepelt, R., Brass, M., and Heyes, C. (2008). Experience-based priming of body parts: a study of action imitation. Brain Res. 1217, 157-170.
16. Glenberg, A. M., and Kaschak, M. P. (2002). Grounding language in action. Psychon. Bull. Rev. 9, 558-565.
17. Glover, S., Rosenbaum, D. A., Graham, J., and Dixon, P. (2004). Grasping the meaning of words. Exp. Brain Res. 154, 103-108.
18. Goldin-Meadow, S., Nusbaum, H., Kelly, S., and Wagner, S. (2001). Explaining math: gesturing lightens the load. Psychol. Sci. 12, 516-522.
19. Goldin-Meadow, S., and Wagner, S. M. A. (2005). How our hands help us learn. Trends Cogn. Sci. 9, 234-241.
20. Graham, J. A., and Argyle, M. (1975). A cross-cultural study of the communication of extra-verbal meaning by gestures. Int. J. Psychol. 10, 57-67.
21. Greenwald, A. G. (1970). Sensory feedback mechanisms in performance control: with special reference to the ideomotor mechanism. Psychol. Rev. 77, 73-99.
22. Griffiths, D., and Tipper, S. P. (2009). Priming of reach trajectory when observing actions: hand-centred effects. Q. J. Exp. Psychol. 62, 2450-2470.
23. Gunter, T. C., and Bach, P. (2004). Communicating hands: ERPs elicited by meaningful symbolic hand postures. Neurosci. Lett. 372, 52-56.
24. Hauk, O., Johnsrude, I., and Pulvermüller, F. (2004). Somatotopic representation of action words in the motor and premotor cortex. Neuron 41, 301-307.
25. Holle, H., and Gunter, T. C. (2007). The role of iconic gestures in speech disambiguation: ERP evidence. J. Cogn. Neurosci. 19, 1175-92.
26. Hommel, B. (2010). The Simon effect as tool and heuristic. Acta Psychol. doi:10.1016/actpsy.2010.04.011
27. Hommel, B., Müsseler, J., Aschersleben, G., and Prinz, W. (2001). The theory of event coding (TEC). A framework for perception and action planning. Behav. Brain Sci. 24, 849-878.
28. Hostetter, A. B., and Alibali, M. W. (2007). Raise your hand if you're spatial: relations between verbal and spatial skills and gesture production. Gesture 7, 73-95.
29. Hostetter, A. B., and Alibali, M. W. (2008). Visible embodiment: gestures as simulated action. Psychon. Bull. Rev. 15, 495-514.
30. Iverson, J. M., and Goldin-Meadow, S. (1998). Why people gesture when they speak. Nature 396, 228.
31. Kemmerer, D., Castillo, J. G., Talavage, T., Patterson, S., and Wiley, C. (2008). Neuroanatomical distribution of five semantic components of verbs: evidence from fMRI. Brain Lang. 107, 16-43.
32. Kita, S. (2000). ''How representational gestures help speaking,''In Language and Gesture, ed. D. McNeill (Cambridge: Cambridge University Press), 162-185.
33. Kita, S., and Özyürek, A. (2003). What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. J. Mem. Lang. 48, 16-32.
34. Knoblich, G., and Prinz, W. (2005). "Linking perception and action: an ideomotor approach," in Higher-Order Motor Disorders, eds H.-J. Freund, M. Jeannerod, M. Hallett, and R. C. Leiguarda (Oxford, UK: Oxford University Press), 79-104.
35. Krauss, R. M. (1998). Why do we gesture when we speak? Curr. Dir. Psychol. Sci. 7, 54-60.
36. Krauss, R. M., Chen, Y., and Chawla, P. (1996). Nonverbal behavior and nonverbal communication: what do conversational hand gestures tell us? Adv. Exp. Soc. Psychol. 28, 389-450.
37. Krauss, R. M., Chen, Y., and Gottesman, R. (2000). "Lexical gestures and lexical access: a process model," in Language and Gesture, ed. D. McNeill (Cambridge, UK: Cambridge University Press), 261-283.
38. MacLeod, C. (1991). Half a century of research on the Stroop effect: an integrative review. Psychol. Bull. 109, 163-203.
39. Melinger, A., and Levelt, W. (2004). Gesture and the communicative intention of the speaker. Gesture 4, 119-141.
40. Morsella, E., and Krauss, R. M. (2005). Muscular activity in the arm during lexical retrieval: implications for gesture-speech theories. J. Psycholinguist. Res. 34, 415-427.
41. Müsseler, J., and Hommel, B. (1997). Blindness to response-compatible stimuli. J. Exp. Psychol. Hum. Percept. Perform. 23, 861-872.
42. Özyürek, A., Willems, R. M., Kita, S., and Hagoort, P. (2007). On-line integration of semantic information from speech and gesture: insights from event-related brain potentials. J. Cogn. Neurosci. 4, 605-616.
43. Pecher, D., van Dantzig, S., Zwaan, R., and Zeelenberg, R. (2009). Language comprehenders retain implied shape and orientation of objects. J. Exp. Psychol. 10, 1-7.
44. Pecher, D., Zeelenberg, R., and Raaijmakers, J. G. W. (1998). Does pizza prime coin? Perceptual priming in lexical decision and pronunciation. J. Mem. Lang. 38, 401-418.
45. Pine, K., Bird, H., and Kirk, E. (2007). The effects of prohibiting gestures on children's lexical retrieval ability. Dev. Sci. 10, 747-754.
46. Prinz, W. (1990). "A common-coding approach to perception and action," in Relationships Between Perception and Action: Current Approaches, eds O. Neumann and W. Prinz (Berlin/Heidelberg/New York: Springer), 167-201.
47. Prinz, W. (1997). Perception and action planning. Eur. J. Cogn. Psychol. 9, 129-154.
48. Pulvermüller, F., and Fadiga, L. (2010). Active perception: sensorimotor circuits as a cortical basis for language. Nat. Rev. Neurosci. 11, 351-360.
49. Rauscher, F. H., Krauss, R. M., and Chen, Y. (1996). Gesture, speech, and lexical access: the role of lexical movements in speech production. Psychol. Sci. 7, 226-231.
50. Richardson, D. C., Spivey, M. J., Barsalou, L. W., and McRae, K. (2003). Spatial representations activated during realtime comprehension of verbs. Cogn. Sci. 27, 767-780.
51. Rimè, B., Shiaratura, L., Hupet, M., and Ghysselinckx, A. (1984). Effects of relative immobilization on the speaker's nonverbal behavior and on the dialogue imagery level. Motiv. Emot. 8, 311-325.
52. Seyfeddinipur, M., and Kita, S. (2001). "Gesture and disfluencies in speech," in Oralité et gestualité: Interactions et comportements multimodaux dans la communication [Orality and gestuality: multimodal interaction and behavior sin communication]. Actes du colloque [Proceedings of the meeting of] ORAGE 2001, eds C. Cavé, I. Guaïtella, and S. Santi (Paris, France: L'Harmattan), 266-270.
53. Simon, J. R. (1969). Reactions towards the source of stimulation. J. Exp. Psychol 81, 174-176.
54. Stroop, J. R. (1935). Studies of interference in serial verbal reactions. J. Exp. Psychol. 18, 643-662.
55. Stürmer, B., Aschersleben, G., and Prinz, W. (2000). Correspondence effects with manual gestures and postures: a study of imitation. J. Exp. Psychol. Hum. Percept. Perform. 26, 1746-1759.
56. Symes, E., Ellis, R., and Tucker, M. (2007). Visual object affordances: object orientation. Acta Psychol. 124, 238-255.
57. Symes, E., Ottoboni, G., Tucker, M., Ellis, R., and Tessari, A. (2009). When motor attention improves selective attention: the dissociating role of saliency. Q. J. Exp. Psychol. doi: 10.1080/17470210903380806.
58. Symes, E., Tucker, M., Ellis, R., Vainio, L., and Ottoboni, G. (2008). Grasp preparation improves change detection for congruent objects. J. Exp. Psychol. Hum. Percept. Perform. 34, 854-871.
59. Symes, E., Tucker, M., and Ottoboni, G. (2010). Integrating action and language through biased competition. Front. Neurorobot. 4:9. doi: 10.3389/fnbot.2010.00009.
60. Tessari, A., Ottoboni, G., Symes, E., and Cubelli, R. (2010). Hand processing depends on the implicit access to a spatially and bio-mechanically organized structural description of the body. Neuropsychologia 48, 681-688.
61. Tipper, S. P., and Bach, P. (2010). The face inhibition effect: social contrast or motor competition? Eur. J. Cogn. Psychol. (in press).
62. Tipper, S. P., Paul, M., and Hayes, A. (2006). Vision-for-action: the effects of object property discrimination and action state on affordance compatibility effects. Psychon. Bull. Rev. 13, 493-498.
63. Trafton, J. G., Trickett, S. B., Stitzlein, C. A., Saner, L., Schunn, C. D., and Kirschenbaum, S. S. (2006). The relationship between spatial transformations and iconic gestures. Spat. Cogn.Comput. 6, 1-29.
64. Tucker, M., and Ellis, R. (1998). On the relations between seen objects and components of potential actions. J. Exp. Psychol. Hum. Percept. Perform. 24, 830-846.
65. Tucker, M., and Ellis, R. (2001). The potentiation of grasp types during visual object recognition. Vis. Cogn. 8, 769-800.
66. Tucker, R., and Ellis, M. (2004). Action priming by briefly presented objects. Acta Psychol. 116, 185-203.
67. Wohlschläger, A. (2000). Visual motion priming by invisible actions. Vision Res. 40, 925-930.
68. Wohlschläger, A., and Wohlschläger, A. (1998). Mental and manual rotation. J. Exp. Psychol. Hum. Percept. Perform. 24, 397-412.
69. Wu, Y. C., and Coulson, S. (2007a). Iconic gestures prime related concepts: an ERP study. Psychon. Bull. Rev. 14, 57-63.
70. Wu, Y. C., and Coulson, S. (2007b). How iconic gestures enhance communication: an ERP study. Brain Lang. 101, 234-245.
71. Zwaan, R. A., Stanfield, R. A., and Yaxley, R. H. (2002). Language comprehenders mentally represent the shapes of objects. Psychol. Sci. 13, 168-171.
72. Zwaan, R. A., and Taylor, L. J. (2006). Seeing, acting, understanding: motor resonance in language comprehension. J. Exp. Psychol. Gen. 135, 1-11.
73. Zwaan, R. A., and Yaxley, R. H. (2003). Spatial iconicity affects semantic relatedness judgments. Psychon. Bull. Rev. 10, 954-958.