Deictic word and gesture production: Their interaction

Behavioural Brain Research

Volumn 203, Issue 2, 2009, Pages 200-206

  Chieffi, Sergio ^a,b   Secchi, Claudio ^a   Gentilucci, Maurizio ^a  

^a UNIVERSITY OF PARMA   (Italy)

^b SECOND UNIVERSITY OF NAPLES   (Italy)

Author keywords

Deictic gesture; Deictic word; Gesture kinematics; Gesture production; Voice spectra; Word production

Indexed keywords

ADULT; ARTICLE; BODY POSITION; BRAIN FUNCTION; COMPREHENSION; CONTROLLED STUDY; FEMALE; GESTURE; HUMAN; HUMAN EXPERIMENT; INTERPERSONAL COMMUNICATION; KINEMATICS; LANGUAGE ABILITY; NONVERBAL COMMUNICATION; NORMAL HUMAN; PRIORITY JOURNAL; SPEECH ANALYSIS; VERBAL COMMUNICATION;

ADULT; FEMALE; GESTURES; HUMANS; PHOTIC STIMULATION; SPEECH; SPEECH PRODUCTION MEASUREMENT;

EID: 67649647905     PISSN: 01664328     EISSN: 18727549     Source Type: Journal    
DOI: 10.1016/j.bbr.2009.05.003     Document Type: Article

References (68)

1. Alibali M.W., Kita S., and Young A. Gesture and the process of speech production: we think, therefore we gesture. Lang Cogn Process 15 (2000) 593-613
2. Barbieri F., Buonocore A., Dalla Volta R., and Gentilucci M. How symbolic gestures and words interact with each other. Brain Lang (2009) [on line]
3. Bates E., and Dick F. Language, gesture, and the developing brain. Dev Psychobiol 40 (2002) 293-310
4. Bernardis P., Bello A., Pettenati P., Stefanini S., and Gentilucci M. Manual actions affect vocalizations of infants. Exp Brain Res 184 (2008) 599-603
5. Bernardis P., and Gentilucci M. Speech and gesture share the same communication system. Neuropsychologia 44 (2006) 178-190
6. Butterworth B., and Hadar U. Gesture, speech and computational stages: a reply to McNeill. Psychol Rev 96 (1989) 168-174
7. Carlomagno S., Pandolfi M., Marini A., Di Iasi G., and Cristilli C. Coverbal gestures in Alzheimer's type dementia. Cortex 41 (2005) 535-546
8. Carlomagno S., Santoro A., Menditti A., Pandolfi M., and Marini A. Referential communication in Alzheimer's type dementia. Cortex 41 (2005) 520-534
9. Chawla P., and Krauss R.M. Gesture and speech in spontaneous and rehearsed narratives. J Exp Soc Psychol 30 (1994) 580-601
10. Chieffi S., Ricci M., and Carlomagno S. Influence of visual distractors on movement trajectory. Cortex 37 (2001) 389-405
11. Chieffi S., and Ricci M. Gesture production and text structure. Percept Mot Skills 101 (2005) 435-439
12. Cicone M., Wapner W., Foldi N., Zurif E., and Gardner H. The relation between gesture and language in aphasic communication. Brain Lang 8 (1979) 324-349
13. Coltheart M., Curtis B., Atkins P., and Haller M. Models of reading aloud: dual-route and parallel-distributed-processing approaches. Psychol Rev 100 (1993) 589-608
14. Coltheart M., Rastle K., Perry C., Langdon R., and Ziegler J. DRC: a dual route cascaded model of visual word recognition and reading aloud. Psychol Rev 108 (2001) 204-256
15. Delis D., Foldi N.S., Hamby S., Gardner H., and Zurif E. A note on temporal relations between language and gestures. Brain Lang 8 (1979) 350-354
16. de Ruiter J.P. The production of gesture and speech. In: Mc Neill D. (Ed). Language and gesture (2000), Cambridge University Press, Cambridge 284-311
17. Ekman P., and Friesen W. The repertoire of nonverbal behaviour: categories, origins, usage and coding. Semiotica 11 (1969) 49-98
18. Gangitano M., Daprati E., and Gentilucci M. Visual distractors differentially interfere with the reaching and grasping components of prehension movements. Exp Brain Res 122 (1998) 441-452
19. Gentilucci M., Benuzzi F., Gangitano M., and Grimaldi S. Grasp with hand and mouth: a kinematic study on healthy subjects. J Neurophysiol 86 (2001) 1685-1699
20. Gentilucci M., Bernardis P., Crisi G., and Dalla Volta R. Repetitive transcranial magnetic stimulation of Broca's area affects verbal responses to gesture observation. J Cogn Neurosci 18 (2006) 1059-1074
21. Gentilucci M., Chieffi S., Scarpa M., and Castiello U. Temporal coupling between transport and grasp components during prehension movements: effects of visual perturbation. Behav Brain Res 15 (1992) 71-82
22. Gentilucci M., and Corballis M.C. From manual gesture to speech: a gradual transition. Neurosci Biobehav Rev 30 (2006) 949-960
23. Gentilucci M., Dalla Volta R., and Gianelli C. When the hands speak. J Physiol Paris 102 (2008) 21-30
24. Gentilucci M., Stefanini S., Roy A.C., and Santunione P. Action observation and speech production: study on children and adults. Neuropsychologia 42 (2004) 1554-1567
25. Goldin-Meadow S., and Butcher C. Pointing toward two-word speech in young children. In: Kita S. (Ed). Pointing: where language, culture, and cognition meet (2003), Erlbaum, Mawhaw, NJ 85-107
26. Hadar U., Burstein A., Krauss R., and Soroker N. Ideational gestures and speech in brain-damaged subjects. Lang Cognit Process 13 (1998) 59-76
27. Hadar U., and Yadlin-Gedassy S. Conceptual and lexical aspects of gesture: evidence from aphasia. J Neurolinguistics 8 (1994) 57-65
28. Hostetter A.B., and Alibali M.W. On the tip of the mind: gesture as key to conceptualization. In: Forbus K., Gentner D., and Regier T. (Eds). Proceedings of the 26th Annual Meeting of the Cognitive Science Society (2004), Erlbaum, Mawah, NJ 589-594
29. Hostetter A.B., Alibali W.N., and Kita S. I see it in my hand's eye: representational gestures are sensitive to conceptual demands. Lang Cogn Process 22 (2007) 313-336
30. Hubbard A.L., Wilson S.M., Callan D.E., and Dapretto M. Giving speech a hand: gesture modulates activity in auditory cortex during speech perception. Hum Brain Mapp 30 (2009) 1028-1037
31. Jackson S.R., Jackson G.M., and Rosicky J. Are non-relevant objects represented in working memory? The effect of non-target objects on reach and grasp kinematics. Exp Brain Res 102 (1995) 519-530
32. Kelly S.D., Kravitz C., and Hopkins M. Neural correlates of bimodal speech and gesture comprehension. Brain Lang 89 (2004) 253-260
33. Kelly S.D., Ward S., Creigh P., and Bartolotti J. An intentional stance modulates the integration of gesture and speech during comprehension. Brain Lang 101 (2007) 222-233
34. Kendon A. Some relationships between body motion and speech. An analysis of an example. In: Siegman A., and Pope B. (Eds). Studies in dyadic communication (1972), Pergamon, Elmsford, NY 177-210
35. Kendon A. Gesticulation and speech: two aspects of the process of utterance. In: Key M.R. (Ed). The relationship of verbal and nonverbal communication (1980), The Hague, Mouton 207-227
36. Kendon A. Gesture and speech: how they interact. In: Wiemann J.M., and Harrison R.P. (Eds). Nonverbal interaction (1983), Sage Publications, Beverly Hills, CA 13-45
37. Kendon A. Do gestures communicate? A review. Res Lang Soc Interact 27 (1994) 175-200
38. Kendon A. Gesture: visible action as utterance (2004), Cambridge University Press, Cambridge p. 412
39. Kita S. How representational gestures help speaking. In: McNeill D. (Ed). Language and gesture (2000), Cambridge University Press, Cambridge, UK 162-185
40. Kita S., and Özyürek A. What does cross-linguistic variation in semantic coordination of speech and gesture reveal? Evidence for an interface representation of spatial thinking and speaking. J Mem Lang 48 (2003) 16-32
41. Kita S., Özyürek A., Allen S., Brown A., Furman R., and Ishizuka T. Relations between syntactic encoding and co-speech gestures: implications for a model of speech and gesture production. Lang Cognit Process 22 (2007) 1212-1236
42. Krahmer E., and Swerts M. The effects of visual beats on prosodic prominence: acoustic analyses, auditory perception and visual perception. J Mem Lang 57 (2007) 396-414
43. Krauss R.M., Chen Y., and Gottesman R.F. Lexical gestures and lexical access: a process model. In: McNeill D. (Ed). Language and gesture (2000), Cambridge University Press, New York 261-283
44. Krauss R.M., and Hadar U. The role of speech-related arm/hand gestures in word retrieval. In: Campbell R., and Messing L. (Eds). Gesture, speech, and sign (1999), Oxford University Press, Oxford 93-116
45. Leoni F.A., and Maturi P. Manuale di Fonetica (2002), Carocci, Roma p. 172
46. Levelt W.J.M. Speaking: from intention to articulation (1989), MIT Press, Cambridge, MA p. 566
47. Levelt W.J.M. The skill of speaking. In: Bertelson P., Eelen P., and d'Ydewalle G. (Eds). International perspectives on psychological science. (Vol. I: leading themes) (1994), Lawrence Erlbaum Associates, Hillsdale 89-104
48. Levelt W.J.M., Richardson G., and La Heij W. Pointing and voicing in deictic expressions. J Mem Lang 24 (1985) 133-164
49. McNeill D. So you think gestures are nonverbal?. Psychol Rev 92 (1985) 350-371
50. McNeill D. Psycholinguistics: a new approach (1987), Harper & Row, New York p. 290
51. McNeill D. Hand and mind: what gestures reveal about thought (1992), Univ. Chicago Press, Chicago p. 416
52. Mc Neill D., and Duncan S.D. Growth points in thinking-for-speaking. In: McNeill D. (Ed). Language and gesture (2000), Cambridge University Press, New York 141-161
53. McNeill D., and Levy E. Conceptual representations in language activity and gesture. In: Jarvella R., and Klein W. (Eds). Speech, place, and action: studies in deixis and related topics (1982), Wiley, Chichester, England 271-295
54. Melinger A., and Levelt W.J.M. Gesture and the communicative intention of the speaker. Gesture 4 (2004) 119-141
55. Morrel-Samuels P., and Krauss R.M. Word familiarity predicts temporal asynchrony of hand gestures and speech. J Exp Psychol Learn Mem Cogn 18 (1992) 615-622
56. Morsella E., and Krauss R.M. The role of gestures in spatial working memory and speech. Am J Psychol 117 (2004) 411-424
57. Oldfield R.C. The assessment and analysis of handedness: the Edinburgh inventory. Neuropsychologia 9 (1971) 97-113
58. Özyürek A., Kita S., Allen S., Furman R., and Brown A. How does linguistic framing of events influence co-speech gestures? Insights from cross-linguistic variations and similarities. Gesture 5 (2005) 215-237
59. Rauscher F.B., Krauss R.M., and Chen Y. Gesture, speech and lexical access: the role of lexical movements in speech production. Psychol Sci 7 (1996) 226-231
60. Tipper S.P., Howard L.A., and Jackson S.R. Selective reaching to grasp: evidence for distractor interference effects. Vis Cogn 4 (1997) 1-38
61. Tipper S.P., Lortie C., and Baylis G.C. Selective reaching: evidence for action-centered attention. J Exp Psychol Hum Percept Perform 18 (1992) 891-905
62. Van Hoof JARA.M. Facial expressions in higher primates. Symp Zool Soc Lond 8 (1962) 97-125
63. Van Hoof JARA.M. The facial displays of the catarrhine monkeys and apes. In: Morris D. (Ed). Primate ethology (1967), Weidenfield and Nicolson, London 7-68
64. Volterra V., Bates E., Benigni L., Bretherton I., and Campioni L. First words in language and action: a qualitative look. In: Bates E., Benigni L., Bretherton I., Camaioni L., and Volterra V. (Eds). The emergence of symbols: cognition and communication in infancy (1979), Academic Press, New York 141-222
65. Volterra V., Caselli M.C., Capirci O., and Pizzuto E. Gesture and the emergence and development of language. In: Tomasello M., and Slobin D. (Eds). Beyond nature-nurture. Essays in honor of Elizabeth Bates (2005), Lawrence Erlbaum Associates, NJ 3-40
66. Welsh T.N., Elliott D., and Weeks D.J. Hand deviations toward distractors. Evidence for response competition. Exp Brain Res 127 (1999) 207-212
67. Willems R.M., and Hagoort P. Neural evidence for the interplay between language, gesture, and action: a review. Brain Lang 101 (2007) 278-289
68. Willems R.M., Ozyürek A., and Hagoort P. When language meets action: the neural integration of gesture and speech. Cereb Cortex 17 (2007) 2322-2333