Infants temporally coordinate gesture-speech combinations before they produce their first words

Speech Communication

Volumn 57, Issue , 2014, Pages 301-316

  Esteve Gibert, Núria ^a   Prieto, Pilar ^a,b  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

Early acquisition of multimodality; Early gesture speech temporal coordination; Early gestures

Indexed keywords

CATALANS; COMMUNICATIVE ACTS; EARLY GESTURES; GESTURE-SPEECH; MULTI-MODALITY; TEMPORAL ALIGNMENT; TEMPORAL COORDINATION;

COMPUTER APPLICATIONS; COMPUTER SIMULATION;

SPEECH;

EID: 84888295179     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2013.06.006     Document Type: Article

References (63)

1. L. Astruc, E. Payne, B. Post, M.M. Vanrell, and P. Prieto Tonal targets in early child English, Spanish, and Catalan Lang. Speech 56 2 2013 78 96
2. R.H. Baayen, D.J. Davidson, and D.M. Bates Mixed-effects modeling with crossed random effects for subjects and items J. Mem. Lang. 59 2008 390 412
3. A. Bangerter Using pointing and describing to achieve joint focus (Pubitemid 38782982)
4. E. Bates, L. Camaioni, and V. Volterra The acquisition of performatives prior to speech Merrill Palmer Q. 21 1975 205 224
5. Bergmann, K.; Aksu, V.; Kopp, S.; 2011. The relation of speech and gestures: temporal synchrony follows semantic synchrony. In: Proceedings of the 2nd Workshop on Gesture and Speech in Interaction, Bielefeld.
6. J. Blake, P. O'Rourke, and G. Borzellino Form and function in the development of pointing and reaching gestures Infant Behav. Dev. 17 1994 195 203
7. J. Blake, G. Vitale, P. Osborne, and E. Olshansky A cross-cultural comparison of communicative gestures in human infants during the transition to language Gesture 5 2005 201 217
8. Boersma, P.; Weenink, D.; 2012. Praat: doing phonetics by computer [Computer program]. Version 5.3.04, retrieved 12 January 2012 from http://www.praat.org/.
9. Bonsdroff, L.; Engstrand, O.; 2005. Durational patterns produced by Swedish and American 18- and 24-month-olds: implications for the acquisition of the quantity contrast. In: Papers from the 18th Swedish Phonetics Conference, Department of Linguistics, Gothenburg, pp. 59-62.
10. C. Butcher, and S. Goldin-Meadow Gesture and the transition from one- to two-word speech: when hand and mouth come together D. McNeill, Language and Gesture 2000 Cambridge University Press New York 235 258
11. B. Butterworth, and G. Beattie Gesture and silence as indicators of planning in speech R. Campbell, G.T. Smith, Recent advances in the psychology of language: formal and experimental approaches 1978 Plenum Press New York 347 360
12. L. Camaioni, P. Perucchini, F. Bellagamba, and C. Colonnesi The role of declarative pointing in developing a theory of mind Infancy 5 2004 291 308 (Pubitemid 40259897)
13. N.C. Capone, and K.K. McGregor Gesture development: a review for clinicians and researchers J. Speech Lang. Hear. Res. 47 2004 173 186 (Pubitemid 38338391)
14. H. Cochet, and J. Vauclair Pointing gesture in young children: hand preference and language development Gesture 10 2010 129 149
15. C. Colonnesi, G.J.J.M. Stams, I. Koster, and M.J. Noom The relationship between pointing gesture and language: a meta-analysis Dev. Rev. 30 2010 352 366
16. B. De Boysson-Bardies, and M.M. Vihman Adaptation to language: evidence from babbling and first words in four languages Language 67 1991 297 319
17. De Ruiter, J.P.; 1998. Gesture and speech production. Doctoral dissertation. Katholieke Universiteit, Nijmegen.
18. J.P. De Ruiter The production of gesture and speech D. McNeill, Language and Gesture 2000 Cambridge University Press Cambridge 284 311
19. J.P. De Ruiter Can gesticulation help aphasic people speak, or rather, communicate? Adv. Speech Lang. Pathol. 8 2 2006 124 127
20. K. Ejiri, and N. Masataka Co-occurrence of preverbal vocal behavior and motor action in early infancy Dev. Sci. 4 2001 40 48
21. P. Ekman, and W. Friesen The repertoire of nonverbal behavioural categories: origins, usage and coding Semiotica 1 1969 49 98
22. Engstrand, O.; Bonsdroff, L.; 2004. Quantity and duration in early speech: preliminary observations on three Swedish children. In: Papers from the 17th Swedish Phonetics Conference, Stockholm, pp. 64-67.
23. N. Esteve-Gibert, and P. Prieto Intonational and gestural structures are temporally coordinated J. Speech. Lang. Hear. Res. 2013 10.1044/1092-4388(2012/ 12-0049
24. Esteve-Gibert, N.; Prieto, P.; 2012. Esteve-Prieto Catalan acquisition corpus. (http://prosodia.upf.edu/phon/ca/corpora/description/esteveprieto.html).
25. R. Feldman, and J.S. Reznick Maternal perception of infant intentionality at 4 and 8 months Infant Behav. Dev. 19 1996 483 496 (Pubitemid 126399390)
26. Ferré, G.; 2010. Timing relationships between speech and co-verbal gestures in spontaneous French. In: Proceedings of Language Resources and Evaluation, Workshop on Multimodal Corpora, pp. 86-91.
27. Frota, S.; Vigário, M.; 2008. The intonation of one-word and first two-word utterances in European Portuguese. In: Proceedings of XIth International Congress for the Study of Child Language, Edinburgh.
28. J.M. Iverson, and M.K. Fagan Infant vocal-motor coordination: precursor to the gesture-speech system? Child Dev. 75 2004 1053 1066 (Pubitemid 39137754)
29. J.M. Iverson, and S. Goldin-Meadow Gesture paves the way for language development Psychol. Sci. 16 2005 367 371 (Pubitemid 40763682)
30. J.M. Iverson, H.L. Tencer, J. Lany, and S. Goldin-Meadow The relation between gesture and speech in congenitally blind and sighted language-learners J. Nonverbal Behav. 24 2000 105 130
31. J.M. Iverson, and E. Thelen Hand, mouth and brain: the dynamic emergence of speech and gesture J. Conscious. Stud. 6 1999 19 40
32. A. Kendon Gesticulation and speech: two aspects of the process of utterance M.R. Key, The Relationship of Verbal and Nonverbal Communication 1980 Mouton The Hague 207 227
33. A. Kendon Gesture: Visible Action as Utterance 2004 Cambridge University Press Cambridge
34. S. Kita How representational gestures help speaking D. McNeill, Language and Gesture 2000 Cambridge University Press Cambridge 162 185
35. E. Krahmer, and M. Swerts The effects of visual beats on prosodic prominence: acoustic analyses, auditory perception and visual perception J. Mem. Lang. 57 3 2007 396 414
36. R.M. Krauss, Y. Chen, and R.F. Gottesman Lexical gestures and lexical access: a process model D. McNeill, Language and Gesture 2000 Cambridge University Press New York 261 283
37. H. Lausberg, and H. Sloetjes Coding gestural behavior with the NEUROGES-ELAN system Behav. Res. Methods Instrum. Comput. 41 3 2009 841 849
38. E.H.L. Leung, and H.L. Rheingold Development of pointing as a social gesture Dev. Psychol. 17 1981 215 220
39. W.J. Levelt, G. Richardson, and W. La Heij Pointing and voicing in deictic expressions J. Mem. Lang. 24 1985 133 164
40. T. Leonard, and F. Cummins The temporal relation between beat gestures and speech Lang. Cogn. Process. 26 2010 1295 1309
41. U. Liszkowski Human twelve-months-olds point cooperatively to share interest with and helpfully provide information for a communicative partner K. Liebal, C. Müller, S. Pieka, Gestural Communication in Nonhuman and Human Primates 2007 John Benjamins Amsterdam 124 140
42. D. Loehr Aspects of rhythm in gesture and speech Gesture 7 2007 179 214
43. N. Masataka From index-finger extension to index-finger pointing: ontogenesis of pointing in preverbal infants S. Kita, Pointing: Where Language, Culture, and Cognition Meet 2003 Lawrence Erlbaum Mahwah 69 84
44. D. McNeill Hand and Mind: What Gestures Reveal About Thought 1992 The Chicago University Press Chicago
45. A. Melinger, and W. Levelt Gesture and the communicative intention of the speaker Gesture 4 2004 119 141
46. Nobe, S.; 1996. Representational gestures, cognitive rhythms, and acoustic aspects of speech: a network/threshold model of gesture production. Doctoral dissertation. University of Chicago, Chicago.
47. D.K. Oller, L.A. Wieman, W.J. Doyle, and C. Ross Infant babbling and speech J. Child Lang. 3 1976 1 11
48. S.L. Olson, J.E. Bates, and K. Bayles Predicting long-term developmental outcomes from maternal perceptions of infant and toddler behavior Infant Behav. Dev. 12 1982 77 92
49. S. Özçalişkan, and S. Goldin-Meadow Gesture is at the cutting edge of early language development Cognition 96 2005 101 113
50. C.F. Papaeliou, and C. Trevarthen Prelinguistic pitch patterns expressing 'communication' and 'apprehension' J. Child Lang. 33 2006 163 178 (Pubitemid 43289779)
51. P. Prieto The relevance of metrical information in early prosodic word acquisition: a comparison of Catalan and Spanish Lang. Speech 49 2 2006 233 261
52. P. Prieto, J. Borràs-Comes, T. Cabré, V. Crespo-Sendra, I. Mascaró, P. Roseano, R. Sichel-Bazin, and M.M. Vanrell Intonational phonology of Catalan and its dialectal varieties S. Frota, P. Prieto, Intonational Variation in Romance 2013 Oxford University Press Oxford
53. P. Rochat Intentional action arises from early reciprocal exchanges Acta Psychol. 124 2007 8 25 (Pubitemid 44932835)
54. A. Rochet-Capellan, R. Laboissière, A. Galván, and J.L. Schwartz The speech focus position effect on jaw-finger coordination in a pointing task J. Speech Lang. Hear. Res. 51 6 2008 1507 1521
55. Roustan, B.; Dohen, M.; 2010. Co-Production of contrastive prosodic focus and manual gestures: temporal coordination and effects on the acoustic and articulatory correlates of focus. In: Proceeding of the Speech Prosody, Chicago.
56. Rusiewicz, H.L.; 2010. The role of prosodic stress and speech perturbation on the temporal synchronization of speech and deictic gestures. Doctoral dissertation. University of Pittsburgh, Pittsburgh.
57. W.C. So, O.E. Demir, and S. Goldin-Meadow When speech is ambiguous gesture steps in: sensitivity to discourse-pragmatic principles in early childhood Appl. Psycholinguist. 31 2010 209 224
58. L.A. Sperry, and F.J. Symons Maternal judgments of intentionality in young children with autism: the effects of diagnostic information and stereotyped behavior J. Autism Dev. Disord. 33 3 2003 281 287 (Pubitemid 36919119)
59. M. Tomasello, M. Carpenter, and U. Liszkowski A new look at infant pointing Child Dev. 78 2007 705 722
60. Vanrell, M.M.; Prieto, P.; Astruc, L.; Payne, E.; Post, B.; 2011. Adquisició dels patrons d'alineació i de camp tonal en català i espanyol. Anejo de Quaderns de Filologia, pp. 71-88.
61. M.M. Vihman, R.A. DePaolis, and T. Keren-Portnoy Babbling and words: a dynamic systems perspective on phonological development E.L. Bavin, The Cambridge Handbook of Child Language 2009 Cambridge University Press Cambridge 163 182
62. M.M. Vihman, M.A. Macken, R. Miller, H. Simmons, and J. Miller From babbling to speech Language 61 2 1985 397 445
63. B. West, K.B. Welch, and A.T. Galecki Linear Mixed Models: A Practical Guide Using Statistical Software 2007 Chapman & Hall/CRC New York