Effects of prosody and position on the timing of deictic gestures

Journal of Speech, Language, and Hearing Research

Volumn 56, Issue 2, 2013, Pages 458-470

  Rusiewicz, Heather Leavy ^a   Shaiman, Susan ^b   Iverson, Jana M ^b   Szuminsky, Neil ^b  

^a DUQUESNE UNIVERSITY   (United States)

^b UNIVERSITY OF PITTSBURGH   (United States)

Author keywords

Capacitance; Gesture; Prosody; Speech hand coordination; Stress; Synchronization

Indexed keywords

ADULT; FEMALE; GESTURE; HUMAN; MALE; MANUAL COMMUNICATION; MOVEMENT (PHYSIOLOGY); PHONETICS; PHYSIOLOGY; SPEECH; SPEECH PERCEPTION; TIME; VOICE; YOUNG ADULT; ARTICLE; CAPACITANCE; NONVERBAL COMMUNICATION; PROSODY; SPEECH-HAND COORDINATION; STRESS; SYNCHRONIZATION;

ADULT; FEMALE; GESTURES; HUMANS; MALE; MANUAL COMMUNICATION; MOVEMENT; PHONETICS; SPEECH; SPEECH PERCEPTION; TIME FACTORS; VOICE; YOUNG ADULT;

CAPACITANCE; GESTURE; PROSODY; SPEECH-HAND COORDINATION; STRESS; SYNCHRONIZATION;

EID: 84878079751     PISSN: 10924388     EISSN: None     Source Type: Journal    
DOI: 10.1044/1092-4388(2012/11-0283)     Document Type: Article

References (54)

1. Bernardis, P., & Gentilucci, M. (2006). Speech and gesture share the ame communication system. Neuropsychologia, 44, 178-190.
2. Birdwhistell, R. L. (1952). Introduction to kinesics. An annotation ystem for analysis of body motion and gesture. Louisville, KY: niversity of Louisville Press.
3. Birdwhistell, R. L. (1970). Kinesics and context: Essays on body motion communication. Philadelphia, PA: University of Pennsylvania Press.
4. Blake, J., Myszczyszyn, D., Jokel, A., & Bebiroglu, N. (2008). Gestures accompanying speech in specifically language-impaired children and their timing with speech. First Language, 28, 237-253.
5. Browman, C. P., & Goldstein, L. (1990). Gestural specification using dynamically defined articulatory structures. Journal of Phonetics, 18, 299-320.
6. Bull, P., & Connelly, G. (1985). Body movement and emphasis in speech. Journal of Nonverbal Behavior, 9, 169-187.
7. Butterworth, B., & Beattie, G. (1978). Gesture and silence as indicators of planning in speech. In R. Campbell & G. T. Smith (Eds.), Recent advances in the psychology of language: Formal and experimental approaches (pp. 347-360). New York, NY: Plenum.
8. Chang, P., & Hammond, G. R. (1987). Mutual interactions between speech and finger movements. Journal of Motor Behavior, 19, 265-275.
9. Chui, K. (2005). Temporal patterning of speech and iconic gestures in conversational discourse. Journal of Pragmatics, 37, 871-887.
10. Condon, W. S., & Ogston, W. D. (1966). Sound film analysis of normal and pathological behavior patterns. Journal of Nervous and Mental Disease, 143, 338-347.
11. Cutler, A., & Carter, D. M. (1987). The predominance of strong initial syllables in the English vocabulary. Computer Speech & Language, 2, 133-142.
12. de Ruiter, J. P. (1998). Gesture and speech production (Unpublished doctoral dissertation). Katholieke Universiteit, Nijmegen, the Netherlands.
13. de Ruiter, J. P. (2000). The production of gesture and speech. In D. McNeill (Ed.), Language and gesture (pp. 284-311). Cambridge, United Kingdom: Cambridge University Press.
14. Dittman, A. T., & Llewellyn, L. G. (1969). Body movement and speech rhythm in social conversation. Journal of Personality and Social Psychology, 11, 98-106.
15. Esteve-Gibert, N., & Prieto, P. (2011). Temporal alignment of gesture and speech in Catalan-babbling children. Proceedings From the 2nd Gesture and Speech in Interaction (GESPIN) Conference, Bielefield, Germany. Retrieved from http://coral2.spectrum.uni-bielefeld.de/gespin2011/final/Esteve-Gibert_Prieto.pdf
16. Feyereisen, P. (1983). Manual activity during speaking in aphasic subjects. International Journal of Psychology, 18, 545-556.
17. Flecha-Garcia, M. L. (2010). Eyebrow raises in dialogue and their relation to discourse structure, utterance function, and stress in English. Speech Communication, 52, 542-554.
18. Franks, I. M., Nagelkerke, P., Ketelaars, M., & van Donkelaar, P. (1998). Response preparation and control of movement sequences. Canadian Journal of Experimental Psychology, 52, 93-101.
19. Goldin-Meadow, S. (1999). The role of gesture in communication and thinking. Trends in Cognitive Sciences, 3, 419-429.
20. Hiscock, M., & Chipuer, H. (1986). Concurrent performance of rhythmically compatible or incompatible vocal and manual tasks: Evidence for two sources of interference in verbal-manual timesharing. Neuropsychologia, 24, 691-698.
21. Hulstijn, W., van Lieshout, P. H. H. M., & Peters, F. M. (1991). On the measurement of coordination. In H. F. M. Peters, W. Hulstijn, & C. W. Starkweather, (Eds.), Speech motor control and stuttering (pp. 211-231). Amsterdam, the Netherlands: Elsevier.
22. Iverson, J. M., & Thelen, E. (1999). Hand, mouth and brain: The dynamic emergence of speech and gesture. Journal of Consciousness Studies, 6, 19-40.
23. Jacks, A., Mathes, K. A., & Marquardt, T. P. (2010). Vowel acoustics in adults with apraxia of speech. Journal of Speech, Language, and Hearing Research, 53, 61-74.
24. Kendon, A. (1972). Some relationships between body motion and speech. In A. W. Seigman & B. Pope (Eds.), Studies in dyadic communication (pp. 177-210). Elmsford, NY: Pergamon.
25. Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57, 396-414.
26. Krauss, R. M., Chen, Y., & Chawla, P. (1996). Nonverbal behavior and nonverbal communication: What do conversational hand gestures tell us? In M. Zanna (Ed.), Advances in experimental social psychology (pp. 389-450). San Diego, CA: Academic Press.
27. Krauss, R. M., Chen, Y., & Gottesman, R. F. (2000). Lexical gestures and lexical access: A process model. In D. McNeill (Ed.), Language and gesture (pp. 261-283). New York, NY: Cambridge University Press.
28. Lehiste, I. (1977). Isochrony reconsidered. Journal of Phonetics, 5, 253-263.
29. Leonard, T., & Cummins, F. (2011). The temporal relation between beat gestures and speech. Language and Cognitive Processes, 26, 1457-1471.
30. Levelt, W. J. M. (1989). Speaking: From intention to articulation. Cambridge, MA: MIT Press.
31. Levelt, W. J. M., Richardson, G., & La Heij, W. (1985). Pointing and voicing in deictic expressions. Journal of Memory and Language, 24, 133-164.
32. Loehr, D. P. (2004). Gesture and intonation. Dissertation Abstracts International: Section A. The Humanities and Social Sciences, 65(06), 2180.
33. Mayberry, R. I., & Jaques, J. (2000). Gesture production during stuttered speech: Insights into the nature of gesture-speech integration. In D. McNeill (Ed.), Language and gesture (pp. 199-214). Cambridge, United Kingdom: Cambridge University Press.
34. Mayberry, R. I., Jaques, J., & DeDe, G. (1998). What stuttering reveals about the development of the gesture-speech relationship. New Directions for Child Development, 79, 77-87.
35. McClave, E. (1998). Pitch and manual gestures. Journal of Psycholinguistic Research, 27, 69-89.
36. McNeill, D. (1985). So you think gestures are nonverbal? Psychological Review, 92, 350-371.
37. McNeill, D. (1992). Hand and mind. Chicago, IL: University of Chicago Press.
38. McNeill, D. (2005). Gesture and thought. Chicago, IL: University of Chicago Press.
39. Morrel-Samuels, P., & Krauss, R. M. (1992). Word familiarity predicts temporal asynchrony of hand gestures and speech. Journal of Experimental Psychology, 18, 615-622.
40. Nobe, S. (1996). Representational gestures, cognitive rhythms, and acoustic aspects of speech: A network/threshold model of gesture production. Dissertation Abstracts International: Section A. The Humanities and Social Sciences, 57(07), 4736.
41. Port, R. F. (2003). Meter and speech. Journal of Phonetics, 31, 599-611.
42. Ragsdale, J. D., & Silvia, C. (1982). Distribution of kinesic hesitation phenomena in spontaneous speech. Language and Speech Teddington, 25, 185-190.
43. Rochet-Capellan, A., Laboissierre, R., Galvan, A., & Schwartz, J. (2008). The speech focus position effect on jaw-finger coordination in a pointing task. Journal of Speech, Language, and Hearing Research, 51, 1507-1521.
44. Rusiewicz, H. L. (2010). The role of prosodic stress and speech perturbation on the temporal synchronization of speech and deictic gestures (Doctoral dissertation). Available from ProQuest Dissertations and Theses database. (UMI No. 3417410)
45. Rusiewicz, H. L. (2011). Synchronization of speech and gesture: A dynamic systems perspective. Proceedings from the 2nd Gesture and Speech in Interaction (GESPIN) Conference, Bielefield, Germany. Abstract retrieved from http://coral2.spectrum.uni-bielefield.de/gespin2011/final/rusiewicz.pdf
46. Schwartz, R. G., Petinou, K., Goffman, L., Lazowski, G., & Cartusciello, C. (1996). Young children's production of syllable stress: An acoustic analysis. The Journal of the Acoustical Society of America, 99, 3192-3200.
47. Shriberg, L. D., Campbell, T. F., Karlsson, H. B., Brown, R. L., McSweeney, J. L., & Nadler, C. J. (2003). A diagnostic marker for childhood apraxia of speech: The lexical stress ratio. Clinical Linguistics & Phonetics, 17, 549-574.
48. Smith, A., McFarland, D. H., & Weber, C. M. (1986). Interactions between speech and finger movements: An exploration of dynamic pattern perspective. Journal of Speech and Hearing Research, 29, 471-480.
49. Treffner, P., & Peter, M. (2002). Intentional and attentional dynamics of speech-hand coordination. Human Movement Science, 21(5-6), 641-697.
50. Treffner, P., Peter, M., & Kleidon, M. (2008). Gestures and phases: The dynamics of speech-hand communication. Ecological Psychology, 20(1), 32-64.
51. Tuite, K. (1993). The production of gesture. Semiotica, 93, 83-105.
52. Turvey, M. T. (1990). Coordination. American Psychologist, 45, 938-953.
53. van Kuijk, D., & Boves, L. (1999). Acoustic characteristics of lexical stress in continuous telephone speech. Speech Communication, 27, 95-111.
54. van Lieshout, P. H. H. M. (2004). Dynamic systems theory and its application in speech. In B. Maassen, R. Kent, H. Peters, P. van Lieshout, & W. Hulstijn (Eds.), Speech motor control: In normal and disordered speech (pp. 51-82). New York, NY: Oxford University Press.