Head gesture timing is constrained by prosodic structure

Proceedings of the International Conference on Speech Prosody

Volumn , Issue , 2014, Pages 356-360

  Esteve Gibert, Núria ^a   Borràs Comes, Joan ^a   Swerts, Marc ^b   Prieto, Pilar ^a,c  

^a UNIVERSITAT POMPEU FABRA   (Spain)

^b TILBURG UNIVERSITY   (Netherlands)

^c INSTITUCIÓ CATALANA DE RECERCA I ESTUDIS AVANÇATS ICREA   (Spain)

Author keywords

Audiovisual speech; Catalan; Face to face communication; Head gestures; Prosodic structure

Indexed keywords

SPEECH; TIMING CIRCUITS;

AUDIO-VISUAL SPEECH; CATALANS; FACE-TO-FACE COMMUNICATIONS; HEAD GESTURES; PROSODIC STRUCTURE;

SPEECH COMMUNICATION;

EID: 84904653242     PISSN: 23332042     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.21437/speechprosody.2014-58     Document Type: Conference Paper

References (25)

1. Birdwhistell, R. L., "Introduction to kinesics: An annotated system for analysis of body motion and gesture". Department of State, Foreign Service Institute, Washington DC, 1952.
2. Birdwhistell, R. L., "Kinesics and context: Essays on body motion communication", University of Pennsylvania Press, Philadelphia, 1970.
3. Kendon, A., "Some relations between body motion and speech. An analysis of an example", in W. Siegman & B. Pope (Eds.), Studies in dyadic communication, Pergamon Press, New York, NY,177-210, 1972.
4. Kendon, A., "Gesticulation and speech: Two aspects of the process of utterance", in M. R. Key (Ed.), The relationship of verbal and nonverbal communication, Mouton, The Hague, The Netherlands, 207-227, 1980.
5. Kita, S., "How representational gestures help speaking", in D. McNeill (Ed.), Language and Gesture, Cambridge University Press, Cambridge, 2000.
6. De Ruiter, J. P., Gesture and speech production, unpublished doctoral dissertation). Katholieke Universiteit, Nijmegen, The Netherlands, 1998.
7. McNeill, D., Language and Gesture: Window into Thought and Action, Cambridge University Press, Cambridge, 2000.
8. McNeill, D., Hand and mind, University of Chicago Press, Chicago, IL, 1992.
9. Butterworth, B. and Beattie, G., "Gesture and silence as indicators of planning in speech", in R. Campbell & G. T. Smith (Eds.), Recent advances in the psychology of language: Formal and experimental approaches, Plenum Press, New York, NY, 347-360, 1978.
10. Loehr, D. P., "Aspects of rhythm in gesture and speech", Gesture, 7: 179-214, 2007.
11. Nobe, S., Representational gestures, cognitive rhythms, and acoustic aspects of speech: A network/ threshold model of gesture production, unpublished doctoral dissertation, University of Chicago, 1996.
12. Rochet-Capellan, A., Laboissière, R., Galván, A., and Schwartz, J. L., "The speech focus position effect on jaw-finger coordination in a pointing task", Journal of Speech, Language, and Hearing Research, 51: 1507-1521, 2008.
13. Roustan, B. and Dohen, M., "Co-production of contrastive prosodic focus and manual gestures: Temporal coordination and effects on the acoustic and articulatory correlates of focus", Proceedings of Speech Prosody 2010 Conference, 100110, 1-4, 2010.
14. Rusiewicz, H. L., Shaiman, S., Iverson, J. M., and Szuminsky, N., "Effects of perturbation and prosody on the coordination of speech and gesture", Speech Communication, 57,283-300, 2014.
15. Kendon, A., Gesture: Visible action as utterance, Cambridge University Press, Cambridge, 2004.
16. Ferré, G., "Timing relationships between speech and co-verbal gestures in spontaneous French", Proceedings of Language Resources and Evaluation, Workshop on Multimodal Corpora, 86-91, 2010.
17. Esteve-Gibert, N. and Prieto, P., "Prosodic structure shapes the temporal realization of intonation and manual gesture movements", Journal of Speech, Language, and Hearing Research 56: 850-864, 2013.
18. Loehr, D., "Temporal, structural, and pragmatic synchrony between intonation and gesture", Laboratory Phonology, 3(1): 71-89, 2012.
19. Beckman, M. and Ayers-Elam, G., "Guidelines for ToBI labeling", ver. 3, Ohio State University, 1997.
20. Borràs-Comes, J., Kaland, C., Prieto, P., and Swerts, M., "Audiovisual Correlates of Interrogativity: A Comparative Analysis of Catalan and Dutch", Journal of Nonverbal Behavior, in press, published online: 05 October 2013.
21. Krahmer, E. and Swerts, M., "The effects of visual beats on prosodic prominence: Acoustic analyses, auditory perception and visual perception", Journal of Memory and Language, 57(3): 396-414, 2007.
22. Ahmad, M. I., Tariq, H., Saeed, M., Shahid, S., and Krahmer, E., "Guess who? An interactive and entertaining game-like platform for investigating human emotions", in Jacko, J. A. (Ed.), Humancomputer interaction. Towards mobile and intelligent interaction environments, vol. 3, Lecture Notes in Computer Science, 6763, Springer, Berlin, 543-551, 2011.
23. Boersma, P. and Weenink, D., Praat: Doing phonetics by computer, version 5.3.04, computer program, 2012.
24. Lausberg, H. and Sloetjes, H., "Coding gestural behavior with the NEUROGES-ELAN system", Behavior Research Methods, Instruments, & Computers, 41: 841-849, 2009.
25. Wagner, P., Malisz, Z., and Kopp, S. "Gesture and speech in interaction: An overview". Sp. Comm 57: 209-232, 2014.