Are Eyebrow Movements Linked to Voice Variations and Turn-taking in Dialogue? An Experimental Investigation

Language and Speech

Volumn 52, Issue 2-3, 2009, Pages 207-222

  Guaïtella, Isabelle ^a,c   Santi, Serge ^b,c   Lagrue, Benoǐt ^c   Cavé, Christian ^a  

^a AIX MARSEILLE UNIVERSITÉ   (France)

^b UNIVERSITÉ DE FRANCHE COMTÉ   (France)

^c Association GeVoix   (France)

Author keywords

Eyebrow movements; Fundamental frequency; Interaction; Turn taking; Voice gesture relationship

Indexed keywords

EID: 67949103363     PISSN: 00238309     EISSN: None     Source Type: Journal    
DOI: 10.1177/0023830909103167     Document Type: Article

References (33)

1. Barkhuysen, P., Krahmer, E., & Swerts, M. (2008). The interplay between the auditory and visual modality for end-of-utterance detection. The Journal of the Acoustical Society of America, 123, 354-336.
2. Beskow, J., Granström, B., & House, D. (2006). Visual correlates to prominence in several expressive modes. In Proceedings of the International Conference on Spoken Language Processing-Interspeech 2006 (pp.1272-1275). Pittsburgh, PA: Interspeech 2006-ICSLP.
3. Birdwhistell, R.L. (1970). Kinesics and context: Essays on Body Motion Communication. Philadelphia: University of Pennsylvania Press.
4. Bolinger, D.L. (1998). Intonation in American English [preliminary version of article not published in its entirety). In D. J. Hirst & A. Di Cristo (Eds.), Intonation systems: a survey of twenty languages (pp.4 5-55). Cambridge: Cambridge University Press.
5. Branderud, P. (1985). Movetrack-A movement tracking system. In Proceedings of the French Swedish Symposium on Speech (pp.113-122). Grenoble: GALF.
6. Cavé, C., Guaïtella, I., Bertrand, R., Santi, S., Harlay, F., & Espesser, R. (1996). About the relationship between eyebrow movements and F0 variations. In H. T. Bunnell & W. Isardi (Eds.), Proceedings of the 4th International Conference on Spoken Language Processing (pp.2 175-2178). Philadelphia, PA: University of Delaware and Alfred I. duPont Institute.
7. Cavé, C., Guaïtella, I., & Santi, S. (2001). Oralité et gestualité: Interaction et comportements multimodaux dans la communication. Paris: L'Harmattan.
8. Cavé, C., Guaïtella, I., & Santi, S. (2002). Eyebrow movements and voice variations in dialogue situations. In J. H. L. Hansen & B. Pellom (Eds.), Proceedings of the 7th International Conference on Spoken Language Processing (pp.2353-2356). Denver, CO.
9. Condon, W.S. (1976). An analysis of behavioral organization. Sign Language Studies, 13, 285-318.
10. D'Amoco, M., & Ferrigno, G. (1990). Technique for the evaluation of derivatives from noisy biomechanical displacement data using a model-based bandwidth-selection procedure. Medical and Biological Engineering and Computing, 28, 407-415. (Pubitemid 20299452)
11. Darwin, C.R. (1872). The expression of the emotions in man and animals. London: John Murray.
12. Ekman, P. (1979). About brows: Emotional and conversational signals. In M. von Cranach, K. Foppa, W. Lepenies, & D. Ploog (Eds.), Human ethology: Claims and limits of a new discipline (pp. 169-202). Cambridge University Press.
13. Ekman, P., & Friesen, W. (1975). Unmasking the face: A guide to recognizing emotions from facial clues. Englewood Cliffs, NJ: Prentice Hall.
14. Ferrigno, G., & Pedotti, A. (1985). ELITE: A digital dedicated hardware system for movement analysis via real-time TV signal processing. IEEE Transactions on Biomedical Engineering, 32 (11). 943-950.
15. Fraisse, P. (1974). Psychologie du rythme. Paris: Presses Universitaires de France.
16. French, P., & Local, J. (1983). Turn-competitive incomings. Journal of Pragmatics, 7 (1). 17-38.
17. Guaïtella, I. (1991). Rythme et parole: Comparaison critique du rythme de la lecture oralisée et de la parole spontanée. Doctoral thesis, Université de Provence, Aix-en-Provence, France.
18. Guaïtella, I. (1995). Mélodie du geste, mimique vocale ? Semiotica, 103 (3 / 4). 253-276.
19. Guaïtella, I. (1999). Rhythm in speech: What rhythmic organizations reveal about cognitive processes in spontaneous speech production versus reading aloud. Journal of Pragmatics, 31 (4). 509-523.
20. Guaïtella, I., Cavé, C., & Santi, S. (1993). Relations entre geste et voix: Le cas des sourcils et de la fréquence fondamentale. In Images et Langages: Multimodalité et modélisation cognitive. Actes du colloque interdisciplinaire du Comité National de la Recherche Scientifique (pp. 261-268). Paris: CNRS.
21. Guaïtella, I., Dolbec, J., Yehouenou, B., Santi, S., & Diallo, A.M. (1998). Étude prosodique de l'hésitation vocale: universalité et variation culturelle. Actes du colloque N'Wave, 26.
22. Guaïtella, I., Santi, S., Autesserre, D., Boyer, J., Lagrue, B., & Purson, A. (2001). Voix mělées, regards croisés, tissage de l'interaction. In C. Cavé, I. Guaïtella & S. Santi (Eds.), Oralité et gestualité: Interactions et comportements multimodaux dans la communication (pp. 464-469). Paris: L'Harmattan.
23. Guaïtella, I., Santi, S., Cavé, C., Bertrand, R., Boyer, J., Faraco, M., Lagrue, B., Mignard, P., Paboudjian, C., & Purson, A. (1998). Les relations voco-gestuelles dans la communication interpersonnelle: Emergence d'une problématique et carrefour interdisciplinaire. In S. Santi, I. Guaïtella, C. Cavé, & G. Konopczynski (Eds.), Oralité et gestualité: Communication multimodale, interaction (pp. 13-24). Paris: L'Harmattan.
24. Hirst, D.J. (1983). Structures and categories in prosodic representations. In A. Cutler & D. R. Ladd (Eds.), Prosody models and measurements (pp. 93-109). Berlin: Springer Verlag.
25. Hirst, D. J., & Di Cristo, A. (Eds.). (1998). Intonation systems: A survey of twenty languages. Cambridge: Cambridge University Press.
26. Hutois, M., & Scotto DI Carlo, N. (2006). Analyse anatomo-physiologique des systémes ostéo-articulaire et ventilatoire impliqués dans le chant. Médecine des Arts, 57, 8-17.
27. Krahmer, E., & Swerts, M. (2004). More about brows. In Z. Ruttkay & C. Pelachaud (Eds.), From brows to trust: Evaluating embodied conversational agents (pp. 194-216). Dordrecht: Kluwer Academic Press.
28. Krahmer, E., & Swerts, M. (2007). The effects of visual beats on prosodic prominence: acoustic analyses, auditory perception and visual perception. Journal of Memory and Language, 57, 396-414.
29. Nguyen, N. (2000). A MATLAB toolbox for the analysis of articulatory data in the production of speech. Behavior Research Methods, Instruments, and Computers, 32, 464-467.
30. Purson, A., Bertrand, R., Guaïtella, I., Boyer, J., Cavé, C., Santi, S., ET AL. (1998). Mouvements de sourcils dans le questionnement: Relation entre geste et voix. In S. Santi, I. Guaïtella, C. Cavé, & G. Konopczynski (Eds.), Oralité et gestualité: communication multimodale, interaction (pp. 561-566). Paris: L'Harmattan.
31. Santi, S., Guaïtella, I., Cavé, C., & Konopczinsky, G. (1998). Oralité et gestualité: communication multimodale, interaction. Paris: L'Harmattan.
32. Scotto DI Carlo, N. (1973). Analyse sémiologique des gestes et mimiques des chanteurs d'opéra. Semiotica, 9 (4). 289-317.
33. Swerts, M., & Krahmer, E. (2008). Facial expression and prosodic prominence: Effects of modality and facial area. Journal of Phonetics, 36, 219-238.