Eyebrow raises in dialogue and their relation to discourse structure, utterance function and pitch accents in English

Speech Communication

Volumn 52, Issue 6, 2010, Pages 542-554

  Flecha García, María L ^a  

^a UNIVERSITY OF EDINBURGH   (United Kingdom)

Author keywords

Dialogue structure; Facial movement; Multimodality; Non verbal communication; Pitch accent

Indexed keywords

DISCOURSE STRUCTURE; FACE-TO-FACE DIALOGUES; FACE-TO-FACE INTERACTION; FACIAL MOVEMENTS; LINGUISTIC SIGNALS; MULTI-MODALITY; MULTIMODAL COMMUNICATIONS; NON-VERBAL COMMUNICATIONS; ON-BODY; PITCH ACCENTS; SPOKEN LANGUAGES; VERBAL MESSAGES;

LINGUISTICS; SPEECH RECOGNITION;

COMMUNICATION;

EID: 77951108686     PISSN: 01676393     EISSN: None     Source Type: Journal    
DOI: 10.1016/j.specom.2009.12.003     Document Type: Article

References (27)

1. Anderson A.H., Bader M., Bard E.G., Boyle E., Doherty G., Garrod S., Isard S., Kowtko J., McAllister J., Miller J., Sotillo C., Thompson H.S., and Weiniert R. The HCRC map task corpus. Lang. Speech 344 (1991) 351-366
2. Bolinger D. Intonation and its Parts: Melody in Spoken English (1986), University Press Stanford, Stanford, CA
3. Carletta J., Isard S., Doherty-Sneddon G., Isard A., Kowtko J.C., and Anderson A.H. The reliability of a dialogue structure coding scheme. Comput. Linguist. 231 (1997) 13-31
4. Cassell, J., Nakano, Y.I., Bickmore, T.W., Sidner, C.L., Rich, C., 2001. Nonverbal cues for discourse structure. In: Proc. 41st Annual Meeting of the Association of Computational Linguistics, pp. 106-115.
5. Cavé, C., Guaitella, I., Bertrand, R., Santi, S., Harlay, F., Espesser, R., 1996. About the relationship between eyebrow movements and F0 variations. In: Proc. ICSLP, pp. 2175-2178.
6. Cavé, C., Guaitella, I., Santi, S., 2002. Eyebrow movements and voice variations in dialogue situations: an experimental investigation. In: Proc. ICSLP, pp. 2353-2356.
7. Chovil N. Discourse-oriented facial displays in conversation. Research on Language and Social Interaction 25 (1991) 163-194 (Published as 1991/92)
8. De Ruiter J.P. The production of gesture and speech. In: McNeill D. (Ed). Language and Gesture: Window into Thought and Action (2000), Cambridge University Press, Cambridge 284-311
9. Ekman P. About brows: emotional and conversational signals. In: von Cranach M., Foppa K., Lepenies W., and Ploog D. (Eds). Human Ethology (1979), Cambridge University Press 169-249
10. Flecha-García, M.L., 2006. Eyebrow Raising in Dialogue: Discourse Structure, Utterance Function, and Pitch Accents. Ph.D. Thesis, University of Edinburgh, Edinburgh.
11. Granström B., and House D. Audiovisual representation of prosody in expressive speech communication. Speech Commun. 46 (2005) 473-484
12. Keating, P., Baroni, M., Mattys, S., Scarborough, R., Alwan, A., Auer, E., Berstein, L., 2003. Optical phonetics and visual perception of lexical and phrasal stress in English. In: Proc. 16th Internat. Conf. of the Phonetic Sciences, pp. 2071-2074.
13. Kendon A. Some relationships between body motion and speech: An analysis of an example. In: Siegman A., and Pope B. (Eds). Studies in Dyadic Communication (1972), Pergamon, Elmsford, New York 177-210
14. Kendon A. Gesticulation and speech: two aspects of the process of utterance. In: Key M.R. (Ed). The Relationship of Verbal and Nonverbal Communication (1980), Mouton 207-227
15. Krahmer E.J., and Swerts M. More about brows: a cross-linguistic study via analysis-by-synthesis. In: Ruttkay Z., and Pelachaud C. (Eds). From Brows to Trust: Evaluating Embodied Conversational Agents (2004), Kluwer Academic Publishers
16. Krahmer E.J., and Swerts M. The effects of visual beats on prosodic prominence. Acoustic analyses, auditory perception and visual perception. J. Mem. Lang. 57 (2007) 396-414
17. Ladd D.R. Intonational Phonology (1996), Cambridge University Press, Cambridge, UK
18. Ladd D.R., and Schepman A. "Sagging transitions" between high pitch accents in English: experimental evidence. J. Phonetics 31 (2003) 81-112
19. McClave E. Pitch and manual gestures. J. Psycholinguist. Res. 27 1 (1998) 69-89
20. McClave E. Linguistic functions of head movements in the context of speech. J. Pragmatics 32 (2000) 855-878
21. McNeill D. Hand and Mind: What Gestures Reveal About Thought (1992), University of Chicago Press
22. McNeill D., Quek F., McCullough K., Duncan S., Furuyama N., and Bryll R. Catchments, prosody and discourse. Gesture 1 (2001) 9-33
23. Neter J., Wasserman W., and Kutner M. Applied Linear Statistical Models. fourth ed. (1996), Irwin, Chicago, London
24. Pitrelli, J., Beckman, M., Hirschberg, J., 1994. Evaluation of prosodic transcription labeling reliability in the ToBI framework. In: Proc. Internat. Conf. on Spoken Language Processing, pp. 123-126.
25. Silverman, K., Beckman, M. E., Pitrelli, J., Ostendorf, M., Wightman, C., Price, P., Pierrehumbert, J, Hirschberg, J., 1992. ToBI: a standard for labeling English prosody. In: Proc. 2nd Internat. Conf. on Spoken Language Processing, pp. 867-870.
26. Srinivasan R.J., and Massaro D.W. Perceiving prosody from the face and voice. Distinguishing statements from echoic questions in English. Lang. Speech 46 (2003) 1-22
27. Swerts M., and Krahmer E.J. Facial expressions and prosodic prominence. Effects of modality and facial area. J. Phonetics 36 (2008) 219-238