Multimodal communication between synthetic agents

Proceedings of the Workshop on Advanced Visual Interfaces AVI

Volumn , Issue , 1998, Pages 156-163

  Pelachaud, Catherine ^a   Poggi, Isabella ^b  

^a SAPIENZA UNIVERSITY OF ROME   (Italy)

^b ROMA TRE UNIVERSITY   (Italy)

Author keywords

3D synthetic agents; Facial expression; Speech acts; Visual modality

Indexed keywords

COMMUNICATIVE FUNCTIONS; FACIAL EXPRESSIONS; HUMAN COMMUNICATIONS; INDIVIDUAL BEHAVIOR; MULTIMODAL COMMUNICATIONS; SPEECH ACTS; SYNTHETIC AGENTS; VISUAL MODALITIES;

COMMUNICATION; USER INTERFACES;

LINGUISTICS;

EID: 65249130440     PISSN: None     EISSN: None     Source Type: Conference Proceeding    
DOI: 10.1145/948496.948518     Document Type: Conference Paper

References (43)

1. ARGYLE, M., AND COOK, M. Gaze and Mutual gaze. Cambridge University Press, 1976.
2. AUSTIN, J. How to do thinks with words. Oxford University Press, London, 1962.
3. BIRDWHISTELL, R. kinesics and context: essays on body motion communication. University of Pennsylvania, 1970.
4. BOLINGER, D. Intonation and its Part. Stanford University Press, 1986.
5. BULL, P. Posture and Gesture. Pergamon Press, 1987.
6. CASSELL, J., PELACHAUD, C, BADLER, N., STEEDMAN, M., ACHORN, B., BECKETT, T., DOUVILLE, B., PRÉVOST, S., AND STONE, M. Animated conversation: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. Computer Graphics Annual Conference Series (1994), 413-420.
7. CASTELFRANCHI, C, AND PARISI, D. Linguaggio, conoscenze e scopi. Il Mulino, Bologna, 1980.
8. CHOVIL, N. Social determinants of facial displays. Journal of Nonverbal Behavior 15, 3 (Fall 1991), 141-154.
9. COHEN, M. M., AND MASSARO, D. W. Modeling coar-ticulation in synthetic visual speech. In Models and Techniques in Computer Animation (Tokyo, 1993), M. Magnenat-Thalmann and D. Thalmann, Eds., Springer-Verlag.
10. CONTE, R., AND CASTELFRANCHI, C. Cognitive and Social Action. University College, London, 1995.
11. DAVIS, J., AND HIRSCHBERG, J. Assigning intonational features in synthesized spoken directions. In 25th Annual Meeting of the Association for Computational Linguistics (Buffalo, 1987), pp. 187-193.
12. DE ROSIS, F., AND GRASSO, F. Mediating between hearer's and speaker's views in the generation of adaptive explanations. Expert Systems with Applications 8, 4 (1995).
13. DUNCAN, S. Some signals and rules for taking speaking turns in conversations. In Nonverbal Communication, S. Weitz, Ed. Oxford University Press, 1974.
14. EKMAN, P. About brows: emotional and conversational signals. In Human ethology: claims and limits of a new disipline: contributions to the Colloquium, M. von Cranach, K. Foppa, W. Lepenies, and D. Ploog, Eds. Cambridge University Press, Cambridge, England; New-York, 1979, pp. 169-248.
15. EKMAN, P. Emotion in the human face. Cambridge University Press, 1982.
16. EKMAN, P., AND FRIESEN, W. The repertoire of nonverbal behavior: Categories, origins, usage, and coding. Semiotica 1 (1969).
17. EKMAN, P., AND FRIESEN, W. Facial Action Coding System. Consulting Psychologists Press, Inc., 1978.
18. GUIARD-MARIGNY, T., ADJOUDANI, A., AND BENOIT, C. 3d models of the lips and jaw for visual speech synthesis. In Progress in Speech Synthesis, J. van Santen, R. Sproat, J. Olive, and J. Hirschberg, Eds. Springier-Verlag, 1996.
19. HIRSCHBERG, J. Accent and discourse context: Assigning pitch accent in synthetic speech. In aaai90 (1990), pp. 952-957.
20. KALRA, P., GOBBETTI, E., MAGNENAT-THALMANN, N., AND THALMANN, D. A multimedia testbed for facial animation control. In International Conference of Multi-Media Modeling, MMM'93 (Singapore, Nov 9-12, 1993), T. Chua and T. Kunii, Eds., pp. 59-72.
21. KENDON, A. Gesticulation and speech: Two aspects of the process of utterance. In The Relation between Verbal and Nonverbal Communication, M.R. Key, Ed. Mouton, 1980, pp. 207-227.
22. LAVER, J. The gift of speech. Edinburgh University Press, 1991.
23. LEE, Y., TERZOPOULOS, D., AND WATERS, K. Realistic modeling for facial animation. Computer Graphics Annual Conference Series (1995), 55-62.
24. MAGNO-CALDOGNETTO, E., AND POGGI, I. Micro- and macro-bimodality. In Proceedings of the Workshop on Audio Visual Speech Perception (Rhodes, September 26-27, 1997 1997), C. Benoit and R. Campbell, Eds.
25. MCNEILL, D. Hand and Mind: What Gestures Reveal about Thought. University of Chicago, 1992.
26. PELACHAUD, C. Functional decomposition of facial expressions for an animated system. In Advanced Visual Interfaces (Rome, May 1992), M. C. T. Catarci and S. Levialdi, Eds., vol. 36, World Scientific Series in Computer Science, pp. 26-49.
27. PELACHAUD, C, BADLER, N., AND STEEDMAN, M. Generating facial expressions for speech. Cognitive Science 20, 1 (January-March 1996), 1-46.
28. PELACHAUD, C, AND PRÉVOST, S. Sight and sound: Generating facial expressions and spoken intonation from context. In Proceedings of the ESCA/AAAI/IEEE workshop on Speech Synthesis (New Paltz, New York, September 1994).
29. PLATT, S. A Structural Model of the Human Face. PhD thesis, University of Pennsylvania, Dept. of Computer and Information Science, Philadelphia, PA, 1985.
30. POGGI, I. Le parole nella testa. Guida a un 'educazione linguistica cognitivista. Il Mulino, Bologna, 1987.
31. POGGI, I., AND CALDOGNETTO, E. M. Moni che parlano. Gesti e Psicologia della comunicazione. Padova: Unipress, 1997.
32. POGGI, I., AND CASTELFRANCHI, C. Dare consigli. In 2nd International Workshop on Language Teachers. DILIT/International House, Rome, 1990, pp. 29-49.
33. PREVOST, S. A Semantics of Discourse Information for Specifying Intonation in Spoken Language Generation. PhD thesis, University of Pennsylvania, 1995.
34. PRÉVOST, S., AND STEEDMAN, M. Specifying intonation from context for speech synthesis. Speech Communication 15 (1994), 139-153.
35. RIST, T., ANDRÉ, E., AND MÜLLER, J. Adding animated presentation agents to the interface. In Intelligent User Interface (1997), pp. 79-86.
36. SCHERER, K. The functions of nonverbal signs in conversation. In The Social and Physiological Contexts of Language, H. G. R. St. Clair, Ed. Lawrence Erlbaum Associates, 1980, pp. 225-243.
37. SEARLE, J. Speech Acts. Cambridge University Press, London, 1969.
38. TAKEUCHI, A., AND NAGAO, K. Communicative facial displays as a new conversational modality. In ACM/IFIP INTERCHI'93 (Amsterdam, 1993).
39. THÖRISSON, K. Layered modular action control for communicative humanoids. In Computer Animation '97 (Geneva, Switzerland, 1997), IEEE Computer Society Press.
40. VATIKIOTIS-BATESON, E., BATESON, K., KASAHARA, Y., GARCIA, F., AND YEHIA, H. Characterizing audiovisual information during speech. In ICSLP (1996).
41. WATERS, K. A muscle model for animating three-dimensional facial expressions. Computer Graphics 21, 4 (July 1987), 17-24.
42. WATERS, K., AND TERZOPOULOS, D. A physical model of facial tissue and muscle articulation. Proceedings of the First Conference on Visualization in Biomedical Computing (May 1990), 77-82.
43. WILLIAMS, C, AND STEVENS, K. Vocal correlates of emotional states. In Speech evaluation in psychiatry, Darby, Ed. Grune and Stratton, New-York, 1981.