The power of a nod and a glance: envelope vs. emotional feedback in animated conversational agents

Applied Artificial Intelligence

Volumn 13, Issue 4-5, 1999, Pages 519-538

  Cassell, Justine ^a   Thórisson, Kristinn R ^a  

^a MIT MEDIA LAB   (United States)

Author keywords

[No Author keywords available]

Indexed keywords

COMMUNICATION; COMPUTER SYSTEMS; HUMAN COMPUTER INTERACTION; SPEECH RECOGNITION; USER INTERFACES;

ANIMATED CONVERSATIONAL AGENTS; EMOTIONAL FEEDBACK; ENVELOPE FEEDBACK;

ARTIFICIAL INTELLIGENCE;

EID: 0345073118     PISSN: 08839514     EISSN: 10876545     Source Type: Journal    
DOI: 10.1080/088395199117360     Document Type: Article

References (35)

1. André, E., and T. Rist. 1996. Coping with temporal constraints in multimedia presentation planning. In Proc. AAAI-96,142-147.
2. Bates, J. 1994. The role of emotion in believableagents. Commun. ACM 37(7):122-125.
3. Britton, B. C. J. 1991. Enhancing computer-human interaction with animated facial expressions. Master’s thesis, Massachusetts Institute of Technology, Cambridge, Mass.
4. Cassell, J. In press. Embodied conversation: Integrating face and gesture into automatic spoken dialogue systems. In Spoken dialogue systems, ed. S. Luperfoy. Cambridge, Mass.: MIT Press.
5. Cassell, J., C. Pelachaud, N. I. Badler, M. Steedman, B. Achorn, T. Beckett, B. Douville, S. Prevost and M. Stone. 1994. Animated conversation: Rule-based generation of facial expression, gesture and spoken intonation for multiple conversational agents. Comput. Graphics 28(4): 413-420.
6. Cassell, J., O. Torres, and S. Prevost. In press. Turn taking vs. discourse structure: How best to model multimodal conversation. In Machine conversations, ed. Y. Wilks. The Hague: Kluwer.
7. Cawsey, A. 1993. Planning interactive explanations. Int. J. Man-Machine Stud. 38:169-199.
8. Duncan, S. 1974. Some signals and rules for taking speaking turns in conversations. In Nonverbal communication, ed. S. Weitz. New York: Oxford University Press.
9. Ekman, P. 1979. About brows: Emotional and conversational signals. In Human ethology: Claims and limits of a new discipline, eds. M. von Cranach, K. Foppa, W. Lepenies, and D. Ploog, 169-249. New York: Cambridge University Press.
10. Ekman, P., and W. V. Friesen. 1984. Unmasking the face. Palo Alto, Calif.: Consulting Psychologists Press.
11. Elliott, C. 1997. I picked up Catapia and other stories: A multimodal approach to expressivity for “emotionally intelligent’ agents. In Proc. First International Conference on Autonomous Agents, 451-457. February 5-8, Marina del Rey, Calif.
12. Hasegawa, O., K. Itou, T. Kurita, S. Hayamizu, K. Tanaka, K. Yamamoto, and N. Otsu. 1995. Active agent oriented multimodal interface system. In Proc. IJCAI, 82-87. August 19-25, Montreal, Quebec, Canada.
13. Hauptman, A. G. 1989. Speech and gestures for graphic image manipulation. In Proc. SIGCHI 89, 241-245. New York: ACM Press.
14. King, W. J., and J. Ohya. 1996. The representation of agents: Anthropomorphism, agency and intelligence. In Proc. CHI ’96: ACM Conference on Human Factors in Computing Systems, 289-290. New York: ACM Press.
15. Koda, T., and P. Maes. 1996. Agents with faces: The effects of personification of agents. Presented at Human-Computer Interaction ’96, August, London, UK.
16. Lanier, J. 1995. Agents of alienation. Interactions 2(3): 66-72.
17. Laurel, B. 1992. Anthropomorphism: From Eliza to Terminator 2. Panelist discussion (A. Don, moderator): In CHI ’92 Conference Proceedings: ACM Conference on Human Factors in Computing, 67-70. May 3-7, Monterey, Calif.
18. Lester, J., J. Voerman, S. Towns and C. Callaway. 1997. Cosmo: A life-like animated pedagogical agent with deictic believability. In Working Notes of the IJCAI ’97 Workshop on Animated Interface Agents: Making Them Intelligent, 61-69. August, Nagoya, Japan.
19. Maes, P. 1994. Agents that reduce work and information overload. Commun. ACM 37(7):31-40.
20. Maulsby, D., D. Greenberg, and R. Mander. 1993. Prototyping an intelligent agent through Wizard of OZ. In Proc. InterCHI ’93, 277-284. April 24-29, Amsterdam, Netherlands.
21. McNeill, D. 1992. Hand and mind: What gestures reveal about thought. Chicago: University of Chicago Press.
22. Moore, J. D., and C. L. Paris. 1993. Planning text for advisory dialogues: Capturing intentional and rhetorical information. Comput. Linguistics 19(4): 651-695.
23. Nagao, K., and A. Takeuchi. 1994. Social interaction: Multimodal conversation with social agents. In Proc. 12th National Conference on Artificial Intelligence (AAAI-94), vol. 1, 22-28. August 1-4, Seattle, Wash.
24. Nass, C., J. Steuer, E. Tauber, and H. Reeder. 1993. Anthropomorphism, agency and ethopoeia: Computers as social actors. In InterCHI ’93 Adjunct Proceedings, 111-112.
25. Neal, J. G., and S. C. Shapiro. 1991. Intelligent multi-media interface technology. In Intelligent user interfaces, eds. J. W. Sullivan, and S. W. Tyler, pp. 11-45. New York: Addison-Wesley.
26. Ochsman, R. B., and A. Chapanis. 1974. The effects of 10 communication modes on the behavior of teams during co-operativeproblem solving. Int. J. Man-Machine Stud. 6:579-619.
27. Pelachaud, C., N. I. Badler, and M. Steedman. 1991. Linguistic issues in facial animation. In Computer animation ’91, eds. N. Magnenat-Thalmannand D. Thalmann, 15-30. New York: Springer-Verlag.
28. Sparrell, C. J. 1993. Coverbal iconic gesture in human-computer interaction. Master’s thesis, MIT Media Laboratory, Massachusetts Institute of Technology, Cambridge, Mass.
29. Takeuchi, A., and K. Nagao. 1993. Communicative facial displays as a new conversational modality. In Proc. InterCHI, ’93,187-193. April 24-29, Amsterdam, Netherlands.
30. Takeuchi, A., and T. Naito. 1995. Situated facial displays: Towards social interaction. In Human factors in computing systems: CHI ’95 Conference Proceedings, 450-454. May 7-11, Denver, Colo.
31. Thórisson, K. R. 1994. Face-to-face communication with computer agents. In AAAI Spring Symposium on Believable Agents Working Notes, 86-90. March 19-20, Stanford University, Stanford, Calif.
32. Thórisson, K. R. This issue. A mind model of multimodal communicative creatures and humanoids. Applied Artificial intelligence.
33. Thórisson K. R., D. B. Koons and R. A. Bolt. 1992. Multi-modal natural dialogue. In SIGCHI Proc. ’92, 653-654. (Also in SIGGRAPH Video Review, CHI ’92 Technical Video Program 76(1).)
34. Wahlster, W. 1991. User and discourse models for multimodal communication. In Intelligent user interfaces, eds. J. W. Sullivan and S. W. Tyler, 45-67. New York: Addison-Wesley.
35. Yngve, V. H. 1970. On getting a word in edgewise. In Papers from the Sixth Regional Meeting, 567-578. Chicago, ILL.: Chicago Linguistics Society.