Evaluating models of speaker head nods for virtual agents

Proceedings of the International Joint Conference on Autonomous Agents and Multiagent Systems, AAMAS

Volumn 3, Issue , 2010, Pages 1257-1263

  Lee, Jina ^a   Wang, Zhiyang ^a   Marsella, Stacy ^a  

^a University of Southern California ^*  (United States)

Author keywords

Embodied Conversational Agents; Evaluation; Head Nods; Nonverbal Behaviors; Virtual Agents

Indexed keywords

AUTONOMOUS AGENTS; LEARNING SYSTEMS; VIRTUAL REALITY;

BEHAVIOR-BASED; DATA-DRIVEN APPROACH; EMBODIED CONVERSATIONAL AGENT; EVALUATING MODELS; EVALUATION; HEAD NOD; NON-VERBAL BEHAVIOURS; RULE-BASED APPROACH; VIRTUAL AGENT; VIRTUAL HUMANS;

MULTI AGENT SYSTEMS;

EID: 81155128888     PISSN: 15488403     EISSN: 15582914     Source Type: Conference Proceeding    
DOI: None     Document Type: Conference Paper

References (23)

1. K. Bergmann and S. Kopp. GNetic-using bayesian decision networks for iconic gesture generation. In Proceedings of the 9th International Conference on Intelligent Virtual Agents, pages 76-89, 2009.
2. W. Breitfuss, H. Prendinger, and M. Ishizuka. Automated generation of non-verbal behavior for virtual embodied characters. In ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces, pages 319-322, New York, NY, USA, 2007. ACM.
3. C. Busso, Z. Deng, M. Grimm, U. Neumann, and S. Narayanan. Rigid head motion in expressive speech animation: Analysis and synthesis. IEEE Transactions on Audio, Speech and Language Processing, 15(3):1075-1086, 2007.
4. J. Cassell. More than just another pretty face: Embodied conversational interface agents. Communications of the ACM, 43:70-78, 2000.
5. J. Cassell, H. H. Vilhjálmsson, and T. Bickmore. BEAT: the behavior expression animation toolkit. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, pages 477-486, New York, NY, USA, 2001. ACM.
6. U. Hadar, T. J. Steiner, and F. C. Rose. Head movement during listening turns in conversation. Journal of Nonverbal Behavior, 9(4):214-228, 1985.
7. D. Heylen. Challenges ahead: Head movements and other social acts in conversations. In AISB 2005, Social Presence Cues Symposium, 2005.
8. L. Huang, L.-R. Morency, and J. Gratch. Parasocial consensus sampling: Combining multiple perspectives to learn virtual human behavior. In AAMAS '10: Proceedings of the 9th international joint conference on Autonomous agents and multiagent systems. International Foundation for Autonomous Agents and Multiagent Systems, 2010.
9. A. Kendon. Some uses of the head shake. Gesture, 2:147-182(36), 2002.
10. M. Kipp, M. Neff, K. H. Kipp, and I. Albrecht. Towards natural gesture synthesis: Evaluating gesture units in a data-driven approach to gesture synthesis. In Proceedings of the 7th International Conference on Intelligent Virtual Agents, pages 15-28, 2007.
11. M. Knapp and J. Hall. Nonverbal Communication in Human Interaction. Harcourt Brace College Publishers, 4th edition, 1997.
12. F. L. A. Knoppel, A. S. Tigelaar, D. O. Bos, T. Alofs, and Z. Ruttkay. Trackside DEIRA: a dynamic engaging intelligent reporter agent. In AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, pages 112-119, Richland, SC, 2008. International Foundation for Autonomous Agents and Multiagent Systems.
13. S. Kopp, B. Krenn, S. Marsella, A. Marshall, C. Pelachaud, H. Pirker, K. Thorisson, and H. Vilhjálmsson. Towards a common framework for multimodal generation in embodied conversation agents: a behavior markup language. In Proceedings of 6th International Conference on Virtual Agents, pages 205-217, Marina del Rey, CA, USA, 2006.
14. J. Lee and S. Marsella. Nonverbal behavior generator for embodied conversational agents. In Proceedings of the 6th International Conference on Intelligent Virtual Agents, pages 243-255. Springer, 2006.
15. J. Lee and S. Marsella. Learning a model of speaker head nods using gesture corpora. In AAMAS '09: Proceedings of the 8th international joint conference on Autonomous agents and multiagent systems. International Foundation for Autonomous Agents and Multiagent Systems, 2009.
16. J. Lee, H. Prendinger, A. Neviarouskaya, and S. Marsella. Learning models of speaker head nods with affective information. In ACII '09: Proceedings of the 3rd International Conference on Affective Computing and Intelligent Interaction. International Foundation for Autonomous Agents and Multiagent Systems, 2009.
17. E. Z. McClave. Linguistic functions of head movements in the context of speech. Journal of Pragmatics, 32:855-878(24), June 2000.
18. A. Mignault and A. Chaudhuri. The many faces of a neutral face: Head tilt and perception of dominance and emotion. Journal of Nonverbal Behavior, 2(27):111-132, June 2003.
19. L.-P. Morency, I. de Kok, and J. Gratch. Predicting listener backchannels: A probabilistic multimodal approach. In Proceedings of the 8th International Conference on Intelligent Virtual Agents, pages 176-190, 2008.
20. K. G. Munhall, J. A. Jones, D. E. Callan, T. Kuratate, and E. Vatikiotis-Bateson. Visual prosody and speech intelligibility: Head movement improves auditory speech perception. Psychological Science, 15:133-137(5), February 2004.
21. A. Neviarouskaya, H. Prendinger, and M. Ishizuka. Textual affect sensing for sociable and expressive online communication. In ACII '07: Proceedings of the 2nd international conference on Affective Computing and Intelligent Interaction, pages 218-229, Berlin, Heidelberg, 2007. Springer-Verlag.
22. M. Strauss and M. Kipp. Eric: a generic rule-based framework for an affective embodied commentary agent. In L. Padgham, D. C. Parkes, J. Müller, and S. Parsons, editors, AAMAS '08: Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems, pages 97-104, Richland, SC, 2008. International Foundation for Autonomous Agents and Multiagent Systems.
23. G. Tom, P. Pettersen, T. Lau, T. Burton, and J. Cook. The role of overt head movement in the formation of affect. Basic and Applied Social Psychology, 12(3):281-289, 1991.